2023-10-21T16:03:33.929 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T16:03:33.930 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} --archive /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390 --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/orig.config.yaml 2023-10-21T16:03:33.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:03:34.061 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7434390' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: f0804064d67a2a63dbabf1801ff452580a050cfc valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: f0804064d67a2a63dbabf1801ff452580a050cfc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: f0804064d67a2a63dbabf1801ff452580a050cfc owner: scheduled_yuriw@teuthology priority: 76 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2514 sha1: f0804064d67a2a63dbabf1801ff452580a050cfc sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f0804064d67a2a63dbabf1801ff452580a050cfc syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYN4kKqT7xVgODcVRCSZe5jsFsOCfrHaPYJH+rwCRkYG91+v0SBq7FZ9g6EmXEL4IkiQDrCcWb6rqSUlfLBcL0= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVkwp3no3ElQupln7HpL62qvqewOLKkQLS2EhgGvpL4oHHkRLhvdEoXYU/8yLVd6YgEBtq2APMjTS0n0gnLgsg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-20_18:46:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-21T16:03:34.061 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa; will attempt to use it 2023-10-21T16:03:34.062 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks 2023-10-21T16:03:34.063 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-21T16:03:34.064 INFO:teuthology.task.internal:Checking packages... 2023-10-21T16:03:34.088 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f0804064d67a2a63dbabf1801ff452580a050cfc' 2023-10-21T16:03:34.088 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-21T16:03:34.089 INFO:teuthology.packaging:ref: None 2023-10-21T16:03:34.089 INFO:teuthology.packaging:tag: None 2023-10-21T16:03:34.089 INFO:teuthology.packaging:branch: main 2023-10-21T16:03:34.090 INFO:teuthology.packaging:sha1: f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:03:34.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-10-21T16:03:34.317 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6825.g33363a56 2023-10-21T16:03:34.317 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-21T16:03:34.323 INFO:teuthology.task.internal:no buildpackages task found 2023-10-21T16:03:34.324 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-21T16:03:34.351 INFO:teuthology.task.internal:Saving configuration 2023-10-21T16:03:34.369 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-21T16:03:34.385 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T16:03:34.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 15:58:32.509645', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYN4kKqT7xVgODcVRCSZe5jsFsOCfrHaPYJH+rwCRkYG91+v0SBq7FZ9g6EmXEL4IkiQDrCcWb6rqSUlfLBcL0='} 2023-10-21T16:03:34.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 15:58:32.511350', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVkwp3no3ElQupln7HpL62qvqewOLKkQLS2EhgGvpL4oHHkRLhvdEoXYU/8yLVd6YgEBtq2APMjTS0n0gnLgsg='} 2023-10-21T16:03:34.433 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-21T16:03:34.439 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-21T16:03:34.440 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-21T16:03:34.440 INFO:teuthology.run_tasks:Running task console_log... 2023-10-21T16:03:34.535 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f87b5b74b80>, signals=[15]) 2023-10-21T16:03:34.536 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-21T16:03:34.541 INFO:teuthology.task.internal:Opening connections... 2023-10-21T16:03:34.542 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:03:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:03:34.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:03:34.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:03:34.726 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-21T16:03:34.733 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-10-21T16:03:34.751 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-10-21T16:03:34.752 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-21T16:03:34.808 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-10-21T16:03:34.808 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-10-21T16:03:34.809 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-10-21T16:03:34.809 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-10-21T16:03:34.809 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-10-21T16:03:34.809 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-10-21T16:03:34.810 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T16:03:34.810 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-10-21T16:03:34.810 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-10-21T16:03:34.810 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T16:03:34.810 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-10-21T16:03:34.811 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:03:34.811 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T16:03:34.811 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T16:03:34.812 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-21T16:03:34.834 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-10-21T16:03:34.851 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-10-21T16:03:34.852 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-21T16:03:34.909 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-10-21T16:03:34.909 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2023-10-21T16:03:34.909 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-10-21T16:03:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-10-21T16:03:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2023-10-21T16:03:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2023-10-21T16:03:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T16:03:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-10-21T16:03:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2023-10-21T16:03:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T16:03:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-10-21T16:03:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:03:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T16:03:34.912 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T16:03:34.912 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-21T16:03:34.934 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-21T16:03:34.945 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-21T16:03:34.968 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-21T16:03:34.969 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-10-21T16:03:34.972 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2023-10-21T16:03:34.988 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-21T16:03:35.022 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-21T16:03:35.023 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-10-21T16:03:35.029 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2023-10-21T16:03:35.216 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-21T16:03:35.271 INFO:teuthology.run_tasks:Running task kernel... 2023-10-21T16:03:35.303 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-21T16:03:35.304 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-21T16:03:35.304 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-21T16:03:35.305 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-21T16:03:35.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T16:03:35.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-21T16:03:35.560 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-21T16:03:35.560 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-21T16:03:35.560 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-21T16:03:35.578 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-361.el9.x86_64 2023-10-21T16:03:35.579 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-21T16:03:35.579 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-21T16:03:35.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum upgrade -y linux-firmware 2023-10-21T16:03:37.636 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-10-21T16:03:39.019 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2023-10-21T16:03:40.693 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-10-21T16:03:42.494 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-10-21T16:03:48.361 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 5.7 MB 00:02 2023-10-21T16:03:49.695 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 15 kB 00:00 2023-10-21T16:03:51.457 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-10-21T16:03:56.154 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2023-10-21T16:03:58.435 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-21T16:03:58.444 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-21T16:03:58.444 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-21T16:03:58.445 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-21T16:03:58.445 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-10-21T16:03:58.445 INFO:teuthology.orchestra.run.smithi012.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-21T16:03:58.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:03:58.445 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-21T16:03:58.446 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-21T16:03:58.446 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 1 Package 2023-10-21T16:03:58.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:03:58.446 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 326 M 2023-10-21T16:03:58.446 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-21T16:04:04.662 INFO:teuthology.orchestra.run.smithi012.stdout:linux-firmware-20230926-140.el9.noarch.rpm 52 MB/s | 326 MB 00:06 2023-10-21T16:04:04.663 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-21T16:04:04.664 INFO:teuthology.orchestra.run.smithi012.stdout:Total 52 MB/s | 326 MB 00:06 2023-10-21T16:04:04.664 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-21T16:04:04.757 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-21T16:04:04.757 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-21T16:04:06.910 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-21T16:04:06.911 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-21T16:04:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-21T16:04:13.258 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-21T16:04:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-21T16:04:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-21T16:04:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-21T16:04:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-21T16:04:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:04:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-10-21T16:04:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-21T16:04:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:04:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-21T16:04:14.966 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-21T16:04:14.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-21T16:04:15.189 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-21T16:04:15.189 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-21T16:04:15.192 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi012.front.sepia.ceph.com to complete... 2023-10-21T16:04:27.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21 16:04:27 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-21T16:04:27.667 INFO:teuthology.orchestra.run.smithi012.stderr:FINISHED --2023-10-21 16:04:27-- 2023-10-21T16:04:27.667 INFO:teuthology.orchestra.run.smithi012.stderr:Total wall clock time: 12s 2023-10-21T16:04:27.667 INFO:teuthology.orchestra.run.smithi012.stderr:Downloaded: 1 files, 306M in 12s (25.2 MB/s) 2023-10-21T16:04:27.668 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-21T16:04:27.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-21T16:04:29.612 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying... ######################################## 2023-10-21T16:04:29.684 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing... ######################################## 2023-10-21T16:04:29.768 INFO:teuthology.orchestra.run.smithi012.stdout:Updating / installing... 2023-10-21T16:04:37.255 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-21T16:04:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-21T16:05:14.432 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-21T16:05:14.432 DEBUG:teuthology.orchestra.run.smithi012:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-21T16:05:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-21T16:05:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-21T16:05:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-21T16:05:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-21T16:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-21T16:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-21T16:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-21T16:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-21T16:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-21T16:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-21T16:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-21T16:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-21T16:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-21T16:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-21T16:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-21T16:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-21T16:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-21T16:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-21T16:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-21T16:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-21T16:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-21T16:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-21T16:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-21T16:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-21T16:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-21T16:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-21T16:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-21T16:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-21T16:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-21T16:05:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-21T16:05:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-21T16:05:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-21T16:05:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-21T16:05:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-21T16:05:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-21T16:05:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-21T16:05:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-21T16:05:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-21T16:05:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-21T16:05:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-21T16:05:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-21T16:05:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-21T16:05:14.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-21T16:05:14.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-21T16:05:14.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-21T16:05:14.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-21T16:05:14.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-21T16:05:14.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-21T16:05:14.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-21T16:05:14.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-21T16:05:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-21T16:05:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-21T16:05:14.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-21T16:05:14.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-21T16:05:14.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-21T16:05:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-21T16:05:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-21T16:05:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-21T16:05:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-21T16:05:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-21T16:05:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-21T16:05:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-21T16:05:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-21T16:05:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-21T16:05:14.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-21T16:05:14.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-21T16:05:14.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-21T16:05:14.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-21T16:05:14.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-21T16:05:14.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-21T16:05:14.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-21T16:05:14.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-21T16:05:14.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-21T16:05:14.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-21T16:05:14.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-21T16:05:14.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-21T16:05:14.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-21T16:05:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-21T16:05:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-21T16:05:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-21T16:05:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-21T16:05:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-21T16:05:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-21T16:05:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-21T16:05:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-21T16:05:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-21T16:05:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-21T16:05:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-21T16:05:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-21T16:05:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-21T16:05:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-21T16:05:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-21T16:05:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-21T16:05:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-21T16:05:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-21T16:05:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-21T16:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-21T16:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-21T16:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-21T16:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-21T16:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-21T16:05:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-21T16:05:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-21T16:05:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-21T16:05:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-21T16:05:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-21T16:05:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-21T16:05:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-21T16:05:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-21T16:05:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-21T16:05:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-21T16:05:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-21T16:05:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-21T16:05:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-21T16:05:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-21T16:05:14.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-21T16:05:14.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-21T16:05:14.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-21T16:05:14.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-21T16:05:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-21T16:05:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-21T16:05:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-21T16:05:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-21T16:05:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-21T16:05:14.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-21T16:05:14.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-21T16:05:14.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-21T16:05:14.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-21T16:05:14.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-21T16:05:14.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-21T16:05:14.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-21T16:05:14.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-21T16:05:14.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-21T16:05:14.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-21T16:05:14.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-21T16:05:14.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-21T16:05:14.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-21T16:05:14.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-21T16:05:14.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-21T16:05:14.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-21T16:05:14.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-21T16:05:14.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-21T16:05:14.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-21T16:05:14.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-21T16:05:14.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-21T16:05:14.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-21T16:05:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-21T16:05:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-21T16:05:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-21T16:05:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-21T16:05:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-21T16:05:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-21T16:05:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-21T16:05:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-21T16:05:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-21T16:05:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-21T16:05:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-21T16:05:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-21T16:05:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-21T16:05:14.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-21T16:05:14.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-21T16:05:14.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-21T16:05:14.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-21T16:05:14.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-21T16:05:14.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-21T16:05:14.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-21T16:05:14.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-21T16:05:14.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-21T16:05:14.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-21T16:05:14.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-21T16:05:14.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-21T16:05:14.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-21T16:05:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-21T16:05:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-21T16:05:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-21T16:05:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-21T16:05:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-21T16:05:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-21T16:05:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-21T16:05:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-21T16:05:14.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-21T16:05:14.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-21T16:05:14.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-21T16:05:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-21T16:05:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-21T16:05:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-21T16:05:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-21T16:05:14.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-21T16:05:14.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-21T16:05:14.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-21T16:05:14.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-21T16:05:14.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-21T16:05:14.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-21T16:05:14.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-21T16:05:14.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-21T16:05:14.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-21T16:05:14.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-21T16:05:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-21T16:05:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-21T16:05:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-21T16:05:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-21T16:05:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-21T16:05:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-21T16:05:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-21T16:05:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-21T16:05:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-21T16:05:14.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-21T16:05:14.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-21T16:05:14.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-21T16:05:14.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-21T16:05:14.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-21T16:05:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-21T16:05:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-21T16:05:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-21T16:05:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-21T16:05:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-21T16:05:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-21T16:05:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-21T16:05:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-21T16:05:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-21T16:05:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-21T16:05:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-21T16:05:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-21T16:05:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-21T16:05:14.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-21T16:05:14.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-21T16:05:14.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-21T16:05:14.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-21T16:05:14.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-21T16:05:14.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-21T16:05:14.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-21T16:05:14.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-21T16:05:14.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-21T16:05:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-21T16:05:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-21T16:05:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-21T16:05:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-21T16:05:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-21T16:05:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-21T16:05:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-21T16:05:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-21T16:05:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-21T16:05:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-21T16:05:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-21T16:05:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-21T16:05:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-21T16:05:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-21T16:05:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-21T16:05:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-21T16:05:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-21T16:05:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-21T16:05:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-21T16:05:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-21T16:05:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-21T16:05:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-21T16:05:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-21T16:05:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-21T16:05:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-21T16:05:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-21T16:05:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-21T16:05:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-21T16:05:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-21T16:05:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-21T16:05:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-21T16:05:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-21T16:05:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-21T16:05:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-21T16:05:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-21T16:05:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-21T16:05:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-21T16:05:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-21T16:05:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-21T16:05:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-21T16:05:14.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-21T16:05:14.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-21T16:05:14.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-21T16:05:14.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-21T16:05:14.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-21T16:05:14.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-21T16:05:14.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-21T16:05:14.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-21T16:05:14.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-21T16:05:14.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-21T16:05:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-21T16:05:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-21T16:05:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-21T16:05:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-21T16:05:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-21T16:05:14.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-21T16:05:14.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-21T16:05:14.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-21T16:05:14.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-21T16:05:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-21T16:05:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-21T16:05:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-21T16:05:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-21T16:05:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-21T16:05:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-21T16:05:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-21T16:05:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-21T16:05:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-21T16:05:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-21T16:05:14.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-21T16:05:14.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-21T16:05:14.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-21T16:05:14.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-21T16:05:14.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-21T16:05:14.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-21T16:05:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-21T16:05:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-21T16:05:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-21T16:05:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-21T16:05:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-21T16:05:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-21T16:05:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-21T16:05:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-21T16:05:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-21T16:05:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-21T16:05:14.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-21T16:05:14.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-21T16:05:14.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-21T16:05:14.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-21T16:05:14.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-21T16:05:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-21T16:05:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-21T16:05:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-21T16:05:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-21T16:05:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-21T16:05:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-21T16:05:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-21T16:05:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-21T16:05:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-21T16:05:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-21T16:05:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-21T16:05:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-21T16:05:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-21T16:05:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-21T16:05:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-21T16:05:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-21T16:05:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-21T16:05:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-21T16:05:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-21T16:05:14.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-21T16:05:14.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-21T16:05:14.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-21T16:05:14.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-21T16:05:14.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-21T16:05:14.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-21T16:05:14.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-21T16:05:14.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-21T16:05:14.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-21T16:05:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-21T16:05:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-21T16:05:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-21T16:05:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-21T16:05:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-21T16:05:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-21T16:05:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-21T16:05:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-21T16:05:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-21T16:05:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-21T16:05:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-21T16:05:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-21T16:05:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-21T16:05:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-21T16:05:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-21T16:05:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-21T16:05:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-21T16:05:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-21T16:05:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-21T16:05:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-21T16:05:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-21T16:05:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-21T16:05:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-21T16:05:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-21T16:05:14.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-21T16:05:14.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-21T16:05:14.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-21T16:05:14.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-21T16:05:14.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-21T16:05:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-21T16:05:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-21T16:05:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-21T16:05:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-21T16:05:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-21T16:05:14.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-21T16:05:14.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-21T16:05:14.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-21T16:05:14.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-21T16:05:14.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-21T16:05:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-21T16:05:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-21T16:05:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-21T16:05:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-21T16:05:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-21T16:05:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-21T16:05:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-21T16:05:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-21T16:05:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-21T16:05:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-21T16:05:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-21T16:05:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-21T16:05:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-21T16:05:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-21T16:05:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-21T16:05:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-21T16:05:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-21T16:05:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-21T16:05:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-21T16:05:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-21T16:05:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-21T16:05:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-21T16:05:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-21T16:05:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-21T16:05:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-21T16:05:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-21T16:05:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-21T16:05:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-21T16:05:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-21T16:05:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-21T16:05:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-21T16:05:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-21T16:05:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-21T16:05:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-21T16:05:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-21T16:05:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-21T16:05:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-21T16:05:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-21T16:05:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-21T16:05:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-21T16:05:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-21T16:05:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-21T16:05:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-21T16:05:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-21T16:05:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-21T16:05:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-21T16:05:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-21T16:05:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-21T16:05:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-21T16:05:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-21T16:05:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-21T16:05:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-21T16:05:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-21T16:05:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-21T16:05:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-21T16:05:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-21T16:05:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-21T16:05:14.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-21T16:05:14.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-21T16:05:14.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-21T16:05:14.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-21T16:05:14.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-21T16:05:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-21T16:05:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-21T16:05:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-21T16:05:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-21T16:05:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-21T16:05:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-21T16:05:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-21T16:05:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-21T16:05:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-21T16:05:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-21T16:05:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-21T16:05:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-21T16:05:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-21T16:05:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-21T16:05:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-21T16:05:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-21T16:05:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-21T16:05:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-21T16:05:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-21T16:05:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-21T16:05:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-21T16:05:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-21T16:05:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-21T16:05:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-21T16:05:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-21T16:05:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-21T16:05:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-21T16:05:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-21T16:05:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-21T16:05:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-21T16:05:14.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-21T16:05:14.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-21T16:05:14.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-21T16:05:14.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-21T16:05:14.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-21T16:05:14.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-21T16:05:14.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-21T16:05:14.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-21T16:05:14.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-21T16:05:14.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-21T16:05:14.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-21T16:05:14.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-21T16:05:14.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-21T16:05:14.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-21T16:05:14.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-21T16:05:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-21T16:05:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-21T16:05:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-21T16:05:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-21T16:05:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-21T16:05:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-21T16:05:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-21T16:05:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-21T16:05:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-21T16:05:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-21T16:05:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-21T16:05:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-21T16:05:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-21T16:05:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-21T16:05:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-21T16:05:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-21T16:05:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-21T16:05:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-21T16:05:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-21T16:05:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-21T16:05:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-21T16:05:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-21T16:05:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-21T16:05:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-21T16:05:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-21T16:05:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-21T16:05:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-21T16:05:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-21T16:05:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-21T16:05:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-21T16:05:14.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-21T16:05:14.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-21T16:05:14.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-21T16:05:14.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-21T16:05:14.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-21T16:05:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-21T16:05:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-21T16:05:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-21T16:05:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-21T16:05:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-21T16:05:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-21T16:05:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-21T16:05:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-21T16:05:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-21T16:05:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-21T16:05:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-21T16:05:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-21T16:05:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-21T16:05:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-21T16:05:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-21T16:05:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-21T16:05:14.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-21T16:05:14.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-21T16:05:14.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-21T16:05:14.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-21T16:05:14.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-21T16:05:14.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-21T16:05:14.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-21T16:05:14.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-21T16:05:14.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-21T16:05:14.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-21T16:05:14.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-21T16:05:14.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-21T16:05:14.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-21T16:05:14.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-21T16:05:14.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-21T16:05:14.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-21T16:05:14.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-21T16:05:14.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-21T16:05:14.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-21T16:05:14.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-21T16:05:14.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-21T16:05:14.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-21T16:05:14.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-21T16:05:14.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-21T16:05:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-21T16:05:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-21T16:05:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-21T16:05:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-21T16:05:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-21T16:05:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-21T16:05:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-21T16:05:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-21T16:05:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-21T16:05:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-21T16:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-21T16:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-21T16:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-21T16:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-21T16:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-21T16:05:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-21T16:05:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-21T16:05:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-21T16:05:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-21T16:05:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-21T16:05:14.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-21T16:05:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-21T16:05:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-21T16:05:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-21T16:05:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-21T16:05:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-21T16:05:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-21T16:05:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-21T16:05:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-21T16:05:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-21T16:05:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-21T16:05:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-21T16:05:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-21T16:05:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-21T16:05:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-21T16:05:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-21T16:05:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-21T16:05:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-21T16:05:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-21T16:05:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-21T16:05:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-21T16:05:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-21T16:05:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-21T16:05:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-21T16:05:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-21T16:05:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-21T16:05:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-21T16:05:14.666 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-21T16:05:14.666 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-21T16:05:14.666 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-21T16:05:14.666 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-21T16:05:14.666 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-21T16:05:14.667 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-21T16:05:14.667 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-21T16:05:14.667 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-21T16:05:14.667 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-21T16:05:14.667 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-21T16:05:14.668 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-21T16:05:14.668 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-21T16:05:14.668 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-21T16:05:14.668 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-21T16:05:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-21T16:05:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-21T16:05:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-21T16:05:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-21T16:05:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-21T16:05:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-21T16:05:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-21T16:05:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-21T16:05:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-21T16:05:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-21T16:05:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-21T16:05:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-21T16:05:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-21T16:05:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-21T16:05:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-21T16:05:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-21T16:05:14.673 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-21T16:05:14.673 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-21T16:05:14.673 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-21T16:05:14.673 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-21T16:05:14.673 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-21T16:05:14.674 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-21T16:05:14.674 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-21T16:05:14.674 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-21T16:05:14.674 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-21T16:05:14.675 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-21T16:05:14.675 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-21T16:05:14.675 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-21T16:05:14.675 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-21T16:05:14.675 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-21T16:05:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-21T16:05:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-21T16:05:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-21T16:05:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-21T16:05:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-21T16:05:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-21T16:05:14.678 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-21T16:05:14.678 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-21T16:05:14.678 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-21T16:05:14.678 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-21T16:05:14.678 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-21T16:05:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-21T16:05:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-21T16:05:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-21T16:05:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-21T16:05:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-21T16:05:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-21T16:05:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-21T16:05:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-21T16:05:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-21T16:05:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-21T16:05:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-21T16:05:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-21T16:05:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-21T16:05:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-21T16:05:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-21T16:05:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-21T16:05:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-21T16:05:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-21T16:05:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-21T16:05:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-21T16:05:14.683 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-21T16:05:14.684 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-21T16:05:14.684 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-21T16:05:14.684 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-21T16:05:14.684 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-21T16:05:14.684 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-21T16:05:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-21T16:05:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-21T16:05:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-21T16:05:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-21T16:05:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-21T16:05:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-21T16:05:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-21T16:05:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-21T16:05:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-21T16:05:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-21T16:05:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-21T16:05:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-21T16:05:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-21T16:05:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-21T16:05:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-21T16:05:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-21T16:05:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-21T16:05:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-21T16:05:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-21T16:05:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-21T16:05:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-21T16:05:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-21T16:05:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-21T16:05:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-21T16:05:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-21T16:05:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-21T16:05:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-21T16:05:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-21T16:05:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-21T16:05:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-21T16:05:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-21T16:05:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-21T16:05:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-21T16:05:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-21T16:05:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-21T16:05:14.692 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-21T16:05:14.692 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-21T16:05:14.692 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-21T16:05:14.692 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-21T16:05:14.692 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-21T16:05:14.693 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-21T16:05:14.693 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-21T16:05:14.693 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-21T16:05:14.693 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-21T16:05:14.693 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-21T16:05:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-21T16:05:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-21T16:05:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-21T16:05:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-21T16:05:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-21T16:05:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-21T16:05:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-21T16:05:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-21T16:05:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-21T16:05:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-21T16:05:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-21T16:05:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-21T16:05:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-21T16:05:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-21T16:05:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-21T16:05:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-21T16:05:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-21T16:05:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-21T16:05:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-21T16:05:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-21T16:05:14.698 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-21T16:05:14.698 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-21T16:05:14.698 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-21T16:05:14.698 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-21T16:05:14.698 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-21T16:05:14.699 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-21T16:05:14.700 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-21T16:05:14.700 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-21T16:05:14.700 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-21T16:05:14.700 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-21T16:05:14.700 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-21T16:05:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-21T16:05:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-21T16:05:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-21T16:05:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-21T16:05:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-21T16:05:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-21T16:05:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-21T16:05:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-21T16:05:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-21T16:05:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-21T16:05:14.703 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-21T16:05:14.703 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-21T16:05:14.703 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-21T16:05:14.703 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-21T16:05:14.703 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-21T16:05:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-21T16:05:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-21T16:05:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-21T16:05:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-21T16:05:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-21T16:05:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-21T16:05:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-21T16:05:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-21T16:05:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-21T16:05:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-21T16:05:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-21T16:05:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-21T16:05:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-21T16:05:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-21T16:05:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-21T16:05:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-21T16:05:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-21T16:05:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-21T16:05:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-21T16:05:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-21T16:05:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-21T16:05:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-21T16:05:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-21T16:05:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-21T16:05:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-21T16:05:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-21T16:05:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-21T16:05:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-21T16:05:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-21T16:05:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-21T16:05:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-21T16:05:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-21T16:05:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-21T16:05:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-21T16:05:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-21T16:05:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-21T16:05:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-21T16:05:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-21T16:05:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-21T16:05:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-21T16:05:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-21T16:05:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-21T16:05:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-21T16:05:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-21T16:05:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-21T16:05:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-21T16:05:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-21T16:05:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-21T16:05:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-21T16:05:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-21T16:05:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-21T16:05:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-21T16:05:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-21T16:05:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-21T16:05:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-21T16:05:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-21T16:05:14.716 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-21T16:05:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-21T16:05:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-21T16:05:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-21T16:05:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-21T16:05:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-21T16:05:14.718 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-21T16:05:14.718 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-21T16:05:14.718 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-21T16:05:14.718 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-21T16:05:14.718 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-21T16:05:14.719 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-21T16:05:14.719 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-21T16:05:14.719 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-21T16:05:14.719 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-21T16:05:14.719 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-21T16:05:14.720 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-21T16:05:14.720 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-21T16:05:14.720 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-21T16:05:14.720 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-21T16:05:14.720 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-21T16:05:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-21T16:05:14.722 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-21T16:05:14.722 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-21T16:05:14.722 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-21T16:05:14.722 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-21T16:05:14.722 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-21T16:05:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-21T16:05:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-21T16:05:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-21T16:05:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-21T16:05:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-21T16:05:14.724 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-21T16:05:14.724 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-21T16:05:14.724 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-21T16:05:14.724 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-21T16:05:14.724 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-21T16:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-21T16:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-21T16:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-21T16:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-21T16:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-21T16:05:14.726 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-21T16:05:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-21T16:05:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-21T16:05:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-21T16:05:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-21T16:05:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-21T16:05:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-21T16:05:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-21T16:05:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-21T16:05:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-21T16:05:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-21T16:05:14.729 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-21T16:05:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-21T16:05:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-21T16:05:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-21T16:05:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-21T16:05:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-21T16:05:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-21T16:05:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-21T16:05:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-21T16:05:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-21T16:05:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-21T16:05:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-21T16:05:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-21T16:05:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-21T16:05:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-21T16:05:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-21T16:05:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-21T16:05:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-21T16:05:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-21T16:05:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-21T16:05:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-21T16:05:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-21T16:05:14.735 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-21T16:05:14.735 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-21T16:05:14.735 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-21T16:05:14.735 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-21T16:05:14.735 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-21T16:05:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-21T16:05:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-21T16:05:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-21T16:05:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-21T16:05:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-21T16:05:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-21T16:05:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-21T16:05:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-21T16:05:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-21T16:05:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-21T16:05:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-21T16:05:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-21T16:05:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-21T16:05:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-21T16:05:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-21T16:05:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-21T16:05:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-21T16:05:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-21T16:05:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-21T16:05:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-21T16:05:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-21T16:05:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-21T16:05:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-21T16:05:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-21T16:05:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-21T16:05:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-21T16:05:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-21T16:05:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-21T16:05:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-21T16:05:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-21T16:05:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-21T16:05:14.743 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-21T16:05:14.744 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-21T16:05:14.744 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-21T16:05:14.744 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-21T16:05:14.744 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-21T16:05:14.744 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-21T16:05:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-21T16:05:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-21T16:05:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-21T16:05:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-21T16:05:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-21T16:05:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-21T16:05:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-21T16:05:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-21T16:05:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-21T16:05:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-21T16:05:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-21T16:05:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-21T16:05:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-21T16:05:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-21T16:05:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-21T16:05:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-21T16:05:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-21T16:05:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-21T16:05:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-21T16:05:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-21T16:05:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-21T16:05:14.750 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-21T16:05:14.750 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-21T16:05:14.750 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-21T16:05:14.750 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-21T16:05:14.750 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-21T16:05:14.751 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-21T16:05:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-21T16:05:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-21T16:05:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-21T16:05:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-21T16:05:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-21T16:05:14.753 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-21T16:05:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-21T16:05:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-21T16:05:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-21T16:05:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-21T16:05:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-21T16:05:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-21T16:05:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-21T16:05:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-21T16:05:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-21T16:05:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-21T16:05:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-21T16:05:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-21T16:05:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-21T16:05:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-21T16:05:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-21T16:05:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-21T16:05:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-21T16:05:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-21T16:05:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-21T16:05:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-21T16:05:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-21T16:05:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-21T16:05:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-21T16:05:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-21T16:05:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-21T16:05:14.759 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-21T16:05:14.759 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-21T16:05:14.759 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-21T16:05:14.759 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-21T16:05:14.759 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-21T16:05:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-21T16:05:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-21T16:05:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-21T16:05:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-21T16:05:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-21T16:05:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-21T16:05:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-21T16:05:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-21T16:05:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-21T16:05:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-21T16:05:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-21T16:05:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-21T16:05:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-21T16:05:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-21T16:05:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-21T16:05:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-21T16:05:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-21T16:05:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-21T16:05:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-21T16:05:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-21T16:05:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-21T16:05:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-21T16:05:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-21T16:05:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-21T16:05:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-21T16:05:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-21T16:05:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-21T16:05:14.768 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-21T16:05:14.768 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-21T16:05:14.768 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-21T16:05:14.768 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-21T16:05:14.768 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-21T16:05:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-21T16:05:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-21T16:05:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-21T16:05:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-21T16:05:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-21T16:05:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-21T16:05:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-21T16:05:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-21T16:05:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-21T16:05:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-21T16:05:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-21T16:05:14.772 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-21T16:05:14.772 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-21T16:05:14.772 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-21T16:05:14.772 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-21T16:05:14.772 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-21T16:05:14.773 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-21T16:05:14.773 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-21T16:05:14.773 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-21T16:05:14.773 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-21T16:05:14.773 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-21T16:05:14.774 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-21T16:05:14.774 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-21T16:05:14.774 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-21T16:05:14.774 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-21T16:05:14.774 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-21T16:05:14.775 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-21T16:05:14.775 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-21T16:05:14.775 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-21T16:05:14.775 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-21T16:05:14.775 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-21T16:05:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-21T16:05:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-21T16:05:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-21T16:05:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-21T16:05:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-21T16:05:14.777 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-21T16:05:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-21T16:05:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-21T16:05:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-21T16:05:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-21T16:05:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-21T16:05:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-21T16:05:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-21T16:05:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-21T16:05:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-21T16:05:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-21T16:05:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-21T16:05:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-21T16:05:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-21T16:05:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-21T16:05:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-21T16:05:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-21T16:05:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-21T16:05:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-21T16:05:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-21T16:05:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-21T16:05:14.782 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-21T16:05:14.782 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-21T16:05:14.782 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-21T16:05:14.782 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-21T16:05:14.782 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-21T16:05:14.783 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-21T16:05:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-21T16:05:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-21T16:05:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-21T16:05:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-21T16:05:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-21T16:05:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-21T16:05:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-21T16:05:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-21T16:05:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-21T16:05:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-21T16:05:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-21T16:05:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-21T16:05:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-21T16:05:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-21T16:05:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-21T16:05:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-21T16:05:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-21T16:05:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-21T16:05:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-21T16:05:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-21T16:05:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-21T16:05:14.789 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-21T16:05:14.789 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-21T16:05:14.789 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-21T16:05:14.789 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-21T16:05:14.789 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-21T16:05:14.790 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-21T16:05:14.790 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-21T16:05:14.790 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-21T16:05:14.790 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-21T16:05:14.790 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-21T16:05:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-21T16:05:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-21T16:05:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-21T16:05:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-21T16:05:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-21T16:05:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-21T16:05:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-21T16:05:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-21T16:05:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-21T16:05:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-21T16:05:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-21T16:05:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-21T16:05:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-21T16:05:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-21T16:05:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-21T16:05:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-21T16:05:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-21T16:05:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-21T16:05:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-21T16:05:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-21T16:05:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-21T16:05:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-21T16:05:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-21T16:05:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-21T16:05:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-21T16:05:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-21T16:05:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-21T16:05:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-21T16:05:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-21T16:05:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-21T16:05:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-21T16:05:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-21T16:05:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-21T16:05:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-21T16:05:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-21T16:05:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-21T16:05:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-21T16:05:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-21T16:05:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-21T16:05:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-21T16:05:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-21T16:05:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-21T16:05:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-21T16:05:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-21T16:05:14.803 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-21T16:05:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-21T16:05:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-21T16:05:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-21T16:05:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-21T16:05:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-21T16:05:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-21T16:05:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-21T16:05:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-21T16:05:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-21T16:05:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-21T16:05:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-21T16:05:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-21T16:05:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-21T16:05:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-21T16:05:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-21T16:05:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-21T16:05:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-21T16:05:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-21T16:05:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-21T16:05:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-21T16:05:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-21T16:05:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-21T16:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-21T16:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-21T16:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-21T16:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-21T16:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-21T16:05:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-21T16:05:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-21T16:05:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-21T16:05:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-21T16:05:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-21T16:05:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-21T16:05:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-21T16:05:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-21T16:05:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-21T16:05:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-21T16:05:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-21T16:05:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-21T16:05:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-21T16:05:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-21T16:05:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-21T16:05:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-21T16:05:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-21T16:05:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-21T16:05:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-21T16:05:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-21T16:05:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-21T16:05:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-21T16:05:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-21T16:05:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-21T16:05:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-21T16:05:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-21T16:05:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-21T16:05:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-21T16:05:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-21T16:05:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-21T16:05:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-21T16:05:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-21T16:05:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-21T16:05:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-21T16:05:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-21T16:05:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-21T16:05:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-21T16:05:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-21T16:05:14.821 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-21T16:05:14.821 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-21T16:05:14.821 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-21T16:05:14.821 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-21T16:05:14.821 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-21T16:05:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-21T16:05:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-21T16:05:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-21T16:05:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-21T16:05:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-21T16:05:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-21T16:05:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-21T16:05:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-21T16:05:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-21T16:05:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-21T16:05:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-21T16:05:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-21T16:05:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-21T16:05:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-21T16:05:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-21T16:05:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-21T16:05:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-21T16:05:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-21T16:05:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-21T16:05:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-21T16:05:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-21T16:05:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-21T16:05:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-21T16:05:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-21T16:05:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-21T16:05:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-21T16:05:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-21T16:05:14.829 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-21T16:05:14.829 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-21T16:05:14.829 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-21T16:05:14.829 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-21T16:05:14.829 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-21T16:05:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-21T16:05:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-21T16:05:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-21T16:05:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-21T16:05:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-21T16:05:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-21T16:05:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-21T16:05:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-21T16:05:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-21T16:05:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-21T16:05:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-21T16:05:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-21T16:05:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-21T16:05:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-21T16:05:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-21T16:05:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-21T16:05:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-21T16:05:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-21T16:05:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-21T16:05:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-21T16:05:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-21T16:05:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-21T16:05:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-21T16:05:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-21T16:05:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-21T16:05:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-21T16:05:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-21T16:05:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-21T16:05:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-21T16:05:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-21T16:05:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-21T16:05:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-21T16:05:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-21T16:05:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-21T16:05:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-21T16:05:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-21T16:05:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-21T16:05:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-21T16:05:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-21T16:05:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-21T16:05:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-21T16:05:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-21T16:05:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-21T16:05:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-21T16:05:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-21T16:05:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-21T16:05:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-21T16:05:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-21T16:05:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-21T16:05:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-21T16:05:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-21T16:05:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-21T16:05:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-21T16:05:14.843 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-21T16:05:14.843 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-21T16:05:14.843 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-21T16:05:14.843 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-21T16:05:14.843 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-21T16:05:14.844 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-21T16:05:14.844 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-21T16:05:14.844 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-21T16:05:14.844 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-21T16:05:14.844 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-21T16:05:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-21T16:05:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-21T16:05:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-21T16:05:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-21T16:05:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-21T16:05:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-21T16:05:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-21T16:05:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-21T16:05:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-21T16:05:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-21T16:05:14.847 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-21T16:05:14.847 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-21T16:05:14.847 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-21T16:05:14.847 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-21T16:05:14.847 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-21T16:05:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-21T16:05:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-21T16:05:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-21T16:05:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-21T16:05:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-21T16:05:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-21T16:05:14.850 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-21T16:05:14.850 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-21T16:05:14.850 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-21T16:05:14.850 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-21T16:05:14.850 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-21T16:05:14.851 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-21T16:05:14.851 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-21T16:05:14.851 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-21T16:05:14.851 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-21T16:05:14.851 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-21T16:05:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-21T16:05:14.853 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-21T16:05:14.853 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-21T16:05:14.853 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-21T16:05:14.853 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-21T16:05:14.853 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-21T16:05:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-21T16:05:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-21T16:05:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-21T16:05:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-21T16:05:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-21T16:05:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-21T16:05:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-21T16:05:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-21T16:05:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-21T16:05:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-21T16:05:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-21T16:05:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-21T16:05:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-21T16:05:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-21T16:05:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-21T16:05:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-21T16:05:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-21T16:05:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-21T16:05:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-21T16:05:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-21T16:05:14.858 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-21T16:05:14.858 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-21T16:05:14.858 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-21T16:05:14.858 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-21T16:05:14.858 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-21T16:05:14.859 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-21T16:05:14.860 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-21T16:05:14.860 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-21T16:05:14.860 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-21T16:05:14.860 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-21T16:05:14.860 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-21T16:05:14.861 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-21T16:05:14.861 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-21T16:05:14.861 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-21T16:05:14.861 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-21T16:05:14.861 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-21T16:05:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-21T16:05:14.863 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-21T16:05:14.863 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-21T16:05:14.863 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-21T16:05:14.863 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-21T16:05:14.863 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-21T16:05:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-21T16:05:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-21T16:05:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-21T16:05:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-21T16:05:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-21T16:05:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-21T16:05:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-21T16:05:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-21T16:05:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-21T16:05:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-21T16:05:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-21T16:05:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-21T16:05:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-21T16:05:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-21T16:05:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-21T16:05:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-21T16:05:14.868 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-21T16:05:14.869 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-21T16:05:14.869 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-21T16:05:14.869 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-21T16:05:14.869 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-21T16:05:14.869 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-21T16:05:14.870 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-21T16:05:14.870 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-21T16:05:14.870 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-21T16:05:14.870 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-21T16:05:14.870 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-21T16:05:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-21T16:05:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-21T16:05:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-21T16:05:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-21T16:05:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-21T16:05:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-21T16:05:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-21T16:05:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-21T16:05:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-21T16:05:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-21T16:05:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-21T16:05:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-21T16:05:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-21T16:05:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-21T16:05:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-21T16:05:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-21T16:05:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-21T16:05:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-21T16:05:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-21T16:05:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-21T16:05:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-21T16:05:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-21T16:05:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-21T16:05:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-21T16:05:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-21T16:05:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-21T16:05:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-21T16:05:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-21T16:05:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-21T16:05:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-21T16:05:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-21T16:05:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-21T16:05:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-21T16:05:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-21T16:05:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-21T16:05:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-21T16:05:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-21T16:05:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-21T16:05:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-21T16:05:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-21T16:05:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-21T16:05:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-21T16:05:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-21T16:05:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-21T16:05:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-21T16:05:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-21T16:05:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-21T16:05:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-21T16:05:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-21T16:05:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-21T16:05:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-21T16:05:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-21T16:05:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-21T16:05:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-21T16:05:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-21T16:05:14.886 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-21T16:05:14.886 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-21T16:05:14.886 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-21T16:05:14.886 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-21T16:05:14.886 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-21T16:05:14.887 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-21T16:05:14.888 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-21T16:05:14.888 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-21T16:05:14.888 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-21T16:05:14.888 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-21T16:05:14.888 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-21T16:05:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-21T16:05:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-21T16:05:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-21T16:05:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-21T16:05:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-21T16:05:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-21T16:05:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-21T16:05:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-21T16:05:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-21T16:05:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-21T16:05:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-21T16:05:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-21T16:05:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-21T16:05:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-21T16:05:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-21T16:05:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-21T16:05:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-21T16:05:14.894 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-21T16:05:14.894 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-21T16:05:14.894 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-21T16:05:14.894 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-21T16:05:14.894 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-21T16:05:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-21T16:05:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-21T16:05:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-21T16:05:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-21T16:05:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-21T16:05:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-21T16:05:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-21T16:05:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-21T16:05:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-21T16:05:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-21T16:05:14.897 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-21T16:05:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-21T16:05:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-21T16:05:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-21T16:05:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-21T16:05:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-21T16:05:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-21T16:05:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-21T16:05:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-21T16:05:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-21T16:05:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-21T16:05:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-21T16:05:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-21T16:05:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-21T16:05:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-21T16:05:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-21T16:05:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-21T16:05:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-21T16:05:14.903 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-21T16:05:14.903 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-21T16:05:14.903 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-21T16:05:14.903 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-21T16:05:14.903 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-21T16:05:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-21T16:05:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-21T16:05:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-21T16:05:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-21T16:05:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-21T16:05:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-21T16:05:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-21T16:05:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-21T16:05:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-21T16:05:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-21T16:05:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-21T16:05:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-21T16:05:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-21T16:05:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-21T16:05:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-21T16:05:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-21T16:05:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-21T16:05:14.909 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-21T16:05:14.909 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-21T16:05:14.909 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-21T16:05:14.909 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-21T16:05:14.909 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-21T16:05:14.910 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-21T16:05:14.910 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-21T16:05:14.910 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-21T16:05:14.910 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-21T16:05:14.910 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-21T16:05:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-21T16:05:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-21T16:05:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-21T16:05:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-21T16:05:14.913 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.913 DEBUG:teuthology.orchestra.run.smithi012:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-21T16:05:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:postinstall scriptlet (using /bin/sh): 2023-10-21T16:05:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-21T16:05:14.938 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-21T16:05:14.938 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-21T16:05:14.938 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.938 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-21T16:05:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-21T16:05:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-21T16:05:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-21T16:05:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-21T16:05:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-21T16:05:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-21T16:05:14.941 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-21T16:05:14.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2023-10-21T16:05:15.021 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2023-10-21T16:05:15.022 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2023-10-21T16:05:15.022 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2023-10-21T16:05:15.022 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 68.el9 2023-10-21T16:05:15.022 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2023-10-21T16:05:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-21T16:05:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2023-10-21T16:05:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8264254 2023-10-21T16:05:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2023-10-21T16:05:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-21T16:05:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-21T16:05:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-21T16:05:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-21T16:05:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2023-10-21T16:05:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-21T16:05:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-21T16:05:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-21T16:05:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2023-10-21T16:05:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:05:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2023-10-21T16:05:15.027 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-21T16:05:15.027 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 6.6.0-rc5-g47672119149b 2023-10-21T16:05:15.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-21T16:05:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-10-21T16:05:17.116 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-21T16:05:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-10-21T16:05:17.164 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-21T16:05:17.181 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.EJUhGfk7rW 2023-10-21T16:05:17.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EJUhGfk7rW 2023-10-21T16:05:17.252 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.EJUhGfk7rW 2023-10-21T16:05:17.400 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.EJUhGfk7rW is 6KB 2023-10-21T16:05:17.448 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.EJUhGfk7rW 2023-10-21T16:05:17.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2023-10-21T16:05:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-21T16:05:17.532 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-21T16:05:17.532 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-21T16:05:17.532 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-21T16:05:17.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-21T16:05:17.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-10-21T16:05:47.708 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-21T16:05:47.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-21T16:05:47.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:06:47.713 DEBUG:teuthology.orchestra.remote:timed out 2023-10-21T16:06:56.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-21T16:06:56.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:06:57.135 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-21T16:06:57.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-21T16:06:57.797 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-21T16:06:57.797 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-21T16:06:57.838 INFO:teuthology.orchestra.run.smithi012.stdout:6.6.0-rc5-g47672119149b 2023-10-21T16:06:57.839 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-21T16:06:57.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-21T16:06:57.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-21T16:06:58.840 DEBUG:teuthology.parallel:result is None 2023-10-21T16:06:58.840 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-21T16:06:58.848 INFO:teuthology.task.internal:Creating test directory... 2023-10-21T16:06:58.848 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-21T16:06:58.855 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-21T16:06:58.902 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-21T16:06:58.909 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-21T16:06:58.927 INFO:teuthology.task.internal:Creating archive directory... 2023-10-21T16:06:58.927 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-21T16:06:58.932 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-21T16:06:58.981 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-21T16:06:58.987 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-21T16:06:58.988 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-21T16:06:59.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T16:06:59.009 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-21T16:06:59.014 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-21T16:06:59.086 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-21T16:06:59.107 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-21T16:06:59.169 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-21T16:06:59.223 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-21T16:06:59.227 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-21T16:06:59.235 INFO:teuthology.task.internal:Configuring sudo... 2023-10-21T16:06:59.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-21T16:06:59.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-21T16:06:59.317 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-21T16:06:59.326 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-21T16:06:59.327 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-21T16:06:59.332 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-21T16:06:59.370 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-21T16:06:59.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-21T16:06:59.587 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-21T16:06:59.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-21T16:06:59.757 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:06:59.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-21T16:06:59.834 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-21T16:06:59.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-21T16:06:59.962 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-21T16:07:00.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-21T16:07:00.049 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:07:00.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-21T16:07:00.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-10-21T16:07:00.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2023-10-21T16:07:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-21T16:07:00.244 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-21T16:07:00.672 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-21T16:07:00.682 INFO:teuthology.task.internal:Starting timer... 2023-10-21T16:07:00.682 INFO:teuthology.run_tasks:Running task pcp... 2023-10-21T16:07:00.723 INFO:teuthology.run_tasks:Running task selinux... 2023-10-21T16:07:00.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2023-10-21T16:07:00.865 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2023-10-21T16:07:00.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2023-10-21T16:07:00.934 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2023-10-21T16:07:00.936 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-21T16:07:00.936 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2023-10-21T16:07:00.985 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2023-10-21T16:07:00.985 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2023-10-21T16:07:01.011 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2023-10-21T16:07:01.011 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive'} 2023-10-21T16:07:01.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-21T16:07:01.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T16:07:01.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-21T16:07:01.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T16:07:01.119 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-21T16:07:01.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2023-10-21T16:07:01.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2023-10-21T16:07:01.238 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-21T16:07:01.248 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-21T16:07:01.248 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-21T16:07:01.265 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-21T16:07:01.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-21T16:17:14.600 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2023-10-21T16:17:14.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-21T16:17:14.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:17:14.749 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-21T16:17:14.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-21T16:17:14.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-21T16:17:14.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:17:15.008 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-10-21T16:17:15.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-21T16:17:15.079 INFO:teuthology.run_tasks:Running task clock... 2023-10-21T16:17:15.090 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-21T16:17:15.090 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-21T16:17:15.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-21T16:17:15.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-21T16:17:15.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-21T16:17:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-21T16:17:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-21T16:17:15.198 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2023-10-21T16:17:15.207 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-21T16:17:15.212 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2023-10-21T16:17:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-21T16:17:15.244 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-21T16:17:15.263 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-21T16:17:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-10-21T16:17:15.291 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-21T16:17:15.292 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-10-21T16:17:15.292 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.292 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.292 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.293 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.357 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2023-10-21T16:17:15.399 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2023-10-21T16:17:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-21T16:17:15.508 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-21T16:17:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2023-10-21T16:17:15.651 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-21T16:17:15.651 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-21T16:17:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T16:17:15.653 INFO:teuthology.run_tasks:Running task install... 2023-10-21T16:17:15.662 DEBUG:teuthology.task.install:project ceph 2023-10-21T16:17:15.663 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc'}} 2023-10-21T16:17:15.663 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc'} 2023-10-21T16:17:15.663 INFO:teuthology.task.install:Using flavor: default 2023-10-21T16:17:15.669 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-10-21T16:17:15.670 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-21T16:17:15.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'tag': None, 'wait_for_package': False} 2023-10-21T16:17:15.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:17:15.673 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'tag': None, 'wait_for_package': False} 2023-10-21T16:17:15.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:17:15.825 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/ 2023-10-21T16:17:15.825 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6820.gf0804064 2023-10-21T16:17:15.896 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/ 2023-10-21T16:17:15.896 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6820.gf0804064 2023-10-21T16:17:15.944 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-21T16:17:15.945 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:17:15.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-21T16:17:15.975 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-21T16:17:15.975 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f0804064d67a2a63dbabf1801ff452580a050cfc/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-21T16:17:16.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-21T16:17:16.077 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-21T16:17:16.077 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:17:16.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-21T16:17:16.127 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-21T16:17:16.190 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-21T16:17:16.191 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f0804064d67a2a63dbabf1801ff452580a050cfc/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-21T16:17:16.194 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2023-10-21T16:17:16.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2023-10-21T16:17:16.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-21T16:17:16.428 INFO:teuthology.orchestra.run.smithi099.stdout:72 files removed 2023-10-21T16:17:16.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-21T16:17:16.482 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-21T16:17:16.583 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2023-10-21T16:17:16.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2023-10-21T16:17:16.966 INFO:teuthology.orchestra.run.smithi012.stdout:72 files removed 2023-10-21T16:17:17.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-21T16:17:17.219 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 166 kB/s | 78 kB 00:00 2023-10-21T16:17:17.636 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-21T16:17:18.045 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-10-21T16:17:18.124 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 133 kB/s | 78 kB 00:00 2023-10-21T16:17:18.439 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-10-21T16:17:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2023-10-21T16:17:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2023-10-21T16:17:19.765 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-10-21T16:17:20.062 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.3 MB 00:00 2023-10-21T16:17:20.822 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-10-21T16:17:21.679 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2023-10-21T16:17:23.056 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-10-21T16:17:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 7.9 MB 00:01 2023-10-21T16:17:27.882 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.7 MB 00:01 2023-10-21T16:17:30.163 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-10-21T16:17:31.331 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-10-21T16:17:35.906 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2023-10-21T16:17:38.333 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-21T16:17:38.333 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-21T16:17:38.361 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-21T16:17:38.361 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-21T16:17:38.362 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-21T16:17:38.363 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-21T16:17:38.365 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-21T16:17:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-21T16:17:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-21T16:17:38.440 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-10-21T16:17:38.451 INFO:teuthology.orchestra.run.smithi099.stdout:==================================================================================================== 2023-10-21T16:17:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-10-21T16:17:38.451 INFO:teuthology.orchestra.run.smithi099.stdout:==================================================================================================== 2023-10-21T16:17:38.451 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-10-21T16:17:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-21T16:17:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:18.0.0-6820.gf0804064.el9 ceph 6.5 k 2023-10-21T16:17:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.2 M 2023-10-21T16:17:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 74 M 2023-10-21T16:17:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 410 M 2023-10-21T16:17:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 855 k 2023-10-21T16:17:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.8 M 2023-10-21T16:17:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6820.gf0804064.el9 ceph 141 k 2023-10-21T16:17:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.4 M 2023-10-21T16:17:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 47 M 2023-10-21T16:17:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.5 M 2023-10-21T16:17:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 132 k 2023-10-21T16:17:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 1.8 M 2023-10-21T16:17:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 19 M 2023-10-21T16:17:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 7.4 M 2023-10-21T16:17:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 48 k 2023-10-21T16:17:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 112 M 2023-10-21T16:17:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 315 M 2023-10-21T16:17:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:18.0.0-6820.gf0804064.el9 ceph 8.7 M 2023-10-21T16:17:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 174 M 2023-10-21T16:17:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:18.0.0-6820.gf0804064.el9 ceph 41 M 2023-10-21T16:17:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 626 M 2023-10-21T16:17:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 262 k 2023-10-21T16:17:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 270 k 2023-10-21T16:17:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:18.0.0-6820.gf0804064.el9 ceph 218 k 2023-10-21T16:17:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 18 k 2023-10-21T16:17:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-21T16:17:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-21T16:17:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-21T16:17:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:18.0.0-6820.gf0804064.el9 ceph 31 k 2023-10-21T16:17:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 716 k 2023-10-21T16:17:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.1 M 2023-10-21T16:17:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:18.0.0-6820.gf0804064.el9 ceph 126 k 2023-10-21T16:17:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 108 k 2023-10-21T16:17:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 45 M 2023-10-21T16:17:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 51 M 2023-10-21T16:17:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-21T16:17:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-21T16:17:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-21T16:17:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-21T16:17:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-21T16:17:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-21T16:17:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:18.0.0-6820.gf0804064.el9 ceph 162 k 2023-10-21T16:17:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 615 k 2023-10-21T16:17:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:18.0.0-6820.gf0804064.el9 ceph 320 k 2023-10-21T16:17:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 769 k 2023-10-21T16:17:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 298 k 2023-10-21T16:17:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.1 M 2023-10-21T16:17:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:18.0.0-6820.gf0804064.el9 ceph 99 k 2023-10-21T16:17:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 337 k 2023-10-21T16:17:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 85 k 2023-10-21T16:17:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 506 k 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.0 M 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 51 M 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 168 k 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.2 M 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-21T16:17:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2023-10-21T16:17:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-10-21T16:17:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-10-21T16:17:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-10-21T16:17:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-10-21T16:17:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-21T16:17:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-21T16:17:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-21T16:17:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.3 M 2023-10-21T16:17:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.0 M 2023-10-21T16:17:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-21T16:17:38.467 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-10-21T16:17:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-21T16:17:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:18.0.0-6820.gf0804064.el9 ceph 19 M 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 20 M 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 23 k 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:18.0.0-6820.gf0804064.el9 ceph 2.1 M 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 243 k 2023-10-21T16:17:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:18.0.0-6820.gf0804064.el9 ceph 4.4 M 2023-10-21T16:17:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 18 M 2023-10-21T16:17:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 15 k 2023-10-21T16:17:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:18.0.0-6820.gf0804064.el9 ceph 24 k 2023-10-21T16:17:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-21T16:17:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-21T16:17:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-21T16:17:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-21T16:17:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-21T16:17:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-21T16:17:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-21T16:17:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-21T16:17:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-21T16:17:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:18.0.0-6820.gf0804064.el9 ceph 164 k 2023-10-21T16:17:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-21T16:17:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-21T16:17:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-21T16:17:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-21T16:17:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-21T16:17:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 472 k 2023-10-21T16:17:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-21T16:17:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 4.8 M 2023-10-21T16:17:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-21T16:17:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-21T16:17:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-21T16:17:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-21T16:17:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-21T16:17:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-21T16:17:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-21T16:17:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-21T16:17:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-21T16:17:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-21T16:17:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 45 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:18.0.0-6820.gf0804064.el9 ceph 127 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-21T16:17:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-21T16:17:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-21T16:17:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-21T16:17:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-21T16:17:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-10-21T16:17:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-21T16:17:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-21T16:17:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-21T16:17:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-21T16:17:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-21T16:17:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-21T16:17:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-21T16:17:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-21T16:17:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-21T16:17:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-21T16:17:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-21T16:17:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-21T16:17:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-21T16:17:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-21T16:17:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-21T16:17:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-21T16:17:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-21T16:17:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-21T16:17:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-21T16:17:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-21T16:17:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-21T16:17:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-21T16:17:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-21T16:17:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-21T16:17:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-21T16:17:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-21T16:17:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-10-21T16:17:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-21T16:17:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-21T16:17:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-21T16:17:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-21T16:17:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-21T16:17:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-21T16:17:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-21T16:17:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-21T16:17:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-21T16:17:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-21T16:17:38.487 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2023-10-21T16:17:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-21T16:17:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:17:38.488 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-10-21T16:17:38.488 INFO:teuthology.orchestra.run.smithi099.stdout:==================================================================================================== 2023-10-21T16:17:38.488 INFO:teuthology.orchestra.run.smithi099.stdout:Install 155 Packages 2023-10-21T16:17:38.488 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 10 Packages 2023-10-21T16:17:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:17:38.490 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.1 G 2023-10-21T16:17:38.490 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-10-21T16:17:38.906 INFO:teuthology.orchestra.run.smithi099.stdout:(1/165): ceph-18.0.0-6820.gf0804064.el9.x86_64. 37 kB/s | 6.5 kB 00:00 2023-10-21T16:17:39.382 INFO:teuthology.orchestra.run.smithi099.stdout:(2/165): ceph-base-18.0.0-6820.gf0804064.el9.x8 8.0 MB/s | 5.2 MB 00:00 2023-10-21T16:17:39.849 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 18 MB 00:14 2023-10-21T16:17:43.040 INFO:teuthology.orchestra.run.smithi099.stdout:(3/165): ceph-common-18.0.0-6820.gf0804064.el9. 4.6 MB/s | 19 MB 00:04 2023-10-21T16:17:44.632 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 5.7 MB 00:01 2023-10-21T16:17:46.491 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2023-10-21T16:17:46.798 INFO:teuthology.orchestra.run.smithi099.stdout:(4/165): ceph-base-debuginfo-18.0.0-6820.gf0804 9.2 MB/s | 74 MB 00:08 2023-10-21T16:17:46.998 INFO:teuthology.orchestra.run.smithi099.stdout:(5/165): ceph-debuginfo-18.0.0-6820.gf0804064.e 5.1 MB/s | 20 MB 00:03 2023-10-21T16:17:47.040 INFO:teuthology.orchestra.run.smithi099.stdout:(6/165): ceph-fuse-18.0.0-6820.gf0804064.el9.x8 3.5 MB/s | 855 kB 00:00 2023-10-21T16:17:47.090 INFO:teuthology.orchestra.run.smithi099.stdout:(7/165): ceph-immutable-object-cache-18.0.0-682 2.8 MB/s | 141 kB 00:00 2023-10-21T16:17:47.282 INFO:teuthology.orchestra.run.smithi099.stdout:(8/165): ceph-immutable-object-cache-debuginfo- 7.5 MB/s | 1.4 MB 00:00 2023-10-21T16:17:47.549 INFO:teuthology.orchestra.run.smithi099.stdout:(9/165): ceph-mds-18.0.0-6820.gf0804064.el9.x86 7.8 MB/s | 2.1 MB 00:00 2023-10-21T16:17:48.033 INFO:teuthology.orchestra.run.smithi099.stdout:(10/165): ceph-fuse-debuginfo-18.0.0-6820.gf080 5.6 MB/s | 5.8 MB 00:01 2023-10-21T16:17:48.374 INFO:teuthology.orchestra.run.smithi099.stdout:(11/165): ceph-mgr-18.0.0-6820.gf0804064.el9.x8 4.3 MB/s | 1.5 MB 00:00 2023-10-21T16:17:48.633 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 19 MB 00:01 2023-10-21T16:17:52.149 INFO:teuthology.orchestra.run.smithi099.stdout:(12/165): ceph-mgr-debuginfo-18.0.0-6820.gf0804 5.1 MB/s | 19 MB 00:03 2023-10-21T16:17:52.591 INFO:teuthology.orchestra.run.smithi099.stdout:(13/165): ceph-mds-debuginfo-18.0.0-6820.gf0804 9.4 MB/s | 47 MB 00:05 2023-10-21T16:17:52.766 INFO:teuthology.orchestra.run.smithi099.stdout:(14/165): ceph-mon-18.0.0-6820.gf0804064.el9.x8 7.1 MB/s | 4.4 MB 00:00 2023-10-21T16:17:54.261 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-10-21T16:17:55.532 INFO:teuthology.orchestra.run.smithi099.stdout:(15/165): ceph-osd-18.0.0-6820.gf0804064.el9.x8 6.4 MB/s | 18 MB 00:02 2023-10-21T16:17:56.979 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-21T16:17:56.980 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-21T16:17:57.019 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-21T16:17:57.020 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-21T16:17:57.021 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-21T16:17:57.023 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-21T16:17:57.024 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-21T16:17:57.027 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-21T16:17:57.028 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-21T16:17:57.111 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-21T16:17:57.126 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================== 2023-10-21T16:17:57.126 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-21T16:17:57.130 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================== 2023-10-21T16:17:57.130 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-10-21T16:17:57.130 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-21T16:17:57.130 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:18.0.0-6820.gf0804064.el9 ceph 6.5 k 2023-10-21T16:17:57.131 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.2 M 2023-10-21T16:17:57.131 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 74 M 2023-10-21T16:17:57.131 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 410 M 2023-10-21T16:17:57.131 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 855 k 2023-10-21T16:17:57.131 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.8 M 2023-10-21T16:17:57.132 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6820.gf0804064.el9 ceph 141 k 2023-10-21T16:17:57.132 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.4 M 2023-10-21T16:17:57.132 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 47 M 2023-10-21T16:17:57.132 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.5 M 2023-10-21T16:17:57.132 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 132 k 2023-10-21T16:17:57.133 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 1.8 M 2023-10-21T16:17:57.133 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 19 M 2023-10-21T16:17:57.133 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 7.4 M 2023-10-21T16:17:57.133 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 48 k 2023-10-21T16:17:57.133 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 112 M 2023-10-21T16:17:57.134 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 315 M 2023-10-21T16:17:57.134 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:18.0.0-6820.gf0804064.el9 ceph 8.7 M 2023-10-21T16:17:57.134 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 174 M 2023-10-21T16:17:57.135 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:18.0.0-6820.gf0804064.el9 ceph 41 M 2023-10-21T16:17:57.135 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 626 M 2023-10-21T16:17:57.135 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 262 k 2023-10-21T16:17:57.136 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 270 k 2023-10-21T16:17:57.136 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:18.0.0-6820.gf0804064.el9 ceph 218 k 2023-10-21T16:17:57.136 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 18 k 2023-10-21T16:17:57.136 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:18.0.0-6820.gf0804064.el9 ceph 31 k 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 716 k 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 5.1 M 2023-10-21T16:17:57.137 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:18.0.0-6820.gf0804064.el9 ceph 126 k 2023-10-21T16:17:57.138 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 108 k 2023-10-21T16:17:57.138 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 45 M 2023-10-21T16:17:57.138 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 51 M 2023-10-21T16:17:57.138 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-21T16:17:57.139 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-21T16:17:57.139 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-21T16:17:57.139 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-21T16:17:57.139 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-21T16:17:57.139 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-21T16:17:57.140 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:18.0.0-6820.gf0804064.el9 ceph 162 k 2023-10-21T16:17:57.140 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 615 k 2023-10-21T16:17:57.140 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:18.0.0-6820.gf0804064.el9 ceph 320 k 2023-10-21T16:17:57.140 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 769 k 2023-10-21T16:17:57.140 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 298 k 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.1 M 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:18.0.0-6820.gf0804064.el9 ceph 99 k 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 337 k 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 85 k 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 506 k 2023-10-21T16:17:57.141 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.0 M 2023-10-21T16:17:57.142 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 51 M 2023-10-21T16:17:57.142 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 168 k 2023-10-21T16:17:57.142 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 1.2 M 2023-10-21T16:17:57.142 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-21T16:17:57.142 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-10-21T16:17:57.143 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-10-21T16:17:57.143 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-10-21T16:17:57.143 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-10-21T16:17:57.143 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-10-21T16:17:57.143 INFO:teuthology.orchestra.run.smithi012.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-21T16:17:57.144 INFO:teuthology.orchestra.run.smithi012.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-21T16:17:57.144 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-21T16:17:57.144 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.3 M 2023-10-21T16:17:57.144 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 3.0 M 2023-10-21T16:17:57.144 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-21T16:17:57.145 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-10-21T16:17:57.145 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-21T16:17:57.145 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-21T16:17:57.145 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:18.0.0-6820.gf0804064.el9 ceph 19 M 2023-10-21T16:17:57.145 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-debuginfo x86_64 2:18.0.0-6820.gf0804064.el9 ceph 20 M 2023-10-21T16:17:57.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 23 k 2023-10-21T16:17:57.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:18.0.0-6820.gf0804064.el9 ceph 2.1 M 2023-10-21T16:17:57.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 243 k 2023-10-21T16:17:57.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:18.0.0-6820.gf0804064.el9 ceph 4.4 M 2023-10-21T16:17:57.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:18.0.0-6820.gf0804064.el9 ceph 18 M 2023-10-21T16:17:57.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6820.gf0804064.el9 ceph-noarch 15 k 2023-10-21T16:17:57.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:18.0.0-6820.gf0804064.el9 ceph 24 k 2023-10-21T16:17:57.147 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-21T16:17:57.147 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-21T16:17:57.148 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-21T16:17:57.148 INFO:teuthology.orchestra.run.smithi012.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-21T16:17:57.148 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-21T16:17:57.148 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-21T16:17:57.148 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-21T16:17:57.149 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-21T16:17:57.149 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-21T16:17:57.149 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:18.0.0-6820.gf0804064.el9 ceph 164 k 2023-10-21T16:17:57.149 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-21T16:17:57.149 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-21T16:17:57.150 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-21T16:17:57.150 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-21T16:17:57.150 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-21T16:17:57.150 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 472 k 2023-10-21T16:17:57.150 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-21T16:17:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:18.0.0-6820.gf0804064.el9 ceph 4.8 M 2023-10-21T16:17:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-21T16:17:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-21T16:17:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-21T16:17:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-21T16:17:57.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-21T16:17:57.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-21T16:17:57.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-21T16:17:57.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:18.0.0-6820.gf0804064.el9 ceph 45 k 2023-10-21T16:17:57.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:18.0.0-6820.gf0804064.el9 ceph 127 k 2023-10-21T16:17:57.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-21T16:17:57.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-21T16:17:57.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-21T16:17:57.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-21T16:17:57.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-21T16:17:57.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-21T16:17:57.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-10-21T16:17:57.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-21T16:17:57.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-21T16:17:57.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-21T16:17:57.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-21T16:17:57.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-21T16:17:57.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-21T16:17:57.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-21T16:17:57.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-21T16:17:57.157 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-21T16:17:57.157 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-21T16:17:57.157 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-21T16:17:57.157 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-21T16:17:57.157 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-21T16:17:57.158 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-21T16:17:57.158 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-21T16:17:57.158 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-21T16:17:57.158 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-21T16:17:57.158 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-21T16:17:57.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-21T16:17:57.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-21T16:17:57.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-21T16:17:57.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-21T16:17:57.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-21T16:17:57.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-21T16:17:57.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-21T16:17:57.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-21T16:17:57.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-21T16:17:57.161 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-21T16:17:57.161 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-21T16:17:57.161 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-21T16:17:57.161 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-21T16:17:57.161 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-21T16:17:57.162 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-21T16:17:57.162 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-21T16:17:57.162 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-21T16:17:57.162 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-21T16:17:57.162 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-10-21T16:17:57.163 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-21T16:17:57.163 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-21T16:17:57.163 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-21T16:17:57.163 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-21T16:17:57.163 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-21T16:17:57.164 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-21T16:17:57.164 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-21T16:17:57.164 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-21T16:17:57.164 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-21T16:17:57.164 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-21T16:17:57.165 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2023-10-21T16:17:57.165 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-21T16:17:57.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:17:57.165 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-21T16:17:57.165 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================== 2023-10-21T16:17:57.166 INFO:teuthology.orchestra.run.smithi012.stdout:Install 155 Packages 2023-10-21T16:17:57.166 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 10 Packages 2023-10-21T16:17:57.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:17:57.167 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 2.1 G 2023-10-21T16:17:57.167 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-21T16:17:58.488 INFO:teuthology.orchestra.run.smithi012.stdout:(1/165): ceph-18.0.0-6820.gf0804064.el9.x86_64. 13 kB/s | 6.5 kB 00:00 2023-10-21T16:17:59.597 INFO:teuthology.orchestra.run.smithi012.stdout:(2/165): ceph-base-18.0.0-6820.gf0804064.el9.x8 3.2 MB/s | 5.2 MB 00:01 2023-10-21T16:18:03.206 INFO:teuthology.orchestra.run.smithi099.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6820.gf0804 11 MB/s | 112 MB 00:10 2023-10-21T16:18:04.590 INFO:teuthology.orchestra.run.smithi099.stdout:(17/165): ceph-radosgw-18.0.0-6820.gf0804064.el 6.3 MB/s | 8.7 MB 00:01 2023-10-21T16:18:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:(3/165): ceph-common-18.0.0-6820.gf0804064.el9. 1.5 MB/s | 19 MB 00:12 2023-10-21T16:18:18.619 INFO:teuthology.orchestra.run.smithi012.stdout:(4/165): ceph-debuginfo-18.0.0-6820.gf0804064.e 2.8 MB/s | 20 MB 00:07 2023-10-21T16:18:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:(5/165): ceph-fuse-18.0.0-6820.gf0804064.el9.x8 2.0 MB/s | 855 kB 00:00 2023-10-21T16:18:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:(6/165): ceph-fuse-debuginfo-18.0.0-6820.gf0804 3.1 MB/s | 5.8 MB 00:01 2023-10-21T16:18:21.019 INFO:teuthology.orchestra.run.smithi012.stdout:(7/165): ceph-immutable-object-cache-18.0.0-682 1.3 MB/s | 141 kB 00:00 2023-10-21T16:18:21.569 INFO:teuthology.orchestra.run.smithi012.stdout:(8/165): ceph-immutable-object-cache-debuginfo- 2.6 MB/s | 1.4 MB 00:00 2023-10-21T16:18:22.322 INFO:teuthology.orchestra.run.smithi012.stdout:(9/165): ceph-mds-18.0.0-6820.gf0804064.el9.x86 2.8 MB/s | 2.1 MB 00:00 2023-10-21T16:18:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:(10/165): ceph-base-debuginfo-18.0.0-6820.gf080 2.9 MB/s | 74 MB 00:25 2023-10-21T16:18:24.111 INFO:teuthology.orchestra.run.smithi012.stdout:(11/165): ceph-mgr-18.0.0-6820.gf0804064.el9.x8 2.3 MB/s | 1.5 MB 00:00 2023-10-21T16:18:29.069 INFO:teuthology.orchestra.run.smithi012.stdout:(12/165): ceph-mgr-debuginfo-18.0.0-6820.gf0804 3.9 MB/s | 19 MB 00:04 2023-10-21T16:18:29.748 INFO:teuthology.orchestra.run.smithi099.stdout:(18/165): ceph-radosgw-debuginfo-18.0.0-6820.gf 6.9 MB/s | 174 MB 00:25 2023-10-21T16:18:30.028 INFO:teuthology.orchestra.run.smithi099.stdout:(19/165): ceph-selinux-18.0.0-6820.gf0804064.el 86 kB/s | 24 kB 00:00 2023-10-21T16:18:30.761 INFO:teuthology.orchestra.run.smithi012.stdout:(13/165): ceph-mds-debuginfo-18.0.0-6820.gf0804 5.6 MB/s | 47 MB 00:08 2023-10-21T16:18:31.703 INFO:teuthology.orchestra.run.smithi012.stdout:(14/165): ceph-mon-18.0.0-6820.gf0804064.el9.x8 1.7 MB/s | 4.4 MB 00:02 2023-10-21T16:18:35.369 INFO:teuthology.orchestra.run.smithi099.stdout:(20/165): ceph-test-18.0.0-6820.gf0804064.el9.x 7.7 MB/s | 41 MB 00:05 2023-10-21T16:18:36.427 INFO:teuthology.orchestra.run.smithi012.stdout:(15/165): ceph-osd-18.0.0-6820.gf0804064.el9.x8 3.7 MB/s | 18 MB 00:04 2023-10-21T16:18:45.650 INFO:teuthology.orchestra.run.smithi099.stdout:(21/165): ceph-common-debuginfo-18.0.0-6820.gf0 6.2 MB/s | 410 MB 01:06 2023-10-21T16:18:46.025 INFO:teuthology.orchestra.run.smithi099.stdout:(22/165): cephfs-mirror-18.0.0-6820.gf0804064.e 582 kB/s | 218 kB 00:00 2023-10-21T16:18:46.153 INFO:teuthology.orchestra.run.smithi099.stdout:(23/165): libcephfs-devel-18.0.0-6820.gf0804064 245 kB/s | 31 kB 00:00 2023-10-21T16:18:46.592 INFO:teuthology.orchestra.run.smithi099.stdout:(24/165): libcephfs2-18.0.0-6820.gf0804064.el9. 1.6 MB/s | 716 kB 00:00 2023-10-21T16:18:49.534 INFO:teuthology.orchestra.run.smithi099.stdout:(25/165): libcephfs2-debuginfo-18.0.0-6820.gf08 1.8 MB/s | 5.1 MB 00:02 2023-10-21T16:18:49.692 INFO:teuthology.orchestra.run.smithi099.stdout:(26/165): libcephsqlite-18.0.0-6820.gf0804064.e 1.0 MB/s | 164 kB 00:00 2023-10-21T16:18:49.770 INFO:teuthology.orchestra.run.smithi099.stdout:(27/165): librados-devel-18.0.0-6820.gf0804064. 1.7 MB/s | 126 kB 00:00 2023-10-21T16:18:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:(28/165): librados-devel-debuginfo-18.0.0-6820. 1.1 MB/s | 108 kB 00:00 2023-10-21T16:18:56.715 INFO:teuthology.orchestra.run.smithi012.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6820.gf0804 4.3 MB/s | 112 MB 00:25 2023-10-21T16:18:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:(17/165): ceph-radosgw-18.0.0-6820.gf0804064.el 3.2 MB/s | 8.7 MB 00:02 2023-10-21T16:19:03.282 INFO:teuthology.orchestra.run.smithi099.stdout:(29/165): librados2-debuginfo-18.0.0-6820.gf080 3.4 MB/s | 45 MB 00:13 2023-10-21T16:19:03.499 INFO:teuthology.orchestra.run.smithi099.stdout:(30/165): libradosstriper1-18.0.0-6820.gf080406 2.1 MB/s | 472 kB 00:00 2023-10-21T16:19:13.422 INFO:teuthology.orchestra.run.smithi099.stdout:(31/165): librbd1-debuginfo-18.0.0-6820.gf08040 5.1 MB/s | 51 MB 00:09 2023-10-21T16:19:15.681 INFO:teuthology.orchestra.run.smithi099.stdout:(32/165): ceph-osd-debuginfo-18.0.0-6820.gf0804 3.9 MB/s | 315 MB 01:20 2023-10-21T16:19:15.756 INFO:teuthology.orchestra.run.smithi099.stdout:(33/165): librgw2-18.0.0-6820.gf0804064.el9.x86 2.0 MB/s | 4.8 MB 00:02 2023-10-21T16:19:15.790 INFO:teuthology.orchestra.run.smithi099.stdout:(34/165): python3-ceph-argparse-18.0.0-6820.gf0 416 kB/s | 45 kB 00:00 2023-10-21T16:19:15.899 INFO:teuthology.orchestra.run.smithi099.stdout:(35/165): python3-ceph-common-18.0.0-6820.gf080 892 kB/s | 127 kB 00:00 2023-10-21T16:19:15.924 INFO:teuthology.orchestra.run.smithi099.stdout:(36/165): python3-cephfs-18.0.0-6820.gf0804064. 1.2 MB/s | 162 kB 00:00 2023-10-21T16:19:16.107 INFO:teuthology.orchestra.run.smithi099.stdout:(37/165): python3-rados-18.0.0-6820.gf0804064.e 1.7 MB/s | 320 kB 00:00 2023-10-21T16:19:16.141 INFO:teuthology.orchestra.run.smithi099.stdout:(38/165): python3-cephfs-debuginfo-18.0.0-6820. 2.5 MB/s | 615 kB 00:00 2023-10-21T16:19:16.316 INFO:teuthology.orchestra.run.smithi099.stdout:(39/165): python3-rbd-18.0.0-6820.gf0804064.el9 1.7 MB/s | 298 kB 00:00 2023-10-21T16:19:16.358 INFO:teuthology.orchestra.run.smithi099.stdout:(40/165): python3-rados-debuginfo-18.0.0-6820.g 3.0 MB/s | 769 kB 00:00 2023-10-21T16:19:16.433 INFO:teuthology.orchestra.run.smithi099.stdout:(41/165): python3-rgw-18.0.0-6820.gf0804064.el9 1.3 MB/s | 99 kB 00:00 2023-10-21T16:19:16.592 INFO:teuthology.orchestra.run.smithi099.stdout:(42/165): python3-rgw-debuginfo-18.0.0-6820.gf0 2.1 MB/s | 337 kB 00:00 2023-10-21T16:19:16.633 INFO:teuthology.orchestra.run.smithi099.stdout:(43/165): python3-rbd-debuginfo-18.0.0-6820.gf0 3.5 MB/s | 1.1 MB 00:00 2023-10-21T16:19:16.667 INFO:teuthology.orchestra.run.smithi099.stdout:(44/165): rbd-fuse-18.0.0-6820.gf0804064.el9.x8 1.1 MB/s | 85 kB 00:00 2023-10-21T16:19:16.867 INFO:teuthology.orchestra.run.smithi099.stdout:(45/165): rbd-fuse-debuginfo-18.0.0-6820.gf0804 2.1 MB/s | 506 kB 00:00 2023-10-21T16:19:17.509 INFO:teuthology.orchestra.run.smithi099.stdout:(46/165): rbd-mirror-18.0.0-6820.gf0804064.el9. 3.6 MB/s | 3.0 MB 00:00 2023-10-21T16:19:17.593 INFO:teuthology.orchestra.run.smithi099.stdout:(47/165): rbd-nbd-18.0.0-6820.gf0804064.el9.x86 2.0 MB/s | 168 kB 00:00 2023-10-21T16:19:17.868 INFO:teuthology.orchestra.run.smithi099.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6820.gf08040 4.5 MB/s | 1.2 MB 00:00 2023-10-21T16:19:17.935 INFO:teuthology.orchestra.run.smithi099.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6820.g 349 kB/s | 23 kB 00:00 2023-10-21T16:19:18.002 INFO:teuthology.orchestra.run.smithi099.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6820.gf080406 1.9 MB/s | 132 kB 00:00 2023-10-21T16:19:18.360 INFO:teuthology.orchestra.run.smithi099.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6820.gf0804 4.9 MB/s | 1.8 MB 00:00 2023-10-21T16:19:19.410 INFO:teuthology.orchestra.run.smithi099.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 7.0 MB/s | 7.4 MB 00:01 2023-10-21T16:19:19.420 INFO:teuthology.orchestra.run.smithi012.stdout:(18/165): ceph-common-debuginfo-18.0.0-6820.gf0 5.1 MB/s | 410 MB 01:19 2023-10-21T16:19:19.477 INFO:teuthology.orchestra.run.smithi099.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6820.gf0 3.6 MB/s | 243 kB 00:00 2023-10-21T16:19:19.536 INFO:teuthology.orchestra.run.smithi099.stdout:(54/165): ceph-mgr-rook-18.0.0-6820.gf0804064.e 821 kB/s | 48 kB 00:00 2023-10-21T16:19:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:(19/165): ceph-selinux-18.0.0-6820.gf0804064.el 171 kB/s | 24 kB 00:00 2023-10-21T16:19:19.578 INFO:teuthology.orchestra.run.smithi099.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6820.gf 363 kB/s | 15 kB 00:00 2023-10-21T16:19:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:(56/165): ceph-volume-18.0.0-6820.gf0804064.el9 3.4 MB/s | 262 kB 00:00 2023-10-21T16:19:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:(57/165): cephadm-18.0.0-6820.gf0804064.el9.noa 3.2 MB/s | 270 kB 00:00 2023-10-21T16:19:19.812 INFO:teuthology.orchestra.run.smithi099.stdout:(58/165): cephfs-top-18.0.0-6820.gf0804064.el9. 243 kB/s | 18 kB 00:00 2023-10-21T16:19:19.970 INFO:teuthology.orchestra.run.smithi099.stdout:(59/165): bison-3.7.4-5.el9.x86_64.rpm 5.7 MB/s | 920 kB 00:00 2023-10-21T16:19:20.004 INFO:teuthology.orchestra.run.smithi099.stdout:(60/165): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-10-21T16:19:20.054 INFO:teuthology.orchestra.run.smithi099.stdout:(61/165): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-10-21T16:19:20.088 INFO:teuthology.orchestra.run.smithi099.stdout:(62/165): flexiblas-3.0.4-8.el9.x86_64.rpm 946 kB/s | 32 kB 00:00 2023-10-21T16:19:20.197 INFO:teuthology.orchestra.run.smithi099.stdout:(63/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-10-21T16:19:20.239 INFO:teuthology.orchestra.run.smithi099.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 410 kB/s | 17 kB 00:00 2023-10-21T16:19:20.273 INFO:teuthology.orchestra.run.smithi099.stdout:(65/165): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2023-10-21T16:19:20.306 INFO:teuthology.orchestra.run.smithi099.stdout:(66/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-10-21T16:19:20.348 INFO:teuthology.orchestra.run.smithi099.stdout:(67/165): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2023-10-21T16:19:20.399 INFO:teuthology.orchestra.run.smithi099.stdout:(68/165): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-10-21T16:19:20.432 INFO:teuthology.orchestra.run.smithi099.stdout:(69/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-10-21T16:19:20.474 INFO:teuthology.orchestra.run.smithi099.stdout:(70/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-10-21T16:19:20.516 INFO:teuthology.orchestra.run.smithi099.stdout:(71/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-10-21T16:19:20.550 INFO:teuthology.orchestra.run.smithi099.stdout:(72/165): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-21T16:19:20.683 INFO:teuthology.orchestra.run.smithi099.stdout:(73/165): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2023-10-21T16:19:20.750 INFO:teuthology.orchestra.run.smithi099.stdout:(74/165): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2023-10-21T16:19:20.801 INFO:teuthology.orchestra.run.smithi099.stdout:(75/165): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-10-21T16:19:20.834 INFO:teuthology.orchestra.run.smithi099.stdout:(76/165): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-10-21T16:19:21.026 INFO:teuthology.orchestra.run.smithi099.stdout:(77/165): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-10-21T16:19:21.185 INFO:teuthology.orchestra.run.smithi099.stdout:(78/165): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 5.8 MB 00:00 2023-10-21T16:19:21.227 INFO:teuthology.orchestra.run.smithi099.stdout:(79/165): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 205 kB 00:00 2023-10-21T16:19:21.269 INFO:teuthology.orchestra.run.smithi099.stdout:(80/165): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-10-21T16:19:21.302 INFO:teuthology.orchestra.run.smithi099.stdout:(81/165): python3-jsonpatch-1.21-16.el9.noarch. 730 kB/s | 24 kB 00:00 2023-10-21T16:19:21.336 INFO:teuthology.orchestra.run.smithi099.stdout:(82/165): python3-jsonpointer-2.0-4.el9.noarch. 545 kB/s | 18 kB 00:00 2023-10-21T16:19:21.378 INFO:teuthology.orchestra.run.smithi099.stdout:(83/165): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-10-21T16:19:21.411 INFO:teuthology.orchestra.run.smithi099.stdout:(84/165): python3-markupsafe-1.1.1-12.el9.x86_6 951 kB/s | 32 kB 00:00 2023-10-21T16:19:21.570 INFO:teuthology.orchestra.run.smithi099.stdout:(85/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-10-21T16:19:21.620 INFO:teuthology.orchestra.run.smithi099.stdout:(86/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2023-10-21T16:19:21.662 INFO:teuthology.orchestra.run.smithi099.stdout:(87/165): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2023-10-21T16:19:21.687 INFO:teuthology.orchestra.run.smithi099.stdout:(88/165): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2023-10-21T16:19:21.721 INFO:teuthology.orchestra.run.smithi099.stdout:(89/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-10-21T16:19:21.763 INFO:teuthology.orchestra.run.smithi099.stdout:(90/165): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-10-21T16:19:21.797 INFO:teuthology.orchestra.run.smithi099.stdout:(91/165): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2023-10-21T16:19:22.222 INFO:teuthology.orchestra.run.smithi099.stdout:(92/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-10-21T16:19:22.256 INFO:teuthology.orchestra.run.smithi099.stdout:(93/165): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-21T16:19:22.297 INFO:teuthology.orchestra.run.smithi099.stdout:(94/165): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-10-21T16:19:22.331 INFO:teuthology.orchestra.run.smithi099.stdout:(95/165): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2023-10-21T16:19:22.365 INFO:teuthology.orchestra.run.smithi099.stdout:(96/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-10-21T16:19:22.398 INFO:teuthology.orchestra.run.smithi099.stdout:(97/165): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-10-21T16:19:22.457 INFO:teuthology.orchestra.run.smithi099.stdout:(98/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2023-10-21T16:19:22.490 INFO:teuthology.orchestra.run.smithi099.stdout:(99/165): libquadmath-11.4.1-2.3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2023-10-21T16:19:22.533 INFO:teuthology.orchestra.run.smithi099.stdout:(100/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-10-21T16:19:22.558 INFO:teuthology.orchestra.run.smithi099.stdout:(101/165): python3-ply-3.11-14.el9.noarch.rpm 4.1 MB/s | 103 kB 00:00 2023-10-21T16:19:22.592 INFO:teuthology.orchestra.run.smithi099.stdout:(102/165): python3-pycparser-2.20-6.el9.noarch. 3.6 MB/s | 124 kB 00:00 2023-10-21T16:19:22.625 INFO:teuthology.orchestra.run.smithi099.stdout:(103/165): python3-requests-2.25.1-7.el9.noarch 3.3 MB/s | 113 kB 00:00 2023-10-21T16:19:22.667 INFO:teuthology.orchestra.run.smithi099.stdout:(104/165): python3-urllib3-1.26.5-4.el9.noarch. 4.4 MB/s | 187 kB 00:00 2023-10-21T16:19:23.467 INFO:teuthology.orchestra.run.smithi099.stdout:(105/165): python3-cryptography-36.0.1-4.el9.x8 1.5 MB/s | 1.2 MB 00:00 2023-10-21T16:19:23.643 INFO:teuthology.orchestra.run.smithi099.stdout:(106/165): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 689 kB 00:00 2023-10-21T16:19:23.685 INFO:teuthology.orchestra.run.smithi099.stdout:(107/165): elfutils-libelf-devel-0.189-3.el9.x8 538 kB/s | 22 kB 00:00 2023-10-21T16:19:23.726 INFO:teuthology.orchestra.run.smithi099.stdout:(108/165): jq-1.6-15.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-21T16:19:23.768 INFO:teuthology.orchestra.run.smithi099.stdout:(109/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2023-10-21T16:19:23.810 INFO:teuthology.orchestra.run.smithi099.stdout:(110/165): libuuid-devel-2.37.4-15.el9.x86_64.r 612 kB/s | 26 kB 00:00 2023-10-21T16:19:24.852 INFO:teuthology.orchestra.run.smithi099.stdout:(111/165): openssl-devel-3.0.7-24.el9.x86_64.rp 4.0 MB/s | 4.1 MB 00:01 2023-10-21T16:19:24.894 INFO:teuthology.orchestra.run.smithi099.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2023-10-21T16:19:24.936 INFO:teuthology.orchestra.run.smithi099.stdout:(113/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 86 kB 00:00 2023-10-21T16:19:24.978 INFO:teuthology.orchestra.run.smithi099.stdout:(114/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2023-10-21T16:19:25.194 INFO:teuthology.orchestra.run.smithi012.stdout:(20/165): ceph-test-18.0.0-6820.gf0804064.el9.x 7.3 MB/s | 41 MB 00:05 2023-10-21T16:19:25.245 INFO:teuthology.orchestra.run.smithi099.stdout:(115/165): fmt-8.1.1-5.el9.x86_64.rpm 415 kB/s | 111 kB 00:00 2023-10-21T16:19:25.437 INFO:teuthology.orchestra.run.smithi099.stdout:(116/165): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2023-10-21T16:19:27.870 INFO:teuthology.orchestra.run.smithi099.stdout:(117/165): rbd-mirror-debuginfo-18.0.0-6820.gf0 4.6 MB/s | 51 MB 00:11 2023-10-21T16:19:27.929 INFO:teuthology.orchestra.run.smithi099.stdout:(118/165): libarrow-9.0.0-9.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2023-10-21T16:19:28.037 INFO:teuthology.orchestra.run.smithi099.stdout:(119/165): liboath-2.6.7-2.el9.x86_64.rpm 591 kB/s | 49 kB 00:00 2023-10-21T16:19:28.104 INFO:teuthology.orchestra.run.smithi099.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-10-21T16:19:28.188 INFO:teuthology.orchestra.run.smithi099.stdout:(121/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 77 kB/s | 24 kB 00:00 2023-10-21T16:19:28.496 INFO:teuthology.orchestra.run.smithi099.stdout:(122/165): python3-asyncssh-2.13.2-3.el9.noarch 1.7 MB/s | 548 kB 00:00 2023-10-21T16:19:28.555 INFO:teuthology.orchestra.run.smithi099.stdout:(123/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.8 MB/s | 837 kB 00:00 2023-10-21T16:19:28.572 INFO:teuthology.orchestra.run.smithi099.stdout:(124/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2023-10-21T16:19:28.605 INFO:teuthology.orchestra.run.smithi099.stdout:(125/165): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2023-10-21T16:19:28.622 INFO:teuthology.orchestra.run.smithi099.stdout:(126/165): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2023-10-21T16:19:28.723 INFO:teuthology.orchestra.run.smithi099.stdout:(127/165): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-10-21T16:19:28.840 INFO:teuthology.orchestra.run.smithi099.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2023-10-21T16:19:28.865 INFO:teuthology.orchestra.run.smithi099.stdout:(129/165): python3-google-auth-2.23.3-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-10-21T16:19:28.899 INFO:teuthology.orchestra.run.smithi099.stdout:(130/165): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2023-10-21T16:19:28.924 INFO:teuthology.orchestra.run.smithi099.stdout:(131/165): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2023-10-21T16:19:28.957 INFO:teuthology.orchestra.run.smithi099.stdout:(132/165): python3-jaraco-collections-3.0.0-8.e 397 kB/s | 23 kB 00:00 2023-10-21T16:19:28.982 INFO:teuthology.orchestra.run.smithi099.stdout:(133/165): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2023-10-21T16:19:29.016 INFO:teuthology.orchestra.run.smithi099.stdout:(134/165): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2023-10-21T16:19:29.041 INFO:teuthology.orchestra.run.smithi099.stdout:(135/165): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2023-10-21T16:19:29.075 INFO:teuthology.orchestra.run.smithi099.stdout:(136/165): python3-jwt-2.4.0-1.el9.noarch.rpm 699 kB/s | 41 kB 00:00 2023-10-21T16:19:29.134 INFO:teuthology.orchestra.run.smithi099.stdout:(137/165): python3-logutils-0.3.5-21.el9.noarch 796 kB/s | 46 kB 00:00 2023-10-21T16:19:29.192 INFO:teuthology.orchestra.run.smithi099.stdout:(138/165): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-10-21T16:19:29.251 INFO:teuthology.orchestra.run.smithi099.stdout:(139/165): python3-natsort-7.1.1-5.el9.noarch.r 993 kB/s | 58 kB 00:00 2023-10-21T16:19:29.435 INFO:teuthology.orchestra.run.smithi099.stdout:(140/165): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2023-10-21T16:19:29.493 INFO:teuthology.orchestra.run.smithi099.stdout:(141/165): python3-portend-3.1.0-2.el9.noarch.r 283 kB/s | 16 kB 00:00 2023-10-21T16:19:29.618 INFO:teuthology.orchestra.run.smithi099.stdout:(142/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 720 kB/s | 90 kB 00:00 2023-10-21T16:19:29.644 INFO:teuthology.orchestra.run.smithi099.stdout:(143/165): python3-kubernetes-26.1.0-2.el9.noar 1.7 MB/s | 1.0 MB 00:00 2023-10-21T16:19:29.677 INFO:teuthology.orchestra.run.smithi099.stdout:(144/165): python3-repoze-lru-0.7-16.el9.noarch 527 kB/s | 31 kB 00:00 2023-10-21T16:19:29.736 INFO:teuthology.orchestra.run.smithi099.stdout:(145/165): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-10-21T16:19:29.761 INFO:teuthology.orchestra.run.smithi099.stdout:(146/165): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-10-21T16:19:29.795 INFO:teuthology.orchestra.run.smithi099.stdout:(147/165): python3-tempora-5.0.0-2.el9.noarch.r 613 kB/s | 36 kB 00:00 2023-10-21T16:19:29.820 INFO:teuthology.orchestra.run.smithi099.stdout:(148/165): python3-typing-extensions-4.4.0-2.el 871 kB/s | 51 kB 00:00 2023-10-21T16:19:29.912 INFO:teuthology.orchestra.run.smithi099.stdout:(149/165): python3-websocket-client-1.2.3-2.el9 978 kB/s | 90 kB 00:00 2023-10-21T16:19:29.979 INFO:teuthology.orchestra.run.smithi099.stdout:(150/165): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2023-10-21T16:19:30.038 INFO:teuthology.orchestra.run.smithi099.stdout:(151/165): python3-zc-lockfile-2.0-10.el9.noarc 344 kB/s | 20 kB 00:00 2023-10-21T16:19:30.163 INFO:teuthology.orchestra.run.smithi099.stdout:(152/165): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-10-21T16:19:30.221 INFO:teuthology.orchestra.run.smithi099.stdout:(153/165): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2023-10-21T16:19:31.013 INFO:teuthology.orchestra.run.smithi099.stdout:(154/165): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2023-10-21T16:19:31.739 INFO:teuthology.orchestra.run.smithi099.stdout:(155/165): librados2-18.0.0-6820.gf0804064.el9. 2.2 MB/s | 3.3 MB 00:01 2023-10-21T16:19:31.772 INFO:teuthology.orchestra.run.smithi099.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-10-21T16:19:31.864 INFO:teuthology.orchestra.run.smithi099.stdout:(157/165): NetworkManager-1.45.5-1.el9.x86_64.r 25 MB/s | 2.2 MB 00:00 2023-10-21T16:19:31.939 INFO:teuthology.orchestra.run.smithi099.stdout:(158/165): NetworkManager-libnm-1.45.5-1.el9.x8 24 MB/s | 1.8 MB 00:00 2023-10-21T16:19:31.972 INFO:teuthology.orchestra.run.smithi099.stdout:(159/165): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-10-21T16:19:32.015 INFO:teuthology.orchestra.run.smithi099.stdout:(160/165): NetworkManager-tui-1.45.5-1.el9.x86_ 5.7 MB/s | 245 kB 00:00 2023-10-21T16:19:32.057 INFO:teuthology.orchestra.run.smithi099.stdout:(161/165): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-10-21T16:19:32.098 INFO:teuthology.orchestra.run.smithi099.stdout:(162/165): libacl-2.3.1-4.el9.x86_64.rpm 528 kB/s | 22 kB 00:00 2023-10-21T16:19:32.157 INFO:teuthology.orchestra.run.smithi099.stdout:(163/165): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-10-21T16:19:32.208 INFO:teuthology.orchestra.run.smithi099.stdout:(164/165): librbd1-18.0.0-6820.gf0804064.el9.x8 2.5 MB/s | 3.0 MB 00:01 2023-10-21T16:19:41.017 INFO:teuthology.orchestra.run.smithi012.stdout:(21/165): ceph-radosgw-debuginfo-18.0.0-6820.gf 4.2 MB/s | 174 MB 00:41 2023-10-21T16:19:42.134 INFO:teuthology.orchestra.run.smithi012.stdout:(22/165): ceph-osd-debuginfo-18.0.0-6820.gf0804 4.8 MB/s | 315 MB 01:05 2023-10-21T16:19:42.158 INFO:teuthology.orchestra.run.smithi012.stdout:(23/165): cephfs-mirror-18.0.0-6820.gf0804064.e 191 kB/s | 218 kB 00:01 2023-10-21T16:19:42.284 INFO:teuthology.orchestra.run.smithi012.stdout:(24/165): libcephfs-devel-18.0.0-6820.gf0804064 207 kB/s | 31 kB 00:00 2023-10-21T16:19:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:(25/165): libcephfs2-18.0.0-6820.gf0804064.el9. 1.9 MB/s | 716 kB 00:00 2023-10-21T16:19:42.643 INFO:teuthology.orchestra.run.smithi012.stdout:(26/165): libcephsqlite-18.0.0-6820.gf0804064.e 1.4 MB/s | 164 kB 00:00 2023-10-21T16:19:42.743 INFO:teuthology.orchestra.run.smithi012.stdout:(27/165): librados-devel-18.0.0-6820.gf0804064. 1.2 MB/s | 126 kB 00:00 2023-10-21T16:19:42.863 INFO:teuthology.orchestra.run.smithi012.stdout:(28/165): librados-devel-debuginfo-18.0.0-6820. 913 kB/s | 108 kB 00:00 2023-10-21T16:19:43.347 INFO:teuthology.orchestra.run.smithi012.stdout:(29/165): libcephfs2-debuginfo-18.0.0-6820.gf08 4.8 MB/s | 5.1 MB 00:01 2023-10-21T16:19:43.489 INFO:teuthology.orchestra.run.smithi012.stdout:(30/165): libradosstriper1-18.0.0-6820.gf080406 3.3 MB/s | 472 kB 00:00 2023-10-21T16:19:51.580 INFO:teuthology.orchestra.run.smithi012.stdout:(31/165): librados2-debuginfo-18.0.0-6820.gf080 5.2 MB/s | 45 MB 00:08 2023-10-21T16:19:52.446 INFO:teuthology.orchestra.run.smithi012.stdout:(32/165): librgw2-18.0.0-6820.gf0804064.el9.x86 5.5 MB/s | 4.8 MB 00:00 2023-10-21T16:19:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:(33/165): librbd1-debuginfo-18.0.0-6820.gf08040 5.3 MB/s | 51 MB 00:09 2023-10-21T16:19:53.013 INFO:teuthology.orchestra.run.smithi012.stdout:(34/165): python3-ceph-argparse-18.0.0-6820.gf0 80 kB/s | 45 kB 00:00 2023-10-21T16:19:53.097 INFO:teuthology.orchestra.run.smithi012.stdout:(35/165): python3-cephfs-18.0.0-6820.gf0804064. 1.9 MB/s | 162 kB 00:00 2023-10-21T16:19:53.122 INFO:teuthology.orchestra.run.smithi012.stdout:(36/165): python3-ceph-common-18.0.0-6820.gf080 956 kB/s | 127 kB 00:00 2023-10-21T16:19:53.281 INFO:teuthology.orchestra.run.smithi012.stdout:(37/165): python3-cephfs-debuginfo-18.0.0-6820. 3.3 MB/s | 615 kB 00:00 2023-10-21T16:19:53.314 INFO:teuthology.orchestra.run.smithi012.stdout:(38/165): python3-rados-18.0.0-6820.gf0804064.e 1.6 MB/s | 320 kB 00:00 2023-10-21T16:19:53.432 INFO:teuthology.orchestra.run.smithi012.stdout:(39/165): python3-rbd-18.0.0-6820.gf0804064.el9 2.5 MB/s | 298 kB 00:00 2023-10-21T16:19:53.473 INFO:teuthology.orchestra.run.smithi012.stdout:(40/165): python3-rados-debuginfo-18.0.0-6820.g 3.9 MB/s | 769 kB 00:00 2023-10-21T16:19:53.574 INFO:teuthology.orchestra.run.smithi012.stdout:(41/165): python3-rgw-18.0.0-6820.gf0804064.el9 1.0 MB/s | 99 kB 00:00 2023-10-21T16:19:53.691 INFO:teuthology.orchestra.run.smithi012.stdout:(42/165): python3-rbd-debuginfo-18.0.0-6820.gf0 4.4 MB/s | 1.1 MB 00:00 2023-10-21T16:19:53.733 INFO:teuthology.orchestra.run.smithi012.stdout:(43/165): python3-rgw-debuginfo-18.0.0-6820.gf0 2.1 MB/s | 337 kB 00:00 2023-10-21T16:19:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:(44/165): rbd-fuse-18.0.0-6820.gf0804064.el9.x8 1.0 MB/s | 85 kB 00:00 2023-10-21T16:19:53.842 INFO:teuthology.orchestra.run.smithi012.stdout:(45/165): rbd-fuse-debuginfo-18.0.0-6820.gf0804 4.6 MB/s | 506 kB 00:00 2023-10-21T16:19:54.467 INFO:teuthology.orchestra.run.smithi012.stdout:(46/165): rbd-mirror-18.0.0-6820.gf0804064.el9. 4.4 MB/s | 3.0 MB 00:00 2023-10-21T16:19:54.567 INFO:teuthology.orchestra.run.smithi012.stdout:(47/165): rbd-nbd-18.0.0-6820.gf0804064.el9.x86 1.7 MB/s | 168 kB 00:00 2023-10-21T16:19:54.931 INFO:teuthology.orchestra.run.smithi012.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6820.gf08040 3.4 MB/s | 1.2 MB 00:00 2023-10-21T16:19:55.076 INFO:teuthology.orchestra.run.smithi012.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6820.g 161 kB/s | 23 kB 00:00 2023-10-21T16:19:55.176 INFO:teuthology.orchestra.run.smithi012.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6820.gf080406 1.3 MB/s | 132 kB 00:00 2023-10-21T16:19:55.610 INFO:teuthology.orchestra.run.smithi012.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6820.gf0804 4.1 MB/s | 1.8 MB 00:00 2023-10-21T16:19:57.219 INFO:teuthology.orchestra.run.smithi012.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 4.6 MB/s | 7.4 MB 00:01 2023-10-21T16:19:57.335 INFO:teuthology.orchestra.run.smithi012.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6820.gf0 2.1 MB/s | 243 kB 00:00 2023-10-21T16:19:57.441 INFO:teuthology.orchestra.run.smithi012.stdout:(54/165): ceph-mgr-rook-18.0.0-6820.gf0804064.e 470 kB/s | 48 kB 00:00 2023-10-21T16:19:57.505 INFO:teuthology.orchestra.run.smithi012.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6820.gf 230 kB/s | 15 kB 00:00 2023-10-21T16:19:57.613 INFO:teuthology.orchestra.run.smithi012.stdout:(56/165): ceph-volume-18.0.0-6820.gf0804064.el9 2.4 MB/s | 262 kB 00:00 2023-10-21T16:19:57.714 INFO:teuthology.orchestra.run.smithi012.stdout:(57/165): cephadm-18.0.0-6820.gf0804064.el9.noa 2.7 MB/s | 270 kB 00:00 2023-10-21T16:19:57.806 INFO:teuthology.orchestra.run.smithi012.stdout:(58/165): cephfs-top-18.0.0-6820.gf0804064.el9. 202 kB/s | 18 kB 00:00 2023-10-21T16:19:58.040 INFO:teuthology.orchestra.run.smithi012.stdout:(59/165): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 920 kB 00:00 2023-10-21T16:19:58.081 INFO:teuthology.orchestra.run.smithi012.stdout:(60/165): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 106 kB 00:00 2023-10-21T16:19:58.131 INFO:teuthology.orchestra.run.smithi012.stdout:(61/165): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2023-10-21T16:19:58.173 INFO:teuthology.orchestra.run.smithi012.stdout:(62/165): flexiblas-3.0.4-8.el9.x86_64.rpm 776 kB/s | 32 kB 00:00 2023-10-21T16:19:58.324 INFO:teuthology.orchestra.run.smithi012.stdout:(63/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2023-10-21T16:19:58.366 INFO:teuthology.orchestra.run.smithi012.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 419 kB/s | 17 kB 00:00 2023-10-21T16:19:58.408 INFO:teuthology.orchestra.run.smithi012.stdout:(65/165): libaio-devel-0.3.111-13.el9.x86_64.rp 248 kB/s | 10 kB 00:00 2023-10-21T16:19:58.458 INFO:teuthology.orchestra.run.smithi012.stdout:(66/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2023-10-21T16:19:58.525 INFO:teuthology.orchestra.run.smithi012.stdout:(67/165): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2023-10-21T16:19:58.584 INFO:teuthology.orchestra.run.smithi012.stdout:(68/165): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-10-21T16:19:58.634 INFO:teuthology.orchestra.run.smithi012.stdout:(69/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 46 kB 00:00 2023-10-21T16:19:58.692 INFO:teuthology.orchestra.run.smithi012.stdout:(70/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-10-21T16:19:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:(71/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-10-21T16:19:58.769 INFO:teuthology.orchestra.run.smithi099.stdout:(165/165): ceph-test-debuginfo-18.0.0-6820.gf08 7.5 MB/s | 626 MB 01:23 2023-10-21T16:19:58.776 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-10-21T16:19:58.776 INFO:teuthology.orchestra.run.smithi099.stdout:Total 15 MB/s | 2.1 GB 02:20 2023-10-21T16:19:58.793 INFO:teuthology.orchestra.run.smithi012.stdout:(72/165): openblas-0.3.21-2.el9.x86_64.rpm 698 kB/s | 34 kB 00:00 2023-10-21T16:19:58.909 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-10-21T16:19:59.027 INFO:teuthology.orchestra.run.smithi012.stdout:(73/165): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-10-21T16:19:59.042 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-10-21T16:19:59.042 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-10-21T16:19:59.177 INFO:teuthology.orchestra.run.smithi012.stdout:(74/165): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2023-10-21T16:19:59.244 INFO:teuthology.orchestra.run.smithi012.stdout:(75/165): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-10-21T16:19:59.286 INFO:teuthology.orchestra.run.smithi012.stdout:(76/165): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-10-21T16:19:59.811 INFO:teuthology.orchestra.run.smithi012.stdout:(77/165): rbd-mirror-debuginfo-18.0.0-6820.gf08 8.5 MB/s | 51 MB 00:05 2023-10-21T16:19:59.979 INFO:teuthology.orchestra.run.smithi012.stdout:(78/165): postgresql-server-13.11-1.el9.x86_64. 8.2 MB/s | 5.7 MB 00:00 2023-10-21T16:20:00.145 INFO:teuthology.orchestra.run.smithi012.stdout:(79/165): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-10-21T16:20:00.179 INFO:teuthology.orchestra.run.smithi012.stdout:(80/165): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 205 kB 00:00 2023-10-21T16:20:00.213 INFO:teuthology.orchestra.run.smithi012.stdout:(81/165): python3-jinja2-2.11.3-4.el9.noarch.rp 3.5 MB/s | 228 kB 00:00 2023-10-21T16:20:00.238 INFO:teuthology.orchestra.run.smithi012.stdout:(82/165): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 24 kB 00:00 2023-10-21T16:20:00.263 INFO:teuthology.orchestra.run.smithi012.stdout:(83/165): python3-jsonpointer-2.0-4.el9.noarch. 368 kB/s | 18 kB 00:00 2023-10-21T16:20:00.289 INFO:teuthology.orchestra.run.smithi012.stdout:(84/165): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-10-21T16:20:00.306 INFO:teuthology.orchestra.run.smithi012.stdout:(85/165): python3-markupsafe-1.1.1-12.el9.x86_6 792 kB/s | 32 kB 00:00 2023-10-21T16:20:00.522 INFO:teuthology.orchestra.run.smithi012.stdout:(86/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-10-21T16:20:00.548 INFO:teuthology.orchestra.run.smithi012.stdout:(87/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 908 kB/s | 217 kB 00:00 2023-10-21T16:20:00.590 INFO:teuthology.orchestra.run.smithi012.stdout:(88/165): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-10-21T16:20:00.615 INFO:teuthology.orchestra.run.smithi012.stdout:(89/165): python3-prettytable-0.7.2-27.el9.noar 640 kB/s | 41 kB 00:00 2023-10-21T16:20:00.640 INFO:teuthology.orchestra.run.smithi012.stdout:(90/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-10-21T16:20:00.674 INFO:teuthology.orchestra.run.smithi012.stdout:(91/165): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-10-21T16:20:00.699 INFO:teuthology.orchestra.run.smithi012.stdout:(92/165): python3-requests-oauthlib-1.3.0-12.el 768 kB/s | 43 kB 00:00 2023-10-21T16:20:00.941 INFO:teuthology.orchestra.run.smithi012.stdout:(93/165): python3-toml-0.10.2-6.el9.noarch.rpm 175 kB/s | 39 kB 00:00 2023-10-21T16:20:01.300 INFO:teuthology.orchestra.run.smithi012.stdout:(94/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2023-10-21T16:20:01.333 INFO:teuthology.orchestra.run.smithi012.stdout:(95/165): socat-1.7.4.1-5.el9.x86_64.rpm 788 kB/s | 300 kB 00:00 2023-10-21T16:20:01.359 INFO:teuthology.orchestra.run.smithi012.stdout:(96/165): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-10-21T16:20:01.384 INFO:teuthology.orchestra.run.smithi012.stdout:(97/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-10-21T16:20:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:(98/165): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-10-21T16:20:01.451 INFO:teuthology.orchestra.run.smithi012.stdout:(99/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-10-21T16:20:01.485 INFO:teuthology.orchestra.run.smithi012.stdout:(100/165): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-10-21T16:20:01.518 INFO:teuthology.orchestra.run.smithi012.stdout:(101/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-10-21T16:20:01.544 INFO:teuthology.orchestra.run.smithi012.stdout:(102/165): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-10-21T16:20:01.569 INFO:teuthology.orchestra.run.smithi012.stdout:(103/165): python3-pycparser-2.20-6.el9.noarch. 2.5 MB/s | 124 kB 00:00 2023-10-21T16:20:01.594 INFO:teuthology.orchestra.run.smithi012.stdout:(104/165): python3-requests-2.25.1-7.el9.noarch 2.3 MB/s | 113 kB 00:00 2023-10-21T16:20:01.636 INFO:teuthology.orchestra.run.smithi012.stdout:(105/165): python3-urllib3-1.26.5-4.el9.noarch. 2.8 MB/s | 187 kB 00:00 2023-10-21T16:20:01.837 INFO:teuthology.orchestra.run.smithi012.stdout:(106/165): python3-cryptography-36.0.1-4.el9.x8 5.1 MB/s | 1.2 MB 00:00 2023-10-21T16:20:01.904 INFO:teuthology.orchestra.run.smithi012.stdout:(107/165): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2023-10-21T16:20:01.929 INFO:teuthology.orchestra.run.smithi012.stdout:(108/165): elfutils-libelf-devel-0.189-3.el9.x8 245 kB/s | 22 kB 00:00 2023-10-21T16:20:01.971 INFO:teuthology.orchestra.run.smithi012.stdout:(109/165): jq-1.6-15.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-10-21T16:20:02.013 INFO:teuthology.orchestra.run.smithi012.stdout:(110/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 547 kB/s | 45 kB 00:00 2023-10-21T16:20:02.038 INFO:teuthology.orchestra.run.smithi012.stdout:(111/165): libuuid-devel-2.37.4-15.el9.x86_64.r 385 kB/s | 26 kB 00:00 2023-10-21T16:20:02.089 INFO:teuthology.orchestra.run.smithi012.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-10-21T16:20:02.147 INFO:teuthology.orchestra.run.smithi012.stdout:(113/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.5 MB/s | 86 kB 00:00 2023-10-21T16:20:02.198 INFO:teuthology.orchestra.run.smithi012.stdout:(114/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 920 kB/s | 45 kB 00:00 2023-10-21T16:20:02.698 INFO:teuthology.orchestra.run.smithi012.stdout:(115/165): openssl-devel-3.0.7-24.el9.x86_64.rp 6.0 MB/s | 4.1 MB 00:00 2023-10-21T16:20:02.723 INFO:teuthology.orchestra.run.smithi012.stdout:(116/165): fmt-8.1.1-5.el9.x86_64.rpm 211 kB/s | 111 kB 00:00 2023-10-21T16:20:02.973 INFO:teuthology.orchestra.run.smithi012.stdout:(117/165): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2023-10-21T16:20:03.082 INFO:teuthology.orchestra.run.smithi012.stdout:(118/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 226 kB/s | 24 kB 00:00 2023-10-21T16:20:03.199 INFO:teuthology.orchestra.run.smithi012.stdout:(119/165): liboath-2.6.7-2.el9.x86_64.rpm 420 kB/s | 49 kB 00:00 2023-10-21T16:20:03.291 INFO:teuthology.orchestra.run.smithi012.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 744 kB/s | 67 kB 00:00 2023-10-21T16:20:03.524 INFO:teuthology.orchestra.run.smithi012.stdout:(121/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 837 kB 00:00 2023-10-21T16:20:03.708 INFO:teuthology.orchestra.run.smithi012.stdout:(122/165): libarrow-9.0.0-9.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2023-10-21T16:20:03.758 INFO:teuthology.orchestra.run.smithi012.stdout:(123/165): python3-asyncssh-2.13.2-3.el9.noarch 2.3 MB/s | 548 kB 00:00 2023-10-21T16:20:03.783 INFO:teuthology.orchestra.run.smithi012.stdout:(124/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 586 kB/s | 43 kB 00:00 2023-10-21T16:20:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:(125/165): python3-cachetools-4.2.4-1.el9.noarc 434 kB/s | 32 kB 00:00 2023-10-21T16:20:03.867 INFO:teuthology.orchestra.run.smithi012.stdout:(126/165): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2023-10-21T16:20:03.918 INFO:teuthology.orchestra.run.smithi012.stdout:(127/165): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-10-21T16:20:03.960 INFO:teuthology.orchestra.run.smithi012.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2023-10-21T16:20:04.010 INFO:teuthology.orchestra.run.smithi012.stdout:(129/165): python3-google-auth-2.23.3-1.el9.noa 2.1 MB/s | 197 kB 00:00 2023-10-21T16:20:04.027 INFO:teuthology.orchestra.run.smithi012.stdout:(130/165): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2023-10-21T16:20:04.077 INFO:teuthology.orchestra.run.smithi012.stdout:(131/165): python3-jaraco-classes-3.2.1-5.el9.n 268 kB/s | 18 kB 00:00 2023-10-21T16:20:04.094 INFO:teuthology.orchestra.run.smithi012.stdout:(132/165): python3-jaraco-collections-3.0.0-8.e 350 kB/s | 23 kB 00:00 2023-10-21T16:20:04.144 INFO:teuthology.orchestra.run.smithi012.stdout:(133/165): python3-jaraco-functools-3.5.0-2.el9 295 kB/s | 19 kB 00:00 2023-10-21T16:20:04.161 INFO:teuthology.orchestra.run.smithi012.stdout:(134/165): python3-jaraco-text-3.2.0-6.el9.noar 297 kB/s | 20 kB 00:00 2023-10-21T16:20:04.212 INFO:teuthology.orchestra.run.smithi012.stdout:(135/165): python3-jwt+crypto-2.4.0-1.el9.noarc 137 kB/s | 9.0 kB 00:00 2023-10-21T16:20:04.237 INFO:teuthology.orchestra.run.smithi012.stdout:(136/165): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-10-21T16:20:04.304 INFO:teuthology.orchestra.run.smithi012.stdout:(137/165): python3-logutils-0.3.5-21.el9.noarch 702 kB/s | 46 kB 00:00 2023-10-21T16:20:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:(138/165): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-10-21T16:20:04.388 INFO:teuthology.orchestra.run.smithi012.stdout:(139/165): python3-more-itertools-8.12.0-2.el9. 954 kB/s | 79 kB 00:00 2023-10-21T16:20:04.430 INFO:teuthology.orchestra.run.smithi012.stdout:(140/165): python3-natsort-7.1.1-5.el9.noarch.r 875 kB/s | 58 kB 00:00 2023-10-21T16:20:04.472 INFO:teuthology.orchestra.run.smithi012.stdout:(141/165): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-10-21T16:20:04.497 INFO:teuthology.orchestra.run.smithi012.stdout:(142/165): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2023-10-21T16:20:04.547 INFO:teuthology.orchestra.run.smithi012.stdout:(143/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-10-21T16:20:04.564 INFO:teuthology.orchestra.run.smithi012.stdout:(144/165): python3-repoze-lru-0.7-16.el9.noarch 464 kB/s | 31 kB 00:00 2023-10-21T16:20:04.623 INFO:teuthology.orchestra.run.smithi012.stdout:(145/165): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2023-10-21T16:20:04.640 INFO:teuthology.orchestra.run.smithi012.stdout:(146/165): python3-rsa-4.9-2.el9.noarch.rpm 794 kB/s | 59 kB 00:00 2023-10-21T16:20:04.690 INFO:teuthology.orchestra.run.smithi012.stdout:(147/165): python3-tempora-5.0.0-2.el9.noarch.r 542 kB/s | 36 kB 00:00 2023-10-21T16:20:04.707 INFO:teuthology.orchestra.run.smithi012.stdout:(148/165): python3-typing-extensions-4.4.0-2.el 771 kB/s | 51 kB 00:00 2023-10-21T16:20:04.774 INFO:teuthology.orchestra.run.smithi012.stdout:(149/165): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-10-21T16:20:04.799 INFO:teuthology.orchestra.run.smithi012.stdout:(150/165): python3-websocket-client-1.2.3-2.el9 983 kB/s | 90 kB 00:00 2023-10-21T16:20:04.858 INFO:teuthology.orchestra.run.smithi012.stdout:(151/165): python3-werkzeug-2.0.3-3.el9.1.noarc 5.1 MB/s | 427 kB 00:00 2023-10-21T16:20:04.875 INFO:teuthology.orchestra.run.smithi012.stdout:(152/165): python3-zc-lockfile-2.0-10.el9.noarc 268 kB/s | 20 kB 00:00 2023-10-21T16:20:04.942 INFO:teuthology.orchestra.run.smithi012.stdout:(153/165): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2023-10-21T16:20:05.026 INFO:teuthology.orchestra.run.smithi012.stdout:(154/165): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-10-21T16:20:05.484 INFO:teuthology.orchestra.run.smithi012.stdout:(155/165): librados2-18.0.0-6820.gf0804064.el9. 6.1 MB/s | 3.3 MB 00:00 2023-10-21T16:20:05.526 INFO:teuthology.orchestra.run.smithi012.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-21T16:20:05.651 INFO:teuthology.orchestra.run.smithi012.stdout:(157/165): NetworkManager-1.45.5-1.el9.x86_64.r 18 MB/s | 2.2 MB 00:00 2023-10-21T16:20:05.727 INFO:teuthology.orchestra.run.smithi012.stdout:(158/165): librbd1-18.0.0-6820.gf0804064.el9.x8 4.3 MB/s | 3.0 MB 00:00 2023-10-21T16:20:05.819 INFO:teuthology.orchestra.run.smithi012.stdout:(159/165): NetworkManager-libnm-1.45.5-1.el9.x8 11 MB/s | 1.8 MB 00:00 2023-10-21T16:20:05.844 INFO:teuthology.orchestra.run.smithi012.stdout:(160/165): NetworkManager-team-1.45.5-1.el9.x86 406 kB/s | 42 kB 00:00 2023-10-21T16:20:05.878 INFO:teuthology.orchestra.run.smithi012.stdout:(161/165): NetworkManager-tui-1.45.5-1.el9.x86_ 4.2 MB/s | 245 kB 00:00 2023-10-21T16:20:05.894 INFO:teuthology.orchestra.run.smithi012.stdout:(162/165): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-10-21T16:20:05.920 INFO:teuthology.orchestra.run.smithi012.stdout:(163/165): libacl-2.3.1-4.el9.x86_64.rpm 542 kB/s | 22 kB 00:00 2023-10-21T16:20:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:(164/165): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-10-21T16:20:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-10-21T16:20:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-10-21T16:20:28.292 INFO:teuthology.orchestra.run.smithi012.stdout:(165/165): ceph-test-debuginfo-18.0.0-6820.gf08 9.9 MB/s | 626 MB 01:03 2023-10-21T16:20:28.305 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-21T16:20:28.306 INFO:teuthology.orchestra.run.smithi012.stdout:Total 14 MB/s | 2.1 GB 02:31 2023-10-21T16:20:28.770 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-21T16:20:29.000 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-21T16:20:29.000 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-21T16:20:31.890 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-10-21T16:20:32.049 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_6 1/175 2023-10-21T16:20:32.083 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-21T16:20:32.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-21T16:20:32.135 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-21T16:20:32.176 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-21T16:20:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-21T16:20:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:20:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:20:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 8/175 2023-10-21T16:20:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 8/175 2023-10-21T16:20:32.841 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 9/175 2023-10-21T16:20:32.841 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-21T16:20:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-21T16:20:33.037 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-21T16:20:33.073 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:20:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:20:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 14/175 2023-10-21T16:20:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 14/175 2023-10-21T16:20:33.366 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-21T16:20:33.478 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 16/175 2023-10-21T16:20:33.563 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 16/175 2023-10-21T16:20:33.623 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:20:33.682 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:20:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:20:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-21T16:20:34.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-21T16:20:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-21T16:20:34.134 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/175 2023-10-21T16:20:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-21T16:20:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-21T16:20:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-21T16:20:34.313 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-21T16:20:34.348 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-21T16:20:34.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-21T16:20:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:18.0.0-6820.gf0804064.el9. 28/175 2023-10-21T16:20:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:18.0.0-6820.gf0804064.el 29/175 2023-10-21T16:20:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_6 30/175 2023-10-21T16:20:34.703 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-21T16:20:34.748 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-21T16:20:35.283 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-21T16:20:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-21T16:20:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-21T16:20:35.444 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:18.0.0-6820.gf0804064.el9.x86_6 36/175 2023-10-21T16:20:35.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-21T16:20:35.590 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-21T16:20:35.629 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-21T16:20:35.683 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-21T16:20:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-21T16:20:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-21T16:20:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-21T16:20:35.863 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-21T16:20:35.908 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-21T16:20:35.950 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-21T16:20:36.084 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-21T16:20:36.136 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-21T16:20:36.176 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-21T16:20:36.269 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-21T16:20:36.310 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 51/175 2023-10-21T16:20:36.349 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-21T16:20:36.375 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-21T16:20:36.403 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-21T16:20:36.427 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-21T16:20:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-21T16:20:36.543 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-21T16:20:36.588 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-21T16:20:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-21T16:20:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-21T16:20:36.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-21T16:20:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-21T16:20:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-21T16:20:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-21T16:20:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-21T16:20:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-21T16:20:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-21T16:20:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-21T16:20:37.266 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-21T16:20:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-21T16:20:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-21T16:20:37.383 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-21T16:20:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-21T16:20:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-21T16:20:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-21T16:20:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-21T16:20:37.603 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-21T16:20:37.692 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-21T16:20:37.722 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-21T16:20:37.826 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-21T16:20:37.882 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-21T16:20:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-21T16:20:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-21T16:20:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-21T16:20:38.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-21T16:20:39.038 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-21T16:20:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-21T16:20:39.319 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-21T16:20:39.395 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-21T16:20:40.048 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-21T16:20:40.165 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-21T16:20:41.393 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-21T16:20:41.476 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-21T16:20:41.507 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-21T16:20:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-21T16:20:41.566 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-21T16:20:41.868 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-21T16:20:41.904 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 98/175 2023-10-21T16:20:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 98/175 2023-10-21T16:20:42.025 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 99/175 2023-10-21T16:20:42.069 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-21T16:20:42.497 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-21T16:20:42.540 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 102/175 2023-10-21T16:20:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 102/175 2023-10-21T16:20:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 103/175 2023-10-21T16:20:43.591 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-21T16:20:43.592 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-21T16:20:44.660 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:20:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:20:45.232 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:20:45.266 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 105/175 2023-10-21T16:20:45.340 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 105/175 2023-10-21T16:20:45.340 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-21T16:20:45.340 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-21T16:20:45.341 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:20:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 106/175 2023-10-21T16:20:57.898 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 106/175 2023-10-21T16:20:57.898 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2023-10-21T16:20:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2023-10-21T16:20:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2023-10-21T16:20:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2023-10-21T16:20:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2023-10-21T16:20:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2023-10-21T16:20:57.900 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2023-10-21T16:20:57.900 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:20:58.060 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 107/175 2023-10-21T16:20:58.075 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 107/175 2023-10-21T16:20:58.075 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:20:58.075 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-21T16:20:58.075 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:20:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 108/175 2023-10-21T16:20:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 108/175 2023-10-21T16:20:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:20:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-21T16:20:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-21T16:20:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-21T16:20:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:20:59.846 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 109/175 2023-10-21T16:20:59.868 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 109/175 2023-10-21T16:20:59.869 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:20:59.869 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-21T16:20:59.869 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-21T16:20:59.869 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-21T16:20:59.869 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:00.314 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 110/175 2023-10-21T16:21:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 110/175 2023-10-21T16:21:00.336 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:00.336 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-21T16:21:00.337 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-21T16:21:00.337 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-21T16:21:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:00.756 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:18.0.0-6820.gf0804064.el9.noarch 111/175 2023-10-21T16:21:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:18.0.0-6820.gf0804064.el9.noarch 111/175 2023-10-21T16:21:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.e 112/175 2023-10-21T16:21:00.879 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6820.gf0804064. 113/175 2023-10-21T16:21:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 114/175 2023-10-21T16:21:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 114/175 2023-10-21T16:21:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 115/175 2023-10-21T16:21:02.132 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 115/175 2023-10-21T16:21:02.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 116/175 2023-10-21T16:21:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 116/175 2023-10-21T16:21:02.426 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el 117/175 2023-10-21T16:21:02.455 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 118/175 2023-10-21T16:21:02.478 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 118/175 2023-10-21T16:21:02.478 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:02.478 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-21T16:21:02.478 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-21T16:21:02.479 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-21T16:21:02.479 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:02.523 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 119/175 2023-10-21T16:21:02.533 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 119/175 2023-10-21T16:21:03.303 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:18.0.0-6820.gf0804064.el9.x86_64 120/175 2023-10-21T16:21:03.334 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 121/175 2023-10-21T16:21:03.356 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 121/175 2023-10-21T16:21:03.356 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:03.356 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-21T16:21:03.357 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-21T16:21:03.357 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-21T16:21:03.357 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:03.393 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6820.gf0804 122/175 2023-10-21T16:21:03.414 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6820.gf0804 122/175 2023-10-21T16:21:03.414 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:03.414 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-21T16:21:03.415 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:03.460 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 123/175 2023-10-21T16:21:03.482 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 123/175 2023-10-21T16:21:03.482 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:03.570 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-21T16:21:03.570 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-21T16:21:03.571 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-21T16:21:03.571 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:03.786 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 124/175 2023-10-21T16:21:03.808 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 124/175 2023-10-21T16:21:03.808 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:03.809 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-21T16:21:03.809 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-21T16:21:03.809 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-21T16:21:03.809 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:21:05.027 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-21T16:21:05.187 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_6 1/175 2023-10-21T16:21:05.248 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-21T16:21:05.290 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-21T16:21:05.319 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-21T16:21:05.417 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-21T16:21:05.842 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-21T16:21:05.889 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:21:06.082 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:21:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 8/175 2023-10-21T16:21:06.285 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 8/175 2023-10-21T16:21:06.362 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 9/175 2023-10-21T16:21:06.406 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-21T16:21:06.672 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-21T16:21:06.728 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-21T16:21:06.761 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:21:06.922 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:21:06.954 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 14/175 2023-10-21T16:21:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 14/175 2023-10-21T16:21:07.469 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-21T16:21:07.580 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 125/175 2023-10-21T16:21:07.621 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 126/175 2023-10-21T16:21:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 16/175 2023-10-21T16:21:07.652 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 127/175 2023-10-21T16:21:07.773 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 16/175 2023-10-21T16:21:07.823 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-21T16:21:07.934 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-21T16:21:07.984 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 130/175 2023-10-21T16:21:08.027 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-21T16:21:08.032 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:21:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-21T16:21:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_ 133/175 2023-10-21T16:21:08.104 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:21:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 134/175 2023-10-21T16:21:08.176 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 135/175 2023-10-21T16:21:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-21T16:21:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-21T16:21:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 17/175 2023-10-21T16:21:08.607 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-21T16:21:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-21T16:21:08.787 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-21T16:21:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/175 2023-10-21T16:21:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-21T16:21:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:08.944 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-21T16:21:09.056 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-21T16:21:09.107 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-21T16:21:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-21T16:21:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-21T16:21:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:18.0.0-6820.gf0804064.el9. 28/175 2023-10-21T16:21:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:18.0.0-6820.gf0804064.el 29/175 2023-10-21T16:21:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_6 30/175 2023-10-21T16:21:09.661 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-21T16:21:09.726 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-21T16:21:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-21T16:21:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-21T16:21:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-21T16:21:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:18.0.0-6820.gf0804064.el9.x86_6 36/175 2023-10-21T16:21:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-21T16:21:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-21T16:21:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-21T16:21:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-21T16:21:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-21T16:21:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-21T16:21:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-21T16:21:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-21T16:21:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-21T16:21:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-21T16:21:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-21T16:21:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-21T16:21:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-21T16:21:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-21T16:21:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 51/175 2023-10-21T16:21:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-21T16:21:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-21T16:21:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-21T16:21:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-21T16:21:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-21T16:21:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-21T16:21:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-21T16:21:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-21T16:21:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-21T16:21:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-21T16:21:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-21T16:21:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-21T16:21:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-21T16:21:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-21T16:21:13.288 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-21T16:21:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-21T16:21:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-21T16:21:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-21T16:21:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-21T16:21:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-21T16:21:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-21T16:21:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-21T16:21:13.821 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-21T16:21:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-21T16:21:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-21T16:21:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-21T16:21:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-21T16:21:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-21T16:21:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-21T16:21:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-21T16:21:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-21T16:21:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-21T16:21:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-21T16:21:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-21T16:21:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-21T16:21:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-21T16:21:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-21T16:21:16.072 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-21T16:21:16.523 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 139/175 2023-10-21T16:21:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-21T16:21:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-21T16:21:18.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-21T16:21:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-21T16:21:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-21T16:21:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-21T16:21:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-21T16:21:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-21T16:21:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 98/175 2023-10-21T16:21:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 98/175 2023-10-21T16:21:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 99/175 2023-10-21T16:21:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-21T16:21:20.160 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-21T16:21:20.196 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 102/175 2023-10-21T16:21:20.296 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 102/175 2023-10-21T16:21:20.323 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 103/175 2023-10-21T16:21:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:21:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:21:23.916 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 104/175 2023-10-21T16:21:23.972 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 105/175 2023-10-21T16:21:24.173 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 105/175 2023-10-21T16:21:24.174 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-21T16:21:24.174 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-21T16:21:24.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:24.214 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 106/175 2023-10-21T16:21:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 106/175 2023-10-21T16:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2023-10-21T16:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2023-10-21T16:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2023-10-21T16:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2023-10-21T16:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2023-10-21T16:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2023-10-21T16:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2023-10-21T16:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:38.426 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 107/175 2023-10-21T16:21:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 107/175 2023-10-21T16:21:38.476 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:38.476 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-21T16:21:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 108/175 2023-10-21T16:21:40.329 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 108/175 2023-10-21T16:21:40.330 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:40.330 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-21T16:21:40.330 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-21T16:21:40.330 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-21T16:21:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:40.578 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 109/175 2023-10-21T16:21:40.653 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 109/175 2023-10-21T16:21:40.654 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:40.654 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-21T16:21:40.654 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-21T16:21:40.654 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-21T16:21:40.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:41.195 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 110/175 2023-10-21T16:21:41.272 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 110/175 2023-10-21T16:21:41.273 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:41.273 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-21T16:21:41.273 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-21T16:21:41.273 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-21T16:21:41.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:18.0.0-6820.gf0804064.el9.noarch 111/175 2023-10-21T16:21:41.965 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:18.0.0-6820.gf0804064.el9.noarch 111/175 2023-10-21T16:21:42.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.e 112/175 2023-10-21T16:21:42.119 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6820.gf0804064. 113/175 2023-10-21T16:21:42.151 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 114/175 2023-10-21T16:21:42.486 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 114/175 2023-10-21T16:21:42.518 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 115/175 2023-10-21T16:21:43.699 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 115/175 2023-10-21T16:21:43.726 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 116/175 2023-10-21T16:21:43.878 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 116/175 2023-10-21T16:21:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el 117/175 2023-10-21T16:21:44.087 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 118/175 2023-10-21T16:21:44.163 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 118/175 2023-10-21T16:21:44.164 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:44.164 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-21T16:21:44.164 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-21T16:21:44.164 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-21T16:21:44.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:44.235 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 119/175 2023-10-21T16:21:44.276 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 119/175 2023-10-21T16:21:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:18.0.0-6820.gf0804064.el9.x86_64 120/175 2023-10-21T16:21:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 121/175 2023-10-21T16:21:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 121/175 2023-10-21T16:21:45.316 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:45.316 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-21T16:21:45.316 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-21T16:21:45.316 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-21T16:21:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6820.gf0804 122/175 2023-10-21T16:21:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6820.gf0804 122/175 2023-10-21T16:21:45.460 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:45.460 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-21T16:21:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 123/175 2023-10-21T16:21:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 123/175 2023-10-21T16:21:45.641 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:45.641 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-21T16:21:45.641 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-21T16:21:45.642 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-21T16:21:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 124/175 2023-10-21T16:21:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 124/175 2023-10-21T16:21:46.087 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-21T16:21:46.087 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-21T16:21:46.087 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-21T16:21:46.087 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-21T16:21:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:21:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 125/175 2023-10-21T16:21:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 126/175 2023-10-21T16:21:50.551 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 127/175 2023-10-21T16:21:50.869 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-21T16:21:51.001 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-21T16:21:51.068 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 130/175 2023-10-21T16:21:51.115 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-21T16:21:51.152 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-21T16:21:51.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_ 133/175 2023-10-21T16:21:51.228 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 134/175 2023-10-21T16:21:51.371 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 135/175 2023-10-21T16:21:51.440 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-21T16:21:51.486 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-21T16:21:52.753 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:52.800 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-21T16:21:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9. 140/175 2023-10-21T16:21:56.016 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el 141/175 2023-10-21T16:21:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9. 142/175 2023-10-21T16:22:00.751 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-21T16:22:01.661 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 139/175 2023-10-21T16:22:02.747 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x 144/175 2023-10-21T16:22:13.681 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x 145/175 2023-10-21T16:22:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x 146/175 2023-10-21T16:22:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9. 140/175 2023-10-21T16:22:46.868 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el 141/175 2023-10-21T16:22:47.059 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9. 142/175 2023-10-21T16:22:51.942 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-21T16:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x 144/175 2023-10-21T16:23:00.730 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x 147/175 2023-10-21T16:23:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x 145/175 2023-10-21T16:23:42.008 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x 146/175 2023-10-21T16:24:01.983 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x 147/175 2023-10-21T16:24:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.e 148/175 2023-10-21T16:24:03.302 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9. 149/175 2023-10-21T16:24:03.363 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9 150/175 2023-10-21T16:24:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6820.gf0804064 151/175 2023-10-21T16:24:13.618 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados2-debuginfo-2:18.0.0-6820.gf0804064.el9. 152/175 2023-10-21T16:24:14.002 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 153/175 2023-10-21T16:24:14.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064 154/175 2023-10-21T16:24:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6820.gf0804064. 155/175 2023-10-21T16:24:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el 156/175 2023-10-21T16:24:14.379 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el 157/175 2023-10-21T16:24:19.772 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x 158/175 2023-10-21T16:24:20.127 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9 159/175 2023-10-21T16:24:21.064 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 160/175 2023-10-21T16:24:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-21T16:24:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-21T16:24:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-21T16:24:22.337 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-21T16:24:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-21T16:24:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-21T16:24:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-21T16:24:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-21T16:24:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-21T16:24:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-21T16:24:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-21T16:24:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:24:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:24:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:24:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-21T16:24:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-21T16:24:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-21T16:24:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-21T16:24:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-21T16:24:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:24:32.379 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:24:32.379 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:18.0.0-6820.gf0804064.el9.x86_64 1/175 2023-10-21T16:24:32.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 2/175 2023-10-21T16:24:32.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9. 3/175 2023-10-21T16:24:32.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 4/175 2023-10-21T16:24:32.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el 5/175 2023-10-21T16:24:32.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_6 6/175 2023-10-21T16:24:32.381 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:24:32.381 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9. 8/175 2023-10-21T16:24:32.381 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6820.gf0804 9/175 2023-10-21T16:24:32.381 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-21T16:24:32.381 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 11/175 2023-10-21T16:24:32.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x 12/175 2023-10-21T16:24:32.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:24:32.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x 14/175 2023-10-21T16:24:32.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 15/175 2023-10-21T16:24:32.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x 16/175 2023-10-21T16:24:32.383 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 17/175 2023-10-21T16:24:32.383 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x 18/175 2023-10-21T16:24:32.383 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 19/175 2023-10-21T16:24:32.383 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.e 20/175 2023-10-21T16:24:32.383 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 21/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 22/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9. 23/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 24/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_ 25/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 26/175 2023-10-21T16:24:32.384 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9 27/175 2023-10-21T16:24:32.385 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 28/175 2023-10-21T16:24:32.385 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:18.0.0-6820.gf0804064.el9.x86_6 29/175 2023-10-21T16:24:32.399 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6820.gf0804064 30/175 2023-10-21T16:24:32.399 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-debuginfo-2:18.0.0-6820.gf0804064.el9. 31/175 2023-10-21T16:24:32.400 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 32/175 2023-10-21T16:24:32.400 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 33/175 2023-10-21T16:24:32.400 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 34/175 2023-10-21T16:24:32.400 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6820.gf0804064.el 35/175 2023-10-21T16:24:32.400 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:18.0.0-6820.gf0804064.el9. 36/175 2023-10-21T16:24:32.401 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_6 37/175 2023-10-21T16:24:32.401 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064 38/175 2023-10-21T16:24:32.401 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 39/175 2023-10-21T16:24:32.401 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6820.gf0804064. 40/175 2023-10-21T16:24:32.401 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 41/175 2023-10-21T16:24:32.402 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el 42/175 2023-10-21T16:24:32.402 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 43/175 2023-10-21T16:24:32.402 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el 44/175 2023-10-21T16:24:32.402 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 45/175 2023-10-21T16:24:32.402 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x 46/175 2023-10-21T16:24:32.403 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 47/175 2023-10-21T16:24:32.403 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9 48/175 2023-10-21T16:24:32.403 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 49/175 2023-10-21T16:24:32.403 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 50/175 2023-10-21T16:24:32.403 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6820.gf0804064. 51/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 52/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 53/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 54/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el 55/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 56/175 2023-10-21T16:24:32.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.e 57/175 2023-10-21T16:24:32.405 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 58/175 2023-10-21T16:24:32.405 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:18.0.0-6820.gf0804064.el9.noarch 59/175 2023-10-21T16:24:32.405 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 60/175 2023-10-21T16:24:32.405 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-21T16:24:32.405 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-21T16:24:32.406 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-21T16:24:32.406 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-21T16:24:32.406 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-21T16:24:32.406 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-21T16:24:32.406 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-21T16:24:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-21T16:24:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-21T16:24:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-21T16:24:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-21T16:24:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-21T16:24:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-21T16:24:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-21T16:24:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-21T16:24:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-21T16:24:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-21T16:24:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-21T16:24:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-21T16:24:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-21T16:24:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-21T16:24:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-21T16:24:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-21T16:24:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-21T16:24:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-21T16:24:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-21T16:24:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-21T16:24:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-21T16:24:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-21T16:24:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-21T16:24:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-21T16:24:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-21T16:24:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-21T16:24:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-21T16:24:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-21T16:24:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 106/175 2023-10-21T16:24:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-21T16:24:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-21T16:24:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-21T16:24:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-21T16:24:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-21T16:24:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-21T16:24:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-21T16:24:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-21T16:24:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-21T16:24:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-21T16:24:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-21T16:24:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-21T16:24:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-21T16:24:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-21T16:24:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-21T16:24:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-21T16:24:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-21T16:24:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-21T16:24:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 130/175 2023-10-21T16:24:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-21T16:24:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-21T16:24:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-21T16:24:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-21T16:24:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-21T16:24:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-21T16:24:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-21T16:24:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-21T16:24:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-21T16:24:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-21T16:24:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-21T16:24:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-21T16:24:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-21T16:24:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-21T16:24:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-21T16:24:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-21T16:24:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-21T16:24:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-21T16:24:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-21T16:24:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-21T16:24:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:18.0.0-6820.gf0804064.el9.x86_64 156/175 2023-10-21T16:24:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-21T16:24:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 158/175 2023-10-21T16:24:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 162/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 164/175 2023-10-21T16:24:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-21T16:24:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 166/175 2023-10-21T16:24:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-21T16:24:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 168/175 2023-10-21T16:24:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-21T16:24:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-21T16:24:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-21T16:24:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-21T16:24:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-21T16:24:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-21T16:24:34.859 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:24:34.860 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:24:34.860 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2023-10-21T16:24:34.860 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-10-21T16:24:34.860 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-10-21T16:24:34.860 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-10-21T16:24:34.861 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-10-21T16:24:34.861 INFO:teuthology.orchestra.run.smithi099.stdout: acl-2.3.1-4.el9.x86_64 2023-10-21T16:24:34.861 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-21T16:24:34.861 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-21T16:24:34.861 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.862 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.862 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-21T16:24:34.862 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-10-21T16:24:34.862 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2023-10-21T16:24:34.862 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2023-10-21T16:24:34.863 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-21T16:24:34.863 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.863 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.863 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.863 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.864 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.864 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.864 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.864 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.864 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.865 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.866 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.866 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.866 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.866 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.867 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.869 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.869 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.869 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.869 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:24:34.869 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-21T16:24:34.870 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2023-10-21T16:24:34.870 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-21T16:24:34.870 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-21T16:24:34.870 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-21T16:24:34.870 INFO:teuthology.orchestra.run.smithi099.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-15.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-21T16:24:34.871 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-21T16:24:34.872 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.872 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.872 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.872 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.872 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-21T16:24:34.873 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-21T16:24:34.873 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-21T16:24:34.873 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-21T16:24:34.873 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-21T16:24:34.873 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-21T16:24:34.874 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.875 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-21T16:24:34.875 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-21T16:24:34.875 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-21T16:24:34.875 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-21T16:24:34.875 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-21T16:24:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-21T16:24:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-21T16:24:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-21T16:24:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-21T16:24:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.11-1.el9.x86_64 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-21T16:24:34.877 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-21T16:24:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-21T16:24:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-21T16:24:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.879 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.879 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-21T16:24:34.879 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-21T16:24:34.879 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-21T16:24:34.879 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-21T16:24:34.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-21T16:24:34.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-21T16:24:34.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-10-21T16:24:34.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-21T16:24:34.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-21T16:24:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-21T16:24:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-21T16:24:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-21T16:24:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-21T16:24:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-21T16:24:34.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-21T16:24:34.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-21T16:24:34.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-21T16:24:34.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-21T16:24:34.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-21T16:24:34.883 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-21T16:24:34.883 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-21T16:24:34.883 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-21T16:24:34.883 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-21T16:24:34.883 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-21T16:24:34.884 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-21T16:24:34.884 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-21T16:24:34.884 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-21T16:24:34.884 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2023-10-21T16:24:34.884 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-21T16:24:34.885 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-21T16:24:34.885 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-21T16:24:34.885 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-21T16:24:34.885 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-21T16:24:34.885 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-21T16:24:34.886 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-21T16:24:34.886 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.886 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.886 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.886 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-21T16:24:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-10-21T16:24:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-21T16:24:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-21T16:24:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-21T16:24:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-21T16:24:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.890 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.890 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.890 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.890 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.890 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:24:34.891 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2023-10-21T16:24:34.891 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-21T16:24:34.891 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-21T16:24:34.891 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-21T16:24:34.891 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-21T16:24:34.892 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-21T16:24:34.893 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-21T16:24:34.893 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:24:34.893 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-10-21T16:24:35.479 DEBUG:teuthology.parallel:result is None 2023-10-21T16:25:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.e 148/175 2023-10-21T16:25:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9. 149/175 2023-10-21T16:25:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9 150/175 2023-10-21T16:25:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6820.gf0804064 151/175 2023-10-21T16:25:25.693 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados2-debuginfo-2:18.0.0-6820.gf0804064.el9. 152/175 2023-10-21T16:25:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 153/175 2023-10-21T16:25:25.901 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064 154/175 2023-10-21T16:25:26.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6820.gf0804064. 155/175 2023-10-21T16:25:26.114 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el 156/175 2023-10-21T16:25:26.197 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el 157/175 2023-10-21T16:25:32.432 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x 158/175 2023-10-21T16:25:32.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9 159/175 2023-10-21T16:25:32.662 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 160/175 2023-10-21T16:25:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-21T16:25:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-21T16:25:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-21T16:25:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-21T16:25:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-21T16:25:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-21T16:25:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-21T16:25:36.655 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-21T16:25:36.697 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-21T16:25:36.734 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-21T16:25:36.766 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-21T16:25:36.808 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:25:36.808 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:25:37.167 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-21T16:25:37.168 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-21T16:25:37.306 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-21T16:25:37.345 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-21T16:25:37.346 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-21T16:25:37.492 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-21T16:25:37.621 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:25:37.895 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:25:37.896 INFO:teuthology.orchestra.run.smithi012.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-21T16:25:37.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:44.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:18.0.0-6820.gf0804064.el9.x86_64 1/175 2023-10-21T16:25:44.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 2/175 2023-10-21T16:25:44.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9. 3/175 2023-10-21T16:25:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 4/175 2023-10-21T16:25:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el 5/175 2023-10-21T16:25:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_6 6/175 2023-10-21T16:25:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 7/175 2023-10-21T16:25:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9. 8/175 2023-10-21T16:25:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6820.gf0804 9/175 2023-10-21T16:25:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-21T16:25:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 11/175 2023-10-21T16:25:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x 12/175 2023-10-21T16:25:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 13/175 2023-10-21T16:25:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x 14/175 2023-10-21T16:25:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 15/175 2023-10-21T16:25:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x 16/175 2023-10-21T16:25:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 17/175 2023-10-21T16:25:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x 18/175 2023-10-21T16:25:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 19/175 2023-10-21T16:25:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.e 20/175 2023-10-21T16:25:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 21/175 2023-10-21T16:25:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 22/175 2023-10-21T16:25:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9. 23/175 2023-10-21T16:25:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 24/175 2023-10-21T16:25:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_ 25/175 2023-10-21T16:25:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 26/175 2023-10-21T16:25:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9 27/175 2023-10-21T16:25:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 28/175 2023-10-21T16:25:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:18.0.0-6820.gf0804064.el9.x86_6 29/175 2023-10-21T16:25:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6820.gf0804064 30/175 2023-10-21T16:25:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-debuginfo-2:18.0.0-6820.gf0804064.el9. 31/175 2023-10-21T16:25:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86 32/175 2023-10-21T16:25:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 33/175 2023-10-21T16:25:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 34/175 2023-10-21T16:25:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6820.gf0804064.el 35/175 2023-10-21T16:25:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:18.0.0-6820.gf0804064.el9. 36/175 2023-10-21T16:25:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_6 37/175 2023-10-21T16:25:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064 38/175 2023-10-21T16:25:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 39/175 2023-10-21T16:25:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6820.gf0804064. 40/175 2023-10-21T16:25:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 41/175 2023-10-21T16:25:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el 42/175 2023-10-21T16:25:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 43/175 2023-10-21T16:25:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el 44/175 2023-10-21T16:25:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 45/175 2023-10-21T16:25:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x 46/175 2023-10-21T16:25:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 47/175 2023-10-21T16:25:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9 48/175 2023-10-21T16:25:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 49/175 2023-10-21T16:25:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x8 50/175 2023-10-21T16:25:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6820.gf0804064. 51/175 2023-10-21T16:25:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noa 52/175 2023-10-21T16:25:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.n 53/175 2023-10-21T16:25:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6820.gf08 54/175 2023-10-21T16:25:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el 55/175 2023-10-21T16:25:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 56/175 2023-10-21T16:25:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.e 57/175 2023-10-21T16:25:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 58/175 2023-10-21T16:25:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:18.0.0-6820.gf0804064.el9.noarch 59/175 2023-10-21T16:25:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 60/175 2023-10-21T16:25:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-21T16:25:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-21T16:25:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-21T16:25:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-21T16:25:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-21T16:25:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-21T16:25:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-21T16:25:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-21T16:25:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-21T16:25:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-21T16:25:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-21T16:25:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-21T16:25:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-21T16:25:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-21T16:25:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-21T16:25:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-21T16:25:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-21T16:25:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-21T16:25:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-21T16:25:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-21T16:25:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-21T16:25:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-21T16:25:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-21T16:25:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-21T16:25:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-21T16:25:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-21T16:25:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-21T16:25:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-21T16:25:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-21T16:25:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-21T16:25:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-21T16:25:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-21T16:25:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-21T16:25:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-21T16:25:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-21T16:25:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-21T16:25:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-21T16:25:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-21T16:25:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-21T16:25:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-21T16:25:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-21T16:25:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-21T16:25:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-21T16:25:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-21T16:25:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-21T16:25:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 106/175 2023-10-21T16:25:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-21T16:25:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-21T16:25:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-21T16:25:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-21T16:25:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-21T16:25:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-21T16:25:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-21T16:25:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-21T16:25:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-21T16:25:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-21T16:25:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-21T16:25:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-21T16:25:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-21T16:25:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-21T16:25:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-21T16:25:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-21T16:25:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-21T16:25:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-21T16:25:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 130/175 2023-10-21T16:25:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-21T16:25:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-21T16:25:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-21T16:25:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-21T16:25:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-21T16:25:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-21T16:25:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-21T16:25:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-21T16:25:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-21T16:25:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-21T16:25:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-21T16:25:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-21T16:25:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-21T16:25:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-21T16:25:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-21T16:25:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:18.0.0-6820.gf0804064.el9.x86_64 156/175 2023-10-21T16:25:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-21T16:25:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 158/175 2023-10-21T16:25:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-21T16:25:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-21T16:25:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-21T16:25:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 162/175 2023-10-21T16:25:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-21T16:25:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 164/175 2023-10-21T16:25:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-21T16:25:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 166/175 2023-10-21T16:25:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-21T16:25:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 168/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-21T16:25:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-21T16:25:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-21T16:25:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:47.078 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-10-21T16:25:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-10-21T16:25:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-10-21T16:25:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-10-21T16:25:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-10-21T16:25:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: acl-2.3.1-4.el9.x86_64 2023-10-21T16:25:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-21T16:25:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-21T16:25:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-21T16:25:47.081 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-10-21T16:25:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2023-10-21T16:25:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2023-10-21T16:25:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-21T16:25:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:18.0.0-6820.gf0804064.el9.noarch 2023-10-21T16:25:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-21T16:25:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2023-10-21T16:25:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-21T16:25:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-21T16:25:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-21T16:25:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-21T16:25:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-21T16:25:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-21T16:25:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-15.el9.x86_64 2023-10-21T16:25:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-21T16:25:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-21T16:25:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-21T16:25:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-21T16:25:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-21T16:25:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-21T16:25:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-21T16:25:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-21T16:25:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-21T16:25:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-21T16:25:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-21T16:25:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-21T16:25:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-21T16:25:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-21T16:25:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-21T16:25:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-21T16:25:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-21T16:25:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-21T16:25:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.11-1.el9.x86_64 2023-10-21T16:25:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-21T16:25:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-21T16:25:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-21T16:25:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-21T16:25:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-21T16:25:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-21T16:25:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-21T16:25:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-21T16:25:47.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-21T16:25:47.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-21T16:25:47.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-21T16:25:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-21T16:25:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-21T16:25:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-21T16:25:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-21T16:25:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-21T16:25:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-21T16:25:47.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-21T16:25:47.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-21T16:25:47.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-21T16:25:47.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-21T16:25:47.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-21T16:25:47.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-21T16:25:47.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-21T16:25:47.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-21T16:25:47.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-21T16:25:47.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-21T16:25:47.103 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-21T16:25:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-21T16:25:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-21T16:25:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-21T16:25:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-21T16:25:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.105 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.105 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.105 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.105 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-21T16:25:47.105 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-21T16:25:47.106 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-21T16:25:47.106 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.106 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.106 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-21T16:25:47.106 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-21T16:25:47.107 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-21T16:25:47.107 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-21T16:25:47.107 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-21T16:25:47.107 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-21T16:25:47.107 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.108 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.109 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.109 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.109 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.109 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-debuginfo-2:18.0.0-6820.gf0804064.el9.x86_64 2023-10-21T16:25:47.109 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2023-10-21T16:25:47.110 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-21T16:25:47.110 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-21T16:25:47.110 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-21T16:25:47.110 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-21T16:25:47.110 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-21T16:25:47.111 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-21T16:25:47.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:47.111 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-21T16:25:48.338 DEBUG:teuthology.parallel:result is None 2023-10-21T16:25:48.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:25:48.578 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-21T16:25:48.640 INFO:teuthology.orchestra.run.smithi012.stdout:18.0.0-6820.gf0804064.el9 2023-10-21T16:25:48.640 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6820.gf0804064.el9 2023-10-21T16:25:48.641 INFO:teuthology.task.install:The correct ceph version 18.0.0-6820.gf0804064 is installed. 2023-10-21T16:25:48.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:25:48.857 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-21T16:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout:18.0.0-6820.gf0804064.el9 2023-10-21T16:25:48.883 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6820.gf0804064.el9 2023-10-21T16:25:48.883 INFO:teuthology.task.install:The correct ceph version 18.0.0-6820.gf0804064 is installed. 2023-10-21T16:25:48.884 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-21T16:25:48.884 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:48.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-21T16:25:48.970 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:48.971 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-21T16:25:49.006 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-21T16:25:49.007 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:49.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-10-21T16:25:49.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-21T16:25:49.209 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:49.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2023-10-21T16:25:49.241 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-21T16:25:49.311 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-21T16:25:49.311 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:49.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-21T16:25:49.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-21T16:25:49.522 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:49.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-21T16:25:49.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-21T16:25:49.624 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-21T16:25:49.624 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:49.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-10-21T16:25:49.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-21T16:25:49.822 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:49.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2023-10-21T16:25:49.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-21T16:25:49.926 INFO:teuthology.run_tasks:Running task ceph... 2023-10-21T16:25:49.991 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-21T16:25:49.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-10-21T16:25:49.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2023-10-21T16:25:50.077 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-21T16:25:50.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-21T16:25:50.082 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-21T16:25:50.158 INFO:tasks.ceph:Creating extra log directories... 2023-10-21T16:25:50.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-21T16:25:50.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-21T16:25:50.265 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-21T16:25:50.266 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-21T16:25:50.266 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-21T16:25:50.268 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:50.268 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-21T16:25:50.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-21T16:25:50.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-21T16:25:50.712 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:50.713 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-21T16:25:50.731 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-21T16:25:50.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-21T16:25:50.889 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-21T16:25:50.889 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-21T16:25:50.890 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7434390', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 76, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2514, 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYN4kKqT7xVgODcVRCSZe5jsFsOCfrHaPYJH+rwCRkYG91+v0SBq7FZ9g6EmXEL4IkiQDrCcWb6rqSUlfLBcL0=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVkwp3no3ElQupln7HpL62qvqewOLKkQLS2EhgGvpL4oHHkRLhvdEoXYU/8yLVd6YgEBtq2APMjTS0n0gnLgsg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'f0804064d67a2a63dbabf1801ff452580a050cfc', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-20_18:46:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-21T16:25:50.891 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-21T16:25:50.901 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-21T16:25:50.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-10-21T16:25:50.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2023-10-21T16:25:51.058 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:51.059 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-10-21T16:25:51.120 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-21T16:25:51.120 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-10-21T16:25:51.176 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-21T16:25:51.177 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:51.177 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-10-21T16:25:51.177 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:51.177 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:51.178 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-21 16:25:38.372918722 +0000 2023-10-21T16:25:51.178 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-21 16:16:30.740783850 +0000 2023-10-21T16:25:51.178 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-21 16:16:30.740783850 +0000 2023-10-21T16:25:51.178 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-21 16:16:30.740783850 +0000 2023-10-21T16:25:51.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-21T16:25:51.272 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-21T16:25:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-21T16:25:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000438463 s, 1.2 MB/s 2023-10-21T16:25:51.276 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-21T16:25:51.335 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-10-21T16:25:51.386 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-21T16:25:51.387 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:51.387 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-10-21T16:25:51.387 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:51.387 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:51.388 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-21 16:25:38.373918714 +0000 2023-10-21T16:25:51.388 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-21 16:16:31.813775926 +0000 2023-10-21T16:25:51.388 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-21 16:16:31.813775926 +0000 2023-10-21T16:25:51.388 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-21 16:16:31.813775926 +0000 2023-10-21T16:25:51.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-21T16:25:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-21T16:25:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-21T16:25:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000339455 s, 1.5 MB/s 2023-10-21T16:25:51.478 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-21T16:25:51.539 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-10-21T16:25:51.590 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-21T16:25:51.590 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:51.590 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-10-21T16:25:51.590 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-21 16:25:38.373918714 +0000 2023-10-21T16:25:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-21 16:16:32.896767929 +0000 2023-10-21T16:25:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-21 16:16:32.896767929 +0000 2023-10-21T16:25:51.591 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-21 16:16:32.896767929 +0000 2023-10-21T16:25:51.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-21T16:25:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-21T16:25:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-21T16:25:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000349528 s, 1.5 MB/s 2023-10-21T16:25:51.684 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-21T16:25:51.741 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-10-21T16:25:51.794 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-21T16:25:51.794 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:51.794 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-10-21T16:25:51.794 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:51.795 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:51.795 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-21 16:25:38.375918699 +0000 2023-10-21T16:25:51.795 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-21 16:16:33.975759960 +0000 2023-10-21T16:25:51.795 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-21 16:16:33.975759960 +0000 2023-10-21T16:25:51.795 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-21 16:16:33.975759960 +0000 2023-10-21T16:25:51.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-21T16:25:51.891 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-21T16:25:51.891 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-21T16:25:51.891 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000332139 s, 1.5 MB/s 2023-10-21T16:25:51.894 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-21T16:25:51.954 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:51.955 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:51.955 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2023-10-21T16:25:51.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-21T16:25:51.974 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2023-10-21T16:25:52.031 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-21T16:25:52.032 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:52.032 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-10-21T16:25:52.032 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:52.032 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:52.033 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-10-21 16:24:23.330588433 +0000 2023-10-21T16:25:52.033 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-10-21 16:12:27.396510813 +0000 2023-10-21T16:25:52.033 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-10-21 16:12:27.396510813 +0000 2023-10-21T16:25:52.033 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-10-21 16:12:27.396510813 +0000 2023-10-21T16:25:52.034 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-21T16:25:52.100 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-10-21T16:25:52.101 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-10-21T16:25:52.101 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00022263 s, 2.3 MB/s 2023-10-21T16:25:52.102 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-21T16:25:52.161 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2023-10-21T16:25:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-21T16:25:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:52.218 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-21T16:25:52.218 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:52.218 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:52.218 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-10-21 16:24:23.331588428 +0000 2023-10-21T16:25:52.218 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-10-21 16:12:27.896508820 +0000 2023-10-21T16:25:52.219 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-10-21 16:12:27.896508820 +0000 2023-10-21T16:25:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-10-21 16:12:27.896508820 +0000 2023-10-21T16:25:52.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-21T16:25:52.285 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-10-21T16:25:52.285 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-10-21T16:25:52.286 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000199053 s, 2.6 MB/s 2023-10-21T16:25:52.287 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-21T16:25:52.343 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2023-10-21T16:25:52.399 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-21T16:25:52.400 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:52.400 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-10-21T16:25:52.400 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:52.400 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:52.400 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-10-21 16:24:23.331588428 +0000 2023-10-21T16:25:52.401 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-10-21 16:12:28.395506832 +0000 2023-10-21T16:25:52.401 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-10-21 16:12:28.395506832 +0000 2023-10-21T16:25:52.401 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-10-21 16:12:28.395506832 +0000 2023-10-21T16:25:52.401 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-21T16:25:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-10-21T16:25:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-10-21T16:25:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000239494 s, 2.1 MB/s 2023-10-21T16:25:52.468 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-21T16:25:52.525 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2023-10-21T16:25:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-21T16:25:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-21T16:25:52.580 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-10-21T16:25:52.580 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:25:52.580 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-10-21T16:25:52.581 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-10-21 16:24:23.332588424 +0000 2023-10-21T16:25:52.581 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-10-21 16:12:28.883504888 +0000 2023-10-21T16:25:52.581 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-10-21 16:12:28.883504888 +0000 2023-10-21T16:25:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-10-21 16:12:28.883504888 +0000 2023-10-21T16:25:52.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-21T16:25:52.646 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-10-21T16:25:52.646 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-10-21T16:25:52.646 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000254246 s, 2.0 MB/s 2023-10-21T16:25:52.647 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-21T16:25:52.704 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:52.704 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-21T16:25:52.704 INFO:tasks.ceph:Generating config... 2023-10-21T16:25:52.706 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-21T16:25:52.706 INFO:tasks.ceph:[client] debug client = 20 2023-10-21T16:25:52.706 INFO:tasks.ceph:[client] debug ms = 1 2023-10-21T16:25:52.707 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-21T16:25:52.707 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-21T16:25:52.707 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-10-21T16:25:52.707 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-10-21T16:25:52.708 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-21T16:25:52.708 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-10-21T16:25:52.708 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-21T16:25:52.708 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-21T16:25:52.709 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-21T16:25:52.709 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-21T16:25:52.709 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-21T16:25:52.709 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-21T16:25:52.710 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-10-21T16:25:52.710 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-21T16:25:52.710 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-21T16:25:52.710 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-21T16:25:52.711 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-21T16:25:52.711 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-21T16:25:52.711 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-21T16:25:52.712 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-21T16:25:52.712 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-21T16:25:52.712 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-21T16:25:52.712 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-21T16:25:52.712 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-10-21T16:25:52.713 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-21T16:25:52.713 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-21T16:25:52.713 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-21T16:25:52.713 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-21T16:25:52.714 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-21T16:25:52.714 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-21T16:25:52.714 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-21T16:25:52.714 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-21T16:25:52.715 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-21T16:25:52.715 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-21T16:25:52.715 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-21T16:25:52.715 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-21T16:25:52.716 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-21T16:25:52.716 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-21T16:25:52.716 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-10-21T16:25:52.716 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-21T16:25:52.717 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-21T16:25:52.717 INFO:tasks.ceph:Setting up mon.a... 2023-10-21T16:25:52.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-21T16:25:52.908 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-10-21T16:25:52.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-21T16:25:53.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-21T16:25:53.167 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]')] 2023-10-21T16:25:53.168 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-21T16:25:53.169 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:53.169 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-21T16:25:53.225 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:25:53.393 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:25:53.394 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 31504b75-3b00-4d04-9abc-c2f1cbe20b72 2023-10-21T16:25:53.394 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2023-10-21T16:25:53.394 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-10-21T16:25:53.394 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 31504b75-3b00-4d04-9abc-c2f1cbe20b72 2023-10-21T16:25:53.395 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-10-21T16:25:53.391384+0000 2023-10-21T16:25:53.395 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-10-21T16:25:53.391384+0000 2023-10-21T16:25:53.395 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 16 (pacific) 2023-10-21T16:25:53.395 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-10-21T16:25:53.395 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-21T16:25:53.396 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2023-10-21T16:25:53.396 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2023-10-21T16:25:53.396 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-21T16:25:53.397 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-21T16:25:53.452 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 31504b75-3b00-4d04-9abc-c2f1cbe20b72... 2023-10-21T16:25:53.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-21T16:25:53.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-21T16:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2023-10-21T16:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2023-10-21T16:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-21T16:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2023-10-21T16:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2023-10-21T16:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2023-10-21T16:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2023-10-21T16:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2023-10-21T16:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2023-10-21T16:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2023-10-21T16:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-21T16:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2023-10-21T16:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2023-10-21T16:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-21T16:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2023-10-21T16:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2023-10-21T16:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2023-10-21T16:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2023-10-21T16:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2023-10-21T16:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2023-10-21T16:25:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2023-10-21T16:25:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2023-10-21T16:25:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-21T16:25:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-21T16:25:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2023-10-21T16:25:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-21T16:25:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2023-10-21T16:25:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2023-10-21T16:25:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.12,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2023-10-21T16:25:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: mds beacon grace = 60 2023-10-21T16:25:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: mds heartbeat grace = 60 2023-10-21T16:25:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on skipped message = False 2023-10-21T16:25:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: osd heartbeat grace = 60 2023-10-21T16:25:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 31504b75-3b00-4d04-9abc-c2f1cbe20b72 2023-10-21T16:25:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.526 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2023-10-21T16:25:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2023-10-21T16:25:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2023-10-21T16:25:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2023-10-21T16:25:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2023-10-21T16:25:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2023-10-21T16:25:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2023-10-21T16:25:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2023-10-21T16:25:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2023-10-21T16:25:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2023-10-21T16:25:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2023-10-21T16:25:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2023-10-21T16:25:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2023-10-21T16:25:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2023-10-21T16:25:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2023-10-21T16:25:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2023-10-21T16:25:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2023-10-21T16:25:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2023-10-21T16:25:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2023-10-21T16:25:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2023-10-21T16:25:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2023-10-21T16:25:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2023-10-21T16:25:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2023-10-21T16:25:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-10-21T16:25:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2023-10-21T16:25:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2023-10-21T16:25:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2023-10-21T16:25:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2023-10-21T16:25:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2023-10-21T16:25:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2023-10-21T16:25:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: osd fast shutdown = False 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-10-21T16:25:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2023-10-21T16:25:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-10-21T16:25:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-10-21T16:25:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-10-21T16:25:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-10-21T16:25:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2023-10-21T16:25:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.537 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2023-10-21T16:25:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-10-21T16:25:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-10-21T16:25:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2023-10-21T16:25:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-10-21T16:25:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2023-10-21T16:25:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2023-10-21T16:25:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-10-21T16:25:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2023-10-21T16:25:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2023-10-21T16:25:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-10-21T16:25:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-21T16:25:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-21T16:25:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2023-10-21T16:25:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2023-10-21T16:25:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2023-10-21T16:25:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2023-10-21T16:25:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd crush smoke test = False 2023-10-21T16:25:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-21T16:25:53.542 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2023-10-21T16:25:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2023-10-21T16:25:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2023-10-21T16:25:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2023-10-21T16:25:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-21T16:25:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-21T16:25:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2023-10-21T16:25:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2023-10-21T16:25:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-10-21T16:25:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2023-10-21T16:25:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2023-10-21T16:25:53.544 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2023-10-21T16:25:53.544 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.e] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2023-10-21T16:25:53.545 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2023-10-21T16:25:53.546 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.f] 2023-10-21T16:25:53.546 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2023-10-21T16:25:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2023-10-21T16:25:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2023-10-21T16:25:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-10-21T16:25:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2023-10-21T16:25:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2023-10-21T16:25:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2023-10-21T16:25:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: mds valgrind exit = True 2023-10-21T16:25:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2023-10-21T16:25:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2023-10-21T16:25:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2023-10-21T16:25:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2023-10-21T16:25:53.636 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-10-21T16:25:53.637 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-10-21T16:25:53.637 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-21T16:25:53.637 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-10-21T16:25:53.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.637 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-10-21T16:25:53.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.638 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-10-21T16:25:53.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-10-21T16:25:53.638 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-10-21T16:25:53.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.639 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-10-21T16:25:53.639 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-10-21T16:25:53.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.639 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-21T16:25:53.640 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-10-21T16:25:53.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.640 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-10-21T16:25:53.640 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-21T16:25:53.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.641 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-10-21T16:25:53.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.641 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-10-21T16:25:53.641 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-10-21T16:25:53.641 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-10-21T16:25:53.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-10-21T16:25:53.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-10-21T16:25:53.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-10-21T16:25:53.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-10-21T16:25:53.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-21T16:25:53.643 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-21T16:25:53.643 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-10-21T16:25:53.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.643 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-21T16:25:53.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.644 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-10-21T16:25:53.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-10-21T16:25:53.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: mds beacon grace = 60 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: mds heartbeat grace = 60 2023-10-21T16:25:53.645 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2023-10-21T16:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout: osd heartbeat grace = 60 2023-10-21T16:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 31504b75-3b00-4d04-9abc-c2f1cbe20b72 2023-10-21T16:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-10-21T16:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-10-21T16:25:53.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.647 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-10-21T16:25:53.647 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-10-21T16:25:53.647 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2023-10-21T16:25:53.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.648 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-10-21T16:25:53.648 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-10-21T16:25:53.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.648 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-10-21T16:25:53.648 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-10-21T16:25:53.649 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-10-21T16:25:53.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.649 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-10-21T16:25:53.649 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-10-21T16:25:53.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.650 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-10-21T16:25:53.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.650 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-10-21T16:25:53.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.650 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-10-21T16:25:53.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.651 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-10-21T16:25:53.651 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-10-21T16:25:53.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.651 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-10-21T16:25:53.652 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-10-21T16:25:53.652 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2023-10-21T16:25:53.652 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2023-10-21T16:25:53.652 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2023-10-21T16:25:53.652 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-10-21T16:25:53.653 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-10-21T16:25:53.653 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2023-10-21T16:25:53.653 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2023-10-21T16:25:53.653 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-21T16:25:53.653 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-10-21T16:25:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2023-10-21T16:25:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-10-21T16:25:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-10-21T16:25:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-10-21T16:25:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-10-21T16:25:53.655 INFO:teuthology.orchestra.run.smithi012.stdout: osd fast shutdown = False 2023-10-21T16:25:53.655 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-10-21T16:25:53.655 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-21T16:25:53.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.655 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-21T16:25:53.656 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-21T16:25:53.657 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-10-21T16:25:53.658 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-21T16:25:53.658 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-10-21T16:25:53.658 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-10-21T16:25:53.658 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-21T16:25:53.658 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-10-21T16:25:53.659 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-10-21T16:25:53.659 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-21T16:25:53.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.659 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-21T16:25:53.659 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-10-21T16:25:53.660 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-10-21T16:25:53.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.660 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-10-21T16:25:53.660 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-21T16:25:53.660 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2023-10-21T16:25:53.661 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2023-10-21T16:25:53.662 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd crush smoke test = False 2023-10-21T16:25:53.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:25:53.662 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-10-21T16:25:53.662 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-10-21T16:25:53.662 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2023-10-21T16:25:53.663 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-10-21T16:25:53.663 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-21T16:25:53.663 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-21T16:25:53.663 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2023-10-21T16:25:53.663 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2023-10-21T16:25:53.664 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-21T16:25:53.664 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-21T16:25:53.664 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-21T16:25:53.664 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-10-21T16:25:53.664 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-21T16:25:53.665 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-10-21T16:25:53.666 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f] 2023-10-21T16:25:53.666 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2023-10-21T16:25:53.666 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2023-10-21T16:25:53.666 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2023-10-21T16:25:53.666 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-21T16:25:53.667 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2023-10-21T16:25:53.667 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2023-10-21T16:25:53.667 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2023-10-21T16:25:53.667 INFO:teuthology.orchestra.run.smithi012.stdout: mds valgrind exit = True 2023-10-21T16:25:53.667 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2023-10-21T16:25:53.668 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-21T16:25:53.668 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-21T16:25:53.668 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-21T16:25:53.685 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-21T16:25:53.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-21T16:25:53.842 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-21T16:25:53.842 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:53.843 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-21T16:25:53.898 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:53.899 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-21T16:25:53.956 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:25:53.956 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:53.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-21T16:25:53.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-21T16:25:54.118 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:25:54.118 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:25:54.221 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:25:54.222 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:54.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-21T16:25:54.223 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-21T16:25:54.269 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:25:54.269 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:25:54.325 INFO:tasks.ceph:Setting up mon nodes... 2023-10-21T16:25:54.325 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-21T16:25:54.326 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-21T16:25:54.525 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-21T16:25:54.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-21T16:25:54.600 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-21T16:25:54.603 INFO:tasks.ceph:Setting up mds nodes... 2023-10-21T16:25:54.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-21T16:25:54.815 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-21T16:25:54.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-21T16:25:54.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-21T16:25:55.135 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-21T16:25:55.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-21T16:25:55.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-10-21T16:25:55.430 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-10-21T16:25:55.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-10-21T16:25:55.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-21T16:25:55.606 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-21T16:25:55.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-21T16:25:55.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-21T16:25:55.734 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-21T16:25:55.737 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-21T16:25:55.764 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-10-21T16:25:55.857 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-10-21T16:25:55.860 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-10-21T16:25:55.886 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-21T16:25:55.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-21T16:25:56.031 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-21T16:25:56.086 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-21T16:25:56.087 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-21T16:25:56.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-21T16:25:56.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:56.194 INFO:tasks.ceph:role: osd.0 2023-10-21T16:25:56.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:25:56.195 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-21T16:25:56.300 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:25:56.300 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:25:56.300 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:25:56.301 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:25:56.301 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:25:56.301 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:25:56.301 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:25:56.302 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:25:56.302 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:25:56.302 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:25:56.811 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-21T16:25:56.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-21T16:25:56.818 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-21T16:25:57.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-21T16:25:57.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-21T16:25:57.240 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:57.240 INFO:tasks.ceph:role: osd.1 2023-10-21T16:25:57.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:25:57.241 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-21T16:25:57.347 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:25:57.347 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:25:57.347 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:25:57.348 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:25:57.348 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:25:57.348 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:25:57.348 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:25:57.348 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:25:57.349 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:25:57.349 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:25:57.837 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-21T16:25:57.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-21T16:25:57.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-21T16:25:57.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-21T16:25:58.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-21T16:25:58.148 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:58.148 INFO:tasks.ceph:role: osd.2 2023-10-21T16:25:58.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:25:58.149 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-21T16:25:58.238 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:25:58.239 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:25:58.239 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:25:58.239 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:25:58.239 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:25:58.239 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:25:58.240 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:25:58.240 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:25:58.240 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:25:58.240 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:25:58.755 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-21T16:25:58.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-21T16:25:58.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-21T16:25:58.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-21T16:25:59.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-21T16:25:59.175 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-21T16:25:59.176 INFO:tasks.ceph:role: osd.3 2023-10-21T16:25:59.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T16:25:59.177 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-21T16:25:59.288 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:25:59.288 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:25:59.289 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:25:59.289 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:25:59.289 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:25:59.289 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:25:59.290 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:25:59.290 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:25:59.290 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:25:59.290 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:25:59.747 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-21T16:25:59.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-21T16:25:59.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-21T16:25:59.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-21T16:26:00.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.158+0000 7f3e0b824500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-21T16:26:00.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.163+0000 7f3e0b824500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-21T16:26:00.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.163+0000 7f3e0b824500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-21T16:26:00.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.163+0000 7f3e0b824500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-21T16:26:00.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.163+0000 7f3e0b824500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-21T16:26:00.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:00.168+0000 7f3e0b824500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-21T16:26:03.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-21T16:26:03.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.609+0000 7f5dfb4a5500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-21T16:26:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.610+0000 7f5dfb4a5500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-21T16:26:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.610+0000 7f5dfb4a5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-21T16:26:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.610+0000 7f5dfb4a5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-21T16:26:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.610+0000 7f5dfb4a5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-21T16:26:03.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:03.612+0000 7f5dfb4a5500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-21T16:26:06.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-21T16:26:06.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:07.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.029+0000 7faee4410500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-21T16:26:07.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.029+0000 7faee4410500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-21T16:26:07.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.029+0000 7faee4410500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-21T16:26:07.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.029+0000 7faee4410500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-21T16:26:07.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.029+0000 7faee4410500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-21T16:26:07.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:07.032+0000 7faee4410500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-21T16:26:10.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-21T16:26:10.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.481+0000 7f87a280e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-21T16:26:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.482+0000 7f87a280e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-21T16:26:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.482+0000 7f87a280e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-21T16:26:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.482+0000 7f87a280e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-21T16:26:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.482+0000 7f87a280e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-21T16:26:10.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:10.485+0000 7f87a280e500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-21T16:26:13.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-21T16:26:13.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-21T16:26:13.805 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-21T16:26:13.806 INFO:tasks.ceph:role: osd.4 2023-10-21T16:26:13.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:26:13.807 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-21T16:26:13.883 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:26:13.884 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:26:13.884 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:26:13.884 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:26:13.884 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:26:13.884 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:26:13.885 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:26:13.885 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:26:13.885 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:26:13.885 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:26:14.409 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-10-21T16:26:14.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-10-21T16:26:14.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-21T16:26:14.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-21T16:26:14.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-21T16:26:14.645 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-21T16:26:14.646 INFO:tasks.ceph:role: osd.5 2023-10-21T16:26:14.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:26:14.647 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-21T16:26:14.721 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:26:14.722 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:26:14.722 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:26:14.722 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:26:14.722 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:26:14.723 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:26:14.723 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:26:14.723 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:26:14.723 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:26:14.723 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:26:15.169 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-10-21T16:26:15.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-10-21T16:26:15.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-21T16:26:15.262 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-21T16:26:15.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-21T16:26:15.361 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-21T16:26:15.361 INFO:tasks.ceph:role: osd.6 2023-10-21T16:26:15.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:26:15.362 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-21T16:26:15.435 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:26:15.435 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:26:15.435 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:26:15.435 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:26:15.436 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:26:15.929 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-10-21T16:26:15.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-10-21T16:26:15.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-21T16:26:16.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-21T16:26:16.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-21T16:26:16.180 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-21T16:26:16.180 INFO:tasks.ceph:role: osd.7 2023-10-21T16:26:16.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T16:26:16.181 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-21T16:26:16.254 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-21T16:26:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-21T16:26:16.255 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-21T16:26:16.255 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-21T16:26:16.255 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-21T16:26:16.255 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-10-21T16:26:16.255 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-21T16:26:16.256 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-21T16:26:16.256 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-21T16:26:16.256 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-21T16:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-10-21T16:26:16.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-10-21T16:26:16.761 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-21T16:26:16.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-21T16:26:16.930 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:17.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.036+0000 7fa2ff4af500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-21T16:26:17.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.036+0000 7fa2ff4af500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-21T16:26:17.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.036+0000 7fa2ff4af500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-21T16:26:17.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.036+0000 7fa2ff4af500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-21T16:26:17.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.036+0000 7fa2ff4af500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-21T16:26:17.039 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:17.037+0000 7fa2ff4af500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-21T16:26:19.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-21T16:26:19.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.005+0000 7fac72825500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-21T16:26:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.005+0000 7fac72825500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-21T16:26:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.005+0000 7fac72825500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-21T16:26:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.005+0000 7fac72825500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-21T16:26:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.005+0000 7fac72825500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-21T16:26:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:20.006+0000 7fac72825500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-21T16:26:20.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:26:20.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:26:22.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-21T16:26:22.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.989+0000 7f3ea760c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-21T16:26:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.990+0000 7f3ea760c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-21T16:26:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.990+0000 7f3ea760c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-21T16:26:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.990+0000 7f3ea760c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-21T16:26:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.990+0000 7f3ea760c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-21T16:26:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:22.990+0000 7f3ea760c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-21T16:26:25.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-21T16:26:25.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:25.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.977+0000 7f605a74a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-21T16:26:25.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.978+0000 7f605a74a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-21T16:26:25.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.978+0000 7f605a74a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-21T16:26:25.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.978+0000 7f605a74a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-21T16:26:25.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.978+0000 7f605a74a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-21T16:26:25.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:25.978+0000 7f605a74a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-21T16:26:28.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-21T16:26:28.861 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-21T16:26:28.862 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:28.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-21T16:26:28.972 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:28.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-21T16:26:29.076 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-21T16:26:29.181 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-10-21T16:26:29.282 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-21T16:26:29.387 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-21T16:26:29.489 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-21T16:26:29.593 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:29.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-21T16:26:29.699 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:29.699 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-21T16:26:29.731 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:29.731 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-21T16:26:29.800 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:29.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-21T16:26:29.869 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:29.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-10-21T16:26:29.938 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:29.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-21T16:26:30.006 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:30.007 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-21T16:26:30.075 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:30.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-21T16:26:30.142 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:30.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-21T16:26:30.210 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:30.210 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-21T16:26:30.274 INFO:tasks.ceph:Adding keys to all mons... 2023-10-21T16:26:30.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-21T16:26:30.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-21T16:26:30.309 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2023-10-21T16:26:30.310 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCS+zNl/CxTHxAA4ewINW9+vhGeffywNHtvDA== 2023-10-21T16:26:30.310 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2023-10-21T16:26:30.310 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCS+zNl+RmeMBAA8F1zMHpmjry0YPnAgNg1AA== 2023-10-21T16:26:30.311 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2023-10-21T16:26:30.311 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCT+zNlMmkRCBAAK73t1r3ql3AvJzOv3C6BNQ== 2023-10-21T16:26:30.311 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.e] 2023-10-21T16:26:30.311 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCT+zNlw0GfGRAAwAxfRuIeX/tBlM4Wqq7DLQ== 2023-10-21T16:26:30.311 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2023-10-21T16:26:30.312 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCY+zNlJIWICRAAcJJEfkoTeGXMLv/nT0ndgg== 2023-10-21T16:26:30.312 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2023-10-21T16:26:30.312 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCb+zNlSmtsJBAAZvamgIZTVLt3WzSRe2YngQ== 2023-10-21T16:26:30.312 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2023-10-21T16:26:30.312 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCf+zNlvtLSARAAmosPEBl9V5P1wRVw3Ax+vA== 2023-10-21T16:26:30.313 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2023-10-21T16:26:30.313 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCi+zNlQgjNHBAA6MGI3D1RlUGzjRLQddK9Rg== 2023-10-21T16:26:30.313 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2023-10-21T16:26:30.314 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCS+zNlSEXFIxAAWymSpCV13eRomIXU9vWf9Q== 2023-10-21T16:26:30.314 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2023-10-21T16:26:30.314 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCT+zNljq8lJBAAma25DcLaYeUvPI3/1ogVOg== 2023-10-21T16:26:30.314 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCT+zNliPvGKxAAx2w8eOnO+PcgHKtA4yhTRg== 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.f] 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCT+zNlIEcfMxAA/f3OFvZ8Q/t1gGnihk8SWg== 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCp+zNlz8E0AhAAUVJLgb1GobCnLQ/IB36s2w== 2023-10-21T16:26:30.315 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2023-10-21T16:26:30.316 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCs+zNlm8ReABAAdN3MOLFGlako1rrJ49VEDQ== 2023-10-21T16:26:30.316 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2023-10-21T16:26:30.316 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCu+zNlJFQMOxAAv65NOhHcgHyBSxko5BLW4Q== 2023-10-21T16:26:30.316 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2023-10-21T16:26:30.316 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCx+zNl8NpTOhAAWZ6EY0sh2YDZZefiG8FrVw== 2023-10-21T16:26:30.317 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2023-10-21T16:26:30.317 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCU+zNlhM/XARAAol9Md/eSinOFC7XKa1AL6w== 2023-10-21T16:26:30.373 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2023-10-21T16:26:30.374 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCS+zNl/CxTHxAA4ewINW9+vhGeffywNHtvDA== 2023-10-21T16:26:30.374 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-21T16:26:30.374 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCS+zNl+RmeMBAA8F1zMHpmjry0YPnAgNg1AA== 2023-10-21T16:26:30.374 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-10-21T16:26:30.375 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCT+zNlMmkRCBAAK73t1r3ql3AvJzOv3C6BNQ== 2023-10-21T16:26:30.375 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e] 2023-10-21T16:26:30.375 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCT+zNlw0GfGRAAwAxfRuIeX/tBlM4Wqq7DLQ== 2023-10-21T16:26:30.375 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-10-21T16:26:30.375 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCY+zNlJIWICRAAcJJEfkoTeGXMLv/nT0ndgg== 2023-10-21T16:26:30.376 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-10-21T16:26:30.376 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCb+zNlSmtsJBAAZvamgIZTVLt3WzSRe2YngQ== 2023-10-21T16:26:30.376 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-10-21T16:26:30.376 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCf+zNlvtLSARAAmosPEBl9V5P1wRVw3Ax+vA== 2023-10-21T16:26:30.376 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2023-10-21T16:26:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCi+zNlQgjNHBAA6MGI3D1RlUGzjRLQddK9Rg== 2023-10-21T16:26:30.377 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-10-21T16:26:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCS+zNlSEXFIxAAWymSpCV13eRomIXU9vWf9Q== 2023-10-21T16:26:30.377 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-21T16:26:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCT+zNljq8lJBAAma25DcLaYeUvPI3/1ogVOg== 2023-10-21T16:26:30.378 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-10-21T16:26:30.378 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCT+zNliPvGKxAAx2w8eOnO+PcgHKtA4yhTRg== 2023-10-21T16:26:30.378 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f] 2023-10-21T16:26:30.378 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCT+zNlIEcfMxAA/f3OFvZ8Q/t1gGnihk8SWg== 2023-10-21T16:26:30.378 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCp+zNlz8E0AhAAUVJLgb1GobCnLQ/IB36s2w== 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCs+zNlm8ReABAAdN3MOLFGlako1rrJ49VEDQ== 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCu+zNlJFQMOxAAv65NOhHcgHyBSxko5BLW4Q== 2023-10-21T16:26:30.379 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2023-10-21T16:26:30.380 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCx+zNl8NpTOhAAWZ6EY0sh2YDZZefiG8FrVw== 2023-10-21T16:26:30.380 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-10-21T16:26:30.380 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCU+zNlhM/XARAAol9Md/eSinOFC7XKa1AL6w== 2023-10-21T16:26:30.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-21T16:26:30.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-21T16:26:30.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:30.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:30.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:30.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:30.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:30.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:31.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:31.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-21T16:26:31.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-21T16:26:31.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:31.783 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:31.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:31.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:32.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:32.094 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-21T16:26:32.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.405 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-21T16:26:32.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-21T16:26:32.867 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-21T16:26:33.022 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-21T16:26:33.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-21T16:26:33.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-21T16:26:33.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-21T16:26:33.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-21T16:26:33.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-21T16:26:33.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-21T16:26:33.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-21T16:26:33.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-21T16:26:33.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-21T16:26:33.717 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:33.726 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-21T16:26:33.780 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-21T16:26:33.780 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-21T16:26:33.781 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-21T16:26:33.781 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-10-21T16:26:33.790 INFO:tasks.ceph.mon.a:Started 2023-10-21T16:26:33.791 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-21T16:26:33.791 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-21T16:26:33.792 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-10-21T16:26:33.813 INFO:tasks.ceph.mon.b:Started 2023-10-21T16:26:33.813 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-21T16:26:33.813 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-21T16:26:33.814 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-10-21T16:26:33.816 INFO:tasks.ceph.mon.c:Started 2023-10-21T16:26:33.816 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-21T16:26:33.817 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-21T16:26:33.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-10-21T16:26:33.825 INFO:tasks.ceph.mgr.y:Started 2023-10-21T16:26:33.826 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-21T16:26:33.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-10-21T16:26:33.828 INFO:tasks.ceph.mgr.x:Started 2023-10-21T16:26:33.829 INFO:tasks.ceph:Setting crush tunables to default 2023-10-21T16:26:33.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-10-21T16:26:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.012+0000 7fe900850640 1 Processor -- start 2023-10-21T16:26:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.012+0000 7fe900850640 1 -- start start 2023-10-21T16:26:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.013+0000 7fe900850640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe900850640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe900850640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc15aef0 con 0x7fe8fc159a40 2023-10-21T16:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe900850640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8fc15a540 2023-10-21T16:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe900850640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0cad40 con 0x7fe8fc1532c0 2023-10-21T16:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe8fb59e640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8fc15a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe8fad9d640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8fc0c9e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe8f3fff640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8fc0ce820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe8fb59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.014+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.215+0000 7fe8f3fff640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8fc0ce820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.215+0000 7fe8fb59e640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8fc15a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.215+0000 7fe8fad9d640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8fc0c9e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.215+0000 7fe8fb59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.215+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:34.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.616+0000 7fe8f3fff640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8fc0ce820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:34.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.616+0000 7fe8fb59e640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8fc15a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:34.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.616+0000 7fe8fad9d640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8fc0c9e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:34.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.616+0000 7fe8fb59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:34.616+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:35.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:35.417+0000 7fe8fb59e640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8fc15a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:35.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:35.417+0000 7fe8fb59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:35.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:35.417+0000 7fe8f3fff640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8fc0ce820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:35.417+0000 7fe8fad9d640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8fc0c9e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:35.417+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8fc0c9e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8fc0c9e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8fc15a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8fc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8fc0ce820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc1536a0 con 0x7fe8dc006220 2023-10-21T16:26:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f959a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8dc0036c0 2023-10-21T16:26:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8f3fff640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc006220 legacy=0x7fe8dc0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.014+0000 7fe8fad9d640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 msgr2=0x7fe8dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.015+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.215+0000 7fe8f3fff640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc006220 legacy=0x7fe8dc0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.216+0000 7fe8fad9d640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 msgr2=0x7fe8dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.216+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:37.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.616+0000 7fe8f3fff640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc006220 legacy=0x7fe8dc0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.617+0000 7fe8fad9d640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 msgr2=0x7fe8dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:37.617+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:38.417+0000 7fe8f3fff640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc006220 legacy=0x7fe8dc0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:38.418+0000 7fe8fad9d640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 msgr2=0x7fe8dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:38.418+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.014+0000 7fe8f959a640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 msgr2=0x7fe8dc005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.014+0000 7fe8f959a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0036c0 0x7fe8dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.014+0000 7fe8f959a640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc006220 legacy=0x7fe8dc0086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.014+0000 7fe8fb59e640 1 -- reap_dead start 2023-10-21T16:26:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f959a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f959a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f959a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc15aef0 con 0x7fe8fc159a40 2023-10-21T16:26:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f959a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8fc15a540 2023-10-21T16:26:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f959a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0cad40 con 0x7fe8fc1532c0 2023-10-21T16:26:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8fad9d640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f3fff640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8fb59e640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:40.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.015+0000 7fe8fb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.216+0000 7fe8fb59e640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.216+0000 7fe8f3fff640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.216+0000 7fe8fad9d640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.216+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.216+0000 7fe8fb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:40.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.617+0000 7fe8fb59e640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:40.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.617+0000 7fe8fad9d640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:40.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.617+0000 7fe8f3fff640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:40.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.617+0000 7fe8fb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:40.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:40.617+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:41.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:41.418+0000 7fe8fb59e640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3301/0 2023-10-21T16:26:41.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:41.418+0000 7fe8fb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:41.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:41.418+0000 7fe8fad9d640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.99:6789/0 2023-10-21T16:26:41.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:41.418+0000 7fe8f3fff640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.99:3300/0 2023-10-21T16:26:41.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:41.418+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:41.710 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:00:07.794 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:41.715 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:00:07.800 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:42.035 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:00:08.119 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:42.041 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:00:08.125 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:42.825 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:00:08.808 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 -- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 -- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 -- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc1536a0 con 0x7fe8dc008e10 2023-10-21T16:26:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f959a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8dc009900 2023-10-21T16:26:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8f3fff640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.015+0000 7fe8fad9d640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc008e10 legacy=0x7fe8dc0091f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.016+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:43.167 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:00:09.150 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:26:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.217+0000 7fe8fad9d640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc008e10 legacy=0x7fe8dc0091f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.217+0000 7fe8f3fff640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.217+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.618+0000 7fe8fad9d640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc008e10 legacy=0x7fe8dc0091f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.618+0000 7fe8f3fff640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:43.618+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:44.419+0000 7fe8fad9d640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc008e10 legacy=0x7fe8dc0091f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.12:6789/0 2023-10-21T16:26:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:44.419+0000 7fe8f3fff640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.12:3300/0 2023-10-21T16:26:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:44.419+0000 7fe8f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.015+0000 7fe8f959a640 1 -- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.015+0000 7fe8f959a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8dc009900 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.015+0000 7fe8f959a640 1 -- >> v1:172.21.15.12:6789/0 conn(0x7fe8dc008e10 legacy=0x7fe8dc0091f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8fb59e640 1 -- reap_dead start 2023-10-21T16:26:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8f959a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8f959a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8f959a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc15aef0 con 0x7fe8fc159a40 2023-10-21T16:26:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8f959a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8fc15a540 2023-10-21T16:26:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.016+0000 7fe8f959a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0cad40 con 0x7fe8fc1532c0 2023-10-21T16:26:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.017+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.017+0000 7fe8fb59e640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 0x7fe8dc009f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:55588/0 (socket says 172.21.15.12:55588) 2023-10-21T16:26:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.017+0000 7fe8fb59e640 1 -- 172.21.15.12:0/1660529385 learned_addr learned my addr 172.21.15.12:0/1660529385 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:26:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.017+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.019+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.019+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.019+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.019+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.027+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-21T16:26:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.027+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.027+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.027+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:46.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.220+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.222+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:46.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.222+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.222+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.222+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:46.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.231+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.233+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.233+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.234+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.234+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:46.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.624+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.625+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:46.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.625+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.625+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.625+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.635+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.637+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.637+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.637+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:46.637+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-21T16:26:47.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.427+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:47.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.428+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:47.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.428+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.428+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.428+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.439+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.440+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-21T16:26:47.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.440+0000 7fe8f3fff640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:47.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.440+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:47.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:47.440+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-21T16:26:49.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 msgr2=0x7fe8dc012120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:49.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc1532c0 0x7fe8dc012120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:49.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 msgr2=0x7fe8dc00a690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-21T16:26:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15a540 0x7fe8dc00a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 -- 172.21.15.12:0/1660529385 >> v1:172.21.15.99:6789/0 conn(0x7fe8fc159a40 legacy=0x7fe8dc009f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 -- 172.21.15.12:0/1660529385 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc1536a0 con 0x7fe8dc0066b0 2023-10-21T16:26:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.016+0000 7fe8f959a640 1 -- 172.21.15.12:0/1660529385 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c9c30 con 0x7fe8dc0091f0 2023-10-21T16:26:49.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.205+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.222+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-21T16:26:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.222+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.222+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:49.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.222+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-21T16:26:49.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.516+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.554+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-21T16:26:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.554+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 msgr2=0x7fe8dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-21T16:26:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.554+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-21T16:26:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.554+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-21T16:26:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.972+0000 7fe8fa59c640 1 -- 172.21.15.12:0/1660529385 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463159548 0 0) 0x7fe8fc1536a0 con 0x7fe8dc0066b0 2023-10-21T16:26:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:49.972+0000 7fe8fa59c640 1 -- 172.21.15.12:0/1660529385 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e8003520 con 0x7fe8dc0066b0 2023-10-21T16:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.104+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> v2:172.21.15.12:3300/0 conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.205+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 >> v1:172.21.15.12:6789/0 conn(0x7fe8dc0066b0 legacy=0x7fe8dc012660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.205+0000 7fe8fad9d640 1 -- 172.21.15.12:0/1660529385 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc008aa0 con 0x7fe8dc0091f0 2023-10-21T16:26:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.235+0000 7fe8fad9d640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc0091f0 0x7fe8dc005b00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0038b0 tx=0x7fe8ec02cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9445a49a7f600e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:50.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.345+0000 7fe8fa59c640 1 -- 172.21.15.12:0/1660529385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec02d720 con 0x7fe8dc0091f0 2023-10-21T16:26:50.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.345+0000 7fe8fa59c640 1 -- 172.21.15.12:0/1660529385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec031070 con 0x7fe8dc0091f0 2023-10-21T16:26:50.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.345+0000 7fe8fa59c640 1 -- 172.21.15.12:0/1660529385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec02daa0 con 0x7fe8dc0091f0 2023-10-21T16:26:50.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.346+0000 7fe900850640 1 -- 172.21.15.12:0/1660529385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc0091f0 msgr2=0x7fe8dc005b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.346+0000 7fe900850640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc0091f0 0x7fe8dc005b00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0038b0 tx=0x7fe8ec02cb70 comp rx=0 tx=0).stop 2023-10-21T16:26:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe8fb59e640 1 -- 172.21.15.12:0/1660529385 reap_dead start 2023-10-21T16:26:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe900850640 1 -- 172.21.15.12:0/1660529385 shutdown_connections 2023-10-21T16:26:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe900850640 1 --2- 172.21.15.12:0/1660529385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc0091f0 0x7fe8dc005b00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe900850640 1 -- 172.21.15.12:0/1660529385 >> 172.21.15.12:0/1660529385 conn(0x7fe8fc06ac60 msgr2=0x7fe8fc071510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe900850640 1 -- 172.21.15.12:0/1660529385 shutdown_connections 2023-10-21T16:26:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.347+0000 7fe900850640 1 -- 172.21.15.12:0/1660529385 wait complete. 2023-10-21T16:26:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.354+0000 7fe900850640 1 Processor -- start 2023-10-21T16:26:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.354+0000 7fe900850640 1 -- start start 2023-10-21T16:26:50.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.356+0000 7fe900850640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc148ef0 0x7fe8fc1ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:50.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe900850640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe900850640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8fc1578e0 0x7fe8fc14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe900850640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc1efca0 con 0x7fe8fc1578e0 2023-10-21T16:26:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe900850640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc1ef7f0 con 0x7fe8fc148ef0 2023-10-21T16:26:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe900850640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc156c30 con 0x7fe8fc158db0 2023-10-21T16:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe8f3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.357+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc148ef0 0x7fe8fc1ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.358+0000 7fe8f3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:49590/0 (socket says 172.21.15.12:49590) 2023-10-21T16:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.358+0000 7fe8f3fff640 1 -- 172.21.15.12:0/2490556009 learned_addr learned my addr 172.21.15.12:0/2490556009 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.362+0000 7fe8f3fff640 1 -- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc148ef0 msgr2=0x7fe8fc1ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.362+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc148ef0 0x7fe8fc1ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.362+0000 7fe8f3fff640 1 -- 172.21.15.12:0/2490556009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8fc1578e0 msgr2=0x7fe8fc14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.362+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8fc1578e0 0x7fe8fc14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.362+0000 7fe8f3fff640 1 -- 172.21.15.12:0/2490556009 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec00e040 con 0x7fe8fc158db0 2023-10-21T16:26:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.367+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009b80 tx=0x7fe8e400ff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.372+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4014070 con 0x7fe8fc158db0 2023-10-21T16:26:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.372+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e400f2e0 con 0x7fe8fc158db0 2023-10-21T16:26:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.372+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400cba0 con 0x7fe8fc158db0 2023-10-21T16:26:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.372+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc156f10 con 0x7fe8fc158db0 2023-10-21T16:26:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.373+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc158280 con 0x7fe8fc158db0 2023-10-21T16:26:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.374+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc1570a0 con 0x7fe8fc158db0 2023-10-21T16:26:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.377+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe8e400cd00 con 0x7fe8fc158db0 2023-10-21T16:26:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.377+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe8e4022780 con 0x7fe8fc158db0 2023-10-21T16:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.574+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe8e400d450 con 0x7fe8fc158db0 2023-10-21T16:26:50.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:50.667+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe8fc0b4980 con 0x7fe8fc158db0 2023-10-21T16:26:50.853 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:50.851+0000 7ffb9360f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-21T16:26:50.905 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:50.903+0000 7ffb9360f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-21T16:26:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.050+0000 7fe8f37fe640 1 -- 172.21.15.12:0/2490556009 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe8e400d6e0 con 0x7fe8fc158db0 2023-10-21T16:26:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-10-21T16:26:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 msgr2=0x7fe8fc1573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009b80 tx=0x7fe8e400ff80 comp rx=0 tx=0).stop 2023-10-21T16:26:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 shutdown_connections 2023-10-21T16:26:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8fc1578e0 0x7fe8fc14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc158db0 0x7fe8fc1573a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 --2- 172.21.15.12:0/2490556009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc148ef0 0x7fe8fc1ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 >> 172.21.15.12:0/2490556009 conn(0x7fe8fc06ac60 msgr2=0x7fe8fc152090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 shutdown_connections 2023-10-21T16:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:51.052+0000 7fe900850640 1 -- 172.21.15.12:0/2490556009 wait complete. 2023-10-21T16:26:51.075 INFO:tasks.ceph:check_enable_crimson: False 2023-10-21T16:26:51.076 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-21T16:26:51.077 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:51.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-21T16:26:51.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:26:51.088 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:26:51.155 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:51.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-21T16:26:51.269 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:51.268+0000 7f8b88eda040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-21T16:26:51.293 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:51.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-21T16:26:51.339 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:51.336+0000 7f8b88eda040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-21T16:26:51.424 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:26:51.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-21T16:26:51.425 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.423+0000 7ffb9360f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-21T16:26:51.477 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.475+0000 7ffb9360f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-21T16:26:51.516 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:51.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-21T16:26:51.521 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.519+0000 7ffb9360f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-21T16:26:51.544 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:51.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-21T16:26:51.585 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.583+0000 7ffb9360f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-21T16:26:51.611 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:51.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-21T16:26:51.634 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.631+0000 7ffb9360f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-21T16:26:51.660 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-10-21T16:26:51.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-21T16:26:51.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 7575ad2a-98af-459b-8c14-52cc33d181ca 0 2023-10-21T16:26:51.758 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.756+0000 7ffb9360f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-21T16:26:51.832 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.830+0000 7ffb9360f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-21T16:26:51.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.856+0000 7fbcfae61640 1 Processor -- start 2023-10-21T16:26:51.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.856+0000 7fbcfae61640 1 -- start start 2023-10-21T16:26:51.859 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.856+0000 7fbcfae61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 0x7fbcf40c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:51.859 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcfae61640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf4151910 con 0x7fbcf40c20d0 2023-10-21T16:26:51.860 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcfae61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf4157140 con 0x7fbcf40c81f0 2023-10-21T16:26:51.860 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcfae61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf415b400 con 0x7fbcf4151530 2023-10-21T16:26:51.860 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcf8bfd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 0x7fbcf40c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:51.860 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcf3fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbcf40c81f0 0x7fbcf40c71a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51376/0 (socket says 172.21.15.99:51376) 2023-10-21T16:26:51.860 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.857+0000 7fbcf3fff640 1 -- 172.21.15.99:0/2109092203 learned_addr learned my addr 172.21.15.99:0/2109092203 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-10-21T16:26:51.862 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.860+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2109092203 >> v1:172.21.15.99:6789/0 conn(0x7fbcf40c81f0 legacy=0x7fbcf40c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.862 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.860+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2109092203 >> v1:172.21.15.12:6789/0 conn(0x7fbcf40c20d0 legacy=0x7fbcf41619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.862 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.860+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2109092203 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4157400 con 0x7fbcf4151530 2023-10-21T16:26:51.864 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.862+0000 7fbcf8bfd640 1 --2- 172.21.15.99:0/2109092203 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 0x7fbcf40c1760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097d0 tx=0x7fbce802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2365203b7aba6b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:51.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.865+0000 7fbcf37fe640 1 -- 172.21.15.99:0/2109092203 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8031890 con 0x7fbcf4151530 2023-10-21T16:26:51.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.865+0000 7fbcf37fe640 1 -- 172.21.15.99:0/2109092203 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80319f0 con 0x7fbcf4151530 2023-10-21T16:26:51.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.865+0000 7fbcf37fe640 1 -- 172.21.15.99:0/2109092203 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8031d80 con 0x7fbcf4151530 2023-10-21T16:26:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 -- 172.21.15.99:0/2109092203 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 msgr2=0x7fbcf40c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2109092203 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 0x7fbcf40c1760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097d0 tx=0x7fbce802b930 comp rx=0 tx=0).stop 2023-10-21T16:26:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 -- 172.21.15.99:0/2109092203 shutdown_connections 2023-10-21T16:26:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2109092203 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf4151530 0x7fbcf40c1760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 -- 172.21.15.99:0/2109092203 >> 172.21.15.99:0/2109092203 conn(0x7fbcf406fad0 msgr2=0x7fbcf406feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:51.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 -- 172.21.15.99:0/2109092203 shutdown_connections 2023-10-21T16:26:51.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.866+0000 7fbcfae61640 1 -- 172.21.15.99:0/2109092203 wait complete. 2023-10-21T16:26:51.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.867+0000 7fbcfae61640 1 Processor -- start 2023-10-21T16:26:51.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.867+0000 7fbcfae61640 1 -- start start 2023-10-21T16:26:51.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:51.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf40c81f0 0x7fbcf41eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf4151530 0x7fbcf4150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf41f2870 con 0x7fbcf4151530 2023-10-21T16:26:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4159380 con 0x7fbcf40c81f0 2023-10-21T16:26:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.868+0000 7fbcfae61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40ae530 con 0x7fbcf40c20d0 2023-10-21T16:26:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.869+0000 7fbcf8bfd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:51.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.869+0000 7fbcf8bfd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33748/0 (socket says 172.21.15.99:33748) 2023-10-21T16:26:51.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.869+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2690297920 learned_addr learned my addr 172.21.15.99:0/2690297920 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:51.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.870+0000 7fbcf93fe640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf4151530 0x7fbcf4150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:51.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.873+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf40c81f0 msgr2=0x7fbcf41eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.873+0000 7fbcf8bfd640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf40c81f0 0x7fbcf41eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.873+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2690297920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf4151530 msgr2=0x7fbcf4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:51.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.873+0000 7fbcf8bfd640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf4151530 0x7fbcf4150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:51.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.873+0000 7fbcf8bfd640 1 -- 172.21.15.99:0/2690297920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009400 con 0x7fbcf40c20d0 2023-10-21T16:26:51.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.875+0000 7fbcf8bfd640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:51.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.878+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8031830 con 0x7fbcf40c20d0 2023-10-21T16:26:51.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.878+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80453f0 con 0x7fbcf40c20d0 2023-10-21T16:26:51.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.878+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8045780 con 0x7fbcf40c20d0 2023-10-21T16:26:51.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.878+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf41ee5f0 con 0x7fbcf40c20d0 2023-10-21T16:26:51.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.879+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf41f22d0 con 0x7fbcf40c20d0 2023-10-21T16:26:51.882 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.880+0000 7ffb9360f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-21T16:26:51.882 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.880+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf4067560 con 0x7fbcf40c20d0 2023-10-21T16:26:51.884 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.882+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbce8045be0 con 0x7fbcf40c20d0 2023-10-21T16:26:51.884 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.882+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbce804eb80 con 0x7fbcf40c20d0 2023-10-21T16:26:51.935 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.933+0000 7ffb9360f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-21T16:26:52.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:51.981+0000 7f8b88eda040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-21T16:26:52.015 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:51.977+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbce8035020 con 0x7fbcf40c20d0 2023-10-21T16:26:52.015 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:51.980+0000 7ffb9360f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-21T16:26:52.047 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.045+0000 7f8b88eda040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-21T16:26:52.051 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.049+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7575ad2a-98af-459b-8c14-52cc33d181ca", "id": 0} v 0) v1 -- 0x7fbcf40c7d00 con 0x7fbcf40c20d0 2023-10-21T16:26:52.101 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.100+0000 7f8b88eda040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-21T16:26:52.167 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.165+0000 7f8b88eda040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-21T16:26:52.222 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.220+0000 7f8b88eda040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-21T16:26:52.346 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.345+0000 7f8b88eda040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-21T16:26:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.365+0000 7fbcf17fa640 1 -- 172.21.15.99:0/2690297920 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7575ad2a-98af-459b-8c14-52cc33d181ca", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbce804e450 con 0x7fbcf40c20d0 2023-10-21T16:26:52.368 INFO:teuthology.orchestra.run.smithi099.stdout:0 2023-10-21T16:26:52.368 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 msgr2=0x7fbcf40cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce80046c0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 shutdown_connections 2023-10-21T16:26:52.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf4151530 0x7fbcf4150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf40c81f0 0x7fbcf41eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 --2- 172.21.15.99:0/2690297920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf40c20d0 0x7fbcf40cb240 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.370 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 >> 172.21.15.99:0/2690297920 conn(0x7fbcf406fad0 msgr2=0x7fbcf40c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:52.370 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 shutdown_connections 2023-10-21T16:26:52.370 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.366+0000 7fbcfae61640 1 -- 172.21.15.99:0/2690297920 wait complete. 2023-10-21T16:26:52.375 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.373+0000 7ffb9360f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-21T16:26:52.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new aebb3aef-a029-4635-8dc6-0ba4f65e2d4d 1 2023-10-21T16:26:52.432 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.431+0000 7f8b88eda040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-21T16:26:52.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 Processor -- start 2023-10-21T16:26:52.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 -- start start 2023-10-21T16:26:52.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:52.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 0x7f5f08071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:52.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0815c870 con 0x7f5f08071ea0 2023-10-21T16:26:52.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080c2f30 con 0x7f5f0806a430 2023-10-21T16:26:52.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.476+0000 7f5f0d733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0815d6d0 con 0x7f5f0806a050 2023-10-21T16:26:52.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.477+0000 7f5efffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 0x7f5f08071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:52.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.477+0000 7f5f06ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:52.481 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.478+0000 7f5f06ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33752/0 (socket says 172.21.15.99:33752) 2023-10-21T16:26:52.481 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.478+0000 7f5f06ffd640 1 -- 172.21.15.99:0/1711430405 learned_addr learned my addr 172.21.15.99:0/1711430405 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:52.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.480+0000 7f5f06ffd640 1 -- 172.21.15.99:0/1711430405 >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 msgr2=0x7f5f08071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:52.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.480+0000 7f5f06ffd640 1 --2- 172.21.15.99:0/1711430405 >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 0x7f5f08071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.480+0000 7f5f06ffd640 1 -- 172.21.15.99:0/1711430405 >> v1:172.21.15.12:6789/0 conn(0x7f5f08071ea0 legacy=0x7f5f08159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.481+0000 7f5f06ffd640 1 -- 172.21.15.99:0/1711430405 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0815cac0 con 0x7f5f0806a050 2023-10-21T16:26:52.484 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.481+0000 7f5efffff640 1 --2- 172.21.15.99:0/1711430405 >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 0x7f5f08071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:26:52.485 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.483+0000 7f5f06ffd640 1 --2- 172.21.15.99:0/1711430405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3cfa379bac126b server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:52.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.486+0000 7f5f067fc640 1 -- 172.21.15.99:0/1711430405 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8030840 con 0x7f5f0806a050 2023-10-21T16:26:52.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.486+0000 7f5f067fc640 1 -- 172.21.15.99:0/1711430405 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef80309a0 con 0x7f5f0806a050 2023-10-21T16:26:52.489 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.486+0000 7f5f067fc640 1 -- 172.21.15.99:0/1711430405 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8030d30 con 0x7f5f0806a050 2023-10-21T16:26:52.489 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.487+0000 7f8b88eda040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-21T16:26:52.490 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 -- 172.21.15.99:0/1711430405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 msgr2=0x7f5f080c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.491 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 --2- 172.21.15.99:0/1711430405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef802b980 comp rx=0 tx=0).stop 2023-10-21T16:26:52.491 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 -- 172.21.15.99:0/1711430405 shutdown_connections 2023-10-21T16:26:52.491 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 --2- 172.21.15.99:0/1711430405 >> v2:172.21.15.99:3300/0 conn(0x7f5f0806a430 0x7f5f08071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.491 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 --2- 172.21.15.99:0/1711430405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f080c7450 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.491 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 -- 172.21.15.99:0/1711430405 >> 172.21.15.99:0/1711430405 conn(0x7f5f0806b0d0 msgr2=0x7f5f0806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:52.492 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 -- 172.21.15.99:0/1711430405 shutdown_connections 2023-10-21T16:26:52.492 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.487+0000 7f5f0d733640 1 -- 172.21.15.99:0/1711430405 wait complete. 2023-10-21T16:26:52.492 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 Processor -- start 2023-10-21T16:26:52.492 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 -- start start 2023-10-21T16:26:52.493 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:52.493 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f0806a430 0x7f5f08153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f08071ea0 0x7f5f08153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081eeed0 con 0x7f5f08071ea0 2023-10-21T16:26:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081459a0 con 0x7f5f0806a430 2023-10-21T16:26:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.489+0000 7f5f0d733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0815b820 con 0x7f5f0806a050 2023-10-21T16:26:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.490+0000 7f5efffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f0806a430 0x7f5f08153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:52.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.490+0000 7f5f06ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:52.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.490+0000 7f5f06ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33766/0 (socket says 172.21.15.99:33766) 2023-10-21T16:26:52.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.490+0000 7f5f06ffd640 1 -- 172.21.15.99:0/157175534 learned_addr learned my addr 172.21.15.99:0/157175534 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:52.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.491+0000 7f5f077fe640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f08071ea0 0x7f5f08153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.494+0000 7f5f06ffd640 1 -- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f0806a430 msgr2=0x7f5f08153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.494+0000 7f5f06ffd640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f0806a430 0x7f5f08153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.494+0000 7f5f06ffd640 1 -- 172.21.15.99:0/157175534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f08071ea0 msgr2=0x7f5f08153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.494+0000 7f5f06ffd640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f08071ea0 0x7f5f08153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.494+0000 7f5f06ffd640 1 -- 172.21.15.99:0/157175534 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef0009400 con 0x7f5f0806a050 2023-10-21T16:26:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.496+0000 7f5f06ffd640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.498+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8039c90 con 0x7f5f0806a050 2023-10-21T16:26:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.498+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef80094d0 con 0x7f5f0806a050 2023-10-21T16:26:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.498+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f081ee810 con 0x7f5f0806a050 2023-10-21T16:26:52.501 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.499+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f08067560 con 0x7f5f0806a050 2023-10-21T16:26:52.501 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.499+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8039df0 con 0x7f5f0806a050 2023-10-21T16:26:52.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.499+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef804d680 con 0x7f5f0806a050 2023-10-21T16:26:52.520 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.518+0000 7ffb9360f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-21T16:26:52.553 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.552+0000 7f8b88eda040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-21T16:26:52.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.600+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5ef804db80 con 0x7f5f0806a050 2023-10-21T16:26:52.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.600+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5ef803e070 con 0x7f5f0806a050 2023-10-21T16:26:52.603 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.600+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5ef8034070 con 0x7f5f0806a050 2023-10-21T16:26:52.610 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:52.609+0000 7f8b88eda040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-21T16:26:52.651 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.649+0000 7ffb9360f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-21T16:26:52.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.690+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aebb3aef-a029-4635-8dc6-0ba4f65e2d4d", "id": 1} v 0) v1 -- 0x7f5f080be600 con 0x7f5f0806a050 2023-10-21T16:26:52.701 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.699+0000 7ffb9360f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-21T16:26:52.819 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.817+0000 7ffb9360f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-21T16:26:52.930 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:52.928+0000 7ffb9360f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-21T16:26:52.952 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.950+0000 7f5eff7fe640 1 -- 172.21.15.99:0/157175534 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aebb3aef-a029-4635-8dc6-0ba4f65e2d4d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ef8057430 con 0x7f5f0806a050 2023-10-21T16:26:52.953 INFO:teuthology.orchestra.run.smithi099.stdout:1 2023-10-21T16:26:52.953 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 msgr2=0x7f5f08145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:52.954 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef8004730 comp rx=0 tx=0).stop 2023-10-21T16:26:52.954 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 shutdown_connections 2023-10-21T16:26:52.954 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f08071ea0 0x7f5f08153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.954 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f0806a430 0x7f5f08153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.955 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 --2- 172.21.15.99:0/157175534 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5f0806a050 0x7f5f08145460 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:52.955 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 >> 172.21.15.99:0/157175534 conn(0x7f5f0806b0d0 msgr2=0x7f5f0806ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:52.955 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 shutdown_connections 2023-10-21T16:26:52.955 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:52.951+0000 7f5f0d733640 1 -- 172.21.15.99:0/157175534 wait complete. 2023-10-21T16:26:52.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new c9ac73d3-272d-4f34-a81e-d9c3932b185c 2 2023-10-21T16:26:53.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.065+0000 7f04cc67c640 1 Processor -- start 2023-10-21T16:26:53.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.065+0000 7f04cc67c640 1 -- start start 2023-10-21T16:26:53.068 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cc67c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f04c4150da0 0x7f04c4151180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.068 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cc67c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.069 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cc67c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c41579b0 con 0x7f04c415a520 2023-10-21T16:26:53.069 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cc67c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c4157ec0 con 0x7f04c4150da0 2023-10-21T16:26:53.069 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cc67c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4071850 con 0x7f04c4070e80 2023-10-21T16:26:53.069 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.066+0000 7f04cac19640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.070 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.067+0000 7f04cac19640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33782/0 (socket says 172.21.15.99:33782) 2023-10-21T16:26:53.070 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.067+0000 7f04cac19640 1 -- 172.21.15.99:0/549603210 learned_addr learned my addr 172.21.15.99:0/549603210 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:53.070 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.067+0000 7f04ca418640 1 --2- 172.21.15.99:0/549603210 >> v2:172.21.15.99:3300/0 conn(0x7f04c4150da0 0x7f04c4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.071 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.069+0000 7f04cac19640 1 -- 172.21.15.99:0/549603210 >> v2:172.21.15.99:3300/0 conn(0x7f04c4150da0 msgr2=0x7f04c4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:53.071 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.069+0000 7f04cac19640 1 --2- 172.21.15.99:0/549603210 >> v2:172.21.15.99:3300/0 conn(0x7f04c4150da0 0x7f04c4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.071 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.069+0000 7f04cac19640 1 -- 172.21.15.99:0/549603210 >> v1:172.21.15.99:6789/0 conn(0x7f04c415a520 legacy=0x7f04c40c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:53.072 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.069+0000 7f04cac19640 1 -- 172.21.15.99:0/549603210 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4071e60 con 0x7f04c4070e80 2023-10-21T16:26:53.074 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.072+0000 7f04cac19640 1 --2- 172.21.15.99:0/549603210 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009e80 tx=0x7f04bc02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beffa42506e77473 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:53.077 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.075+0000 7f04c9416640 1 -- 172.21.15.99:0/549603210 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc02c9c0 con 0x7f04c4070e80 2023-10-21T16:26:53.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.075+0000 7f04c9416640 1 -- 172.21.15.99:0/549603210 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc02cb20 con 0x7f04c4070e80 2023-10-21T16:26:53.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04c9416640 1 -- 172.21.15.99:0/549603210 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0343f0 con 0x7f04c4070e80 2023-10-21T16:26:53.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 -- 172.21.15.99:0/549603210 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 msgr2=0x7f04c40c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 --2- 172.21.15.99:0/549603210 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009e80 tx=0x7f04bc02be20 comp rx=0 tx=0).stop 2023-10-21T16:26:53.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 -- 172.21.15.99:0/549603210 shutdown_connections 2023-10-21T16:26:53.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 --2- 172.21.15.99:0/549603210 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4070e80 0x7f04c40c4ca0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 --2- 172.21.15.99:0/549603210 >> v2:172.21.15.99:3300/0 conn(0x7f04c4150da0 0x7f04c4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 -- 172.21.15.99:0/549603210 >> 172.21.15.99:0/549603210 conn(0x7f04c406b0d0 msgr2=0x7f04c406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:53.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 -- 172.21.15.99:0/549603210 shutdown_connections 2023-10-21T16:26:53.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.076+0000 7f04cc67c640 1 -- 172.21.15.99:0/549603210 wait complete. 2023-10-21T16:26:53.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 Processor -- start 2023-10-21T16:26:53.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 -- start start 2023-10-21T16:26:53.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c4070e80 0x7f04c4156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 0x7f04c414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40bed80 con 0x7f04c4070e80 2023-10-21T16:26:53.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40cb460 con 0x7f04c415a520 2023-10-21T16:26:53.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.078+0000 7f04cc67c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40c95a0 con 0x7f04c4150da0 2023-10-21T16:26:53.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.079+0000 7f04c9c17640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.079+0000 7f04cac19640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 0x7f04c414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.079+0000 7f04c9c17640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33796/0 (socket says 172.21.15.99:33796) 2023-10-21T16:26:53.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.079+0000 7f04c9c17640 1 -- 172.21.15.99:0/4279934909 learned_addr learned my addr 172.21.15.99:0/4279934909 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:53.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.080+0000 7f04ca418640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c4070e80 0x7f04c4156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04c9c17640 1 -- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 msgr2=0x7f04c414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04c9c17640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 0x7f04c414e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04c9c17640 1 -- 172.21.15.99:0/4279934909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c4070e80 msgr2=0x7f04c4156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.086 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04c9c17640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c4070e80 0x7f04c4156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.086 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04c9c17640 1 -- 172.21.15.99:0/4279934909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009b30 con 0x7f04c4150da0 2023-10-21T16:26:53.086 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.083+0000 7f04cac19640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 0x7f04c414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:26:53.086 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:53.083+0000 7ffb9360f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-21T16:26:53.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.085+0000 7f04c9c17640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c410 tx=0x7f04b400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:53.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.088+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40035f0 con 0x7f04c4150da0 2023-10-21T16:26:53.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.088+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4003750 con 0x7f04c4150da0 2023-10-21T16:26:53.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.088+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c40cb180 con 0x7f04c4150da0 2023-10-21T16:26:53.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.088+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4003b40 con 0x7f04c4150da0 2023-10-21T16:26:53.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.088+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4150890 con 0x7f04c4150da0 2023-10-21T16:26:53.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.089+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c40c9a80 con 0x7f04c4150da0 2023-10-21T16:26:53.098 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.096+0000 7f8b88eda040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-21T16:26:53.130 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:53.128+0000 7ffb9360f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-21T16:26:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.187+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04b401c440 con 0x7f04c4150da0 2023-10-21T16:26:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.187+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f04b401b7d0 con 0x7f04c4150da0 2023-10-21T16:26:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.188+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f04c40c9a80 con 0x7f04c4150da0 2023-10-21T16:26:53.262 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.260+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9ac73d3-272d-4f34-a81e-d9c3932b185c", "id": 2} v 0) v1 -- 0x7f04c4067560 con 0x7f04c4150da0 2023-10-21T16:26:53.266 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.264+0000 7f8b88eda040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-21T16:26:53.277 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:53.274+0000 7ffb9360f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-21T16:26:53.415 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.413+0000 7f8b88eda040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-21T16:26:53.472 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.470+0000 7f8b88eda040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-21T16:26:53.477 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.475+0000 7f04baffd640 1 -- 172.21.15.99:0/4279934909 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9ac73d3-272d-4f34-a81e-d9c3932b185c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04b4017070 con 0x7f04c4150da0 2023-10-21T16:26:53.477 INFO:teuthology.orchestra.run.smithi099.stdout:2 2023-10-21T16:26:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 msgr2=0x7f04c41566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c410 tx=0x7f04b400c8d0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 shutdown_connections 2023-10-21T16:26:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c415a520 0x7f04c414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c4150da0 0x7f04c41566b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 --2- 172.21.15.99:0/4279934909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c4070e80 0x7f04c4156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 >> 172.21.15.99:0/4279934909 conn(0x7f04c406b0d0 msgr2=0x7f04c40c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:53.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 shutdown_connections 2023-10-21T16:26:53.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.476+0000 7f04cc67c640 1 -- 172.21.15.99:0/4279934909 wait complete. 2023-10-21T16:26:53.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 37a14876-5214-46f1-9297-6343b877e3b0 3 2023-10-21T16:26:53.586 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.585+0000 7f8b88eda040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-21T16:26:53.587 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.585+0000 7f5e4191d640 1 Processor -- start 2023-10-21T16:26:53.588 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.585+0000 7f5e4191d640 1 -- start start 2023-10-21T16:26:53.589 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.586+0000 7f5e4191d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e3c0c55c0 0x7f5e3c150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.589 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.586+0000 7f5e4191d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0c7150 con 0x7f5e3c0cb910 2023-10-21T16:26:53.589 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.586+0000 7f5e4191d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0c7870 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.589 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.586+0000 7f5e4191d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c071900 con 0x7f5e3c0c55c0 2023-10-21T16:26:53.590 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.587+0000 7f5e3a7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5e3c0cbcf0 0x7f5e3c14fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51388/0 (socket says 172.21.15.99:51388) 2023-10-21T16:26:53.590 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.587+0000 7f5e3a7fc640 1 -- 172.21.15.99:0/3798817657 learned_addr learned my addr 172.21.15.99:0/3798817657 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-10-21T16:26:53.590 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.588+0000 7f5e3b7fe640 1 --2- 172.21.15.99:0/3798817657 >> v2:172.21.15.12:3300/0 conn(0x7f5e3c0c55c0 0x7f5e3c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.589+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567737161 0 0) 0x7f5e3c0c7870 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.589+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e24003520 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374573020 0 0) 0x7f5e24003520 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 >> v2:172.21.15.12:3300/0 conn(0x7f5e3c0c55c0 msgr2=0x7f5e3c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:53.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 --2- 172.21.15.99:0/3798817657 >> v2:172.21.15.12:3300/0 conn(0x7f5e3c0c55c0 0x7f5e3c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 >> v1:172.21.15.12:6789/0 conn(0x7f5e3c0cb910 legacy=0x7f5e3c0c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c071be0 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f5e2c001670 con 0x7f5e3c0cbcf0 2023-10-21T16:26:53.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 >> v1:172.21.15.99:6789/0 conn(0x7f5e3c0cbcf0 legacy=0x7f5e3c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e24003aa0 0x7f5e24003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 0x7f5e24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240052a0 0x7f5e2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c071900 con 0x7f5e240052a0 2023-10-21T16:26:53.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2400c150 con 0x7f5e24003aa0 2023-10-21T16:26:53.601 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.595+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2400c310 con 0x7f5e240047c0 2023-10-21T16:26:53.601 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.596+0000 7f5e3a7fc640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 0x7f5e24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.601 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3a7fc640 1 -- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e24003aa0 msgr2=0x7f5e24003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:53.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3a7fc640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e24003aa0 0x7f5e24003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3a7fc640 1 -- 172.21.15.99:0/3798817657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240052a0 msgr2=0x7f5e2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:53.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3a7fc640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240052a0 0x7f5e2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3a7fc640 1 -- 172.21.15.99:0/3798817657 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24003520 con 0x7f5e240047c0 2023-10-21T16:26:53.602 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.599+0000 7f5e3b7fe640 1 -- 172.21.15.99:0/3798817657 reap_dead start 2023-10-21T16:26:53.603 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.601+0000 7f5e3a7fc640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 0x7f5e24004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007bc0 tx=0x7f5e240057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6512f59ceb2bc4a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:53.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c02ebd0 con 0x7f5e240047c0 2023-10-21T16:26:53.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c02ed50 con 0x7f5e240047c0 2023-10-21T16:26:53.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e39ffb640 1 -- 172.21.15.99:0/3798817657 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c005b10 con 0x7f5e240047c0 2023-10-21T16:26:53.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 -- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 msgr2=0x7f5e24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.609 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 0x7f5e24004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007bc0 tx=0x7f5e240057f0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.609 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 -- 172.21.15.99:0/3798817657 shutdown_connections 2023-10-21T16:26:53.609 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 --2- 172.21.15.99:0/3798817657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e240047c0 0x7f5e24004c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.609 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 -- 172.21.15.99:0/3798817657 >> 172.21.15.99:0/3798817657 conn(0x7f5e3c06aef0 msgr2=0x7f5e3c06b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:53.609 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 -- 172.21.15.99:0/3798817657 shutdown_connections 2023-10-21T16:26:53.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.605+0000 7f5e4191d640 1 -- 172.21.15.99:0/3798817657 wait complete. 2023-10-21T16:26:53.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.607+0000 7f5e4191d640 1 Processor -- start 2023-10-21T16:26:53.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.607+0000 7f5e4191d640 1 -- start start 2023-10-21T16:26:53.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.607+0000 7f5e4191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240047c0 0x7f5e3c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.607+0000 7f5e4191d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e3c1f2980 0x7f5e3c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e4191d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:53.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e4191d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c151770 con 0x7f5e240047c0 2023-10-21T16:26:53.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e4191d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1f1cb0 con 0x7f5e3c1542d0 2023-10-21T16:26:53.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e4191d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c155120 con 0x7f5e3c1f2980 2023-10-21T16:26:53.613 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.613 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52082/0 (socket says 172.21.15.99:52082) 2023-10-21T16:26:53.613 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.608+0000 7f5e3b7fe640 1 -- 172.21.15.99:0/261161937 learned_addr learned my addr 172.21.15.99:0/261161937 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:53.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.610+0000 7f5e3a7fc640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e3c1f2980 0x7f5e3c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:53.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.612+0000 7f5e3b7fe640 1 -- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e3c1f2980 msgr2=0x7f5e3c14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.612+0000 7f5e3b7fe640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e3c1f2980 0x7f5e3c14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.612+0000 7f5e3b7fe640 1 -- 172.21.15.99:0/261161937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240047c0 msgr2=0x7f5e3c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:53.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.612+0000 7f5e3b7fe640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240047c0 0x7f5e3c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:53.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.612+0000 7f5e3b7fe640 1 -- 172.21.15.99:0/261161937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c154b60 con 0x7f5e3c1542d0 2023-10-21T16:26:53.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.614+0000 7f5e3b7fe640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0bf460 tx=0x7f5e3400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:53.618 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.616+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34010040 con 0x7f5e3c1542d0 2023-10-21T16:26:53.618 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.616+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c154e40 con 0x7f5e3c1542d0 2023-10-21T16:26:53.619 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.616+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c1f2180 con 0x7f5e3c1542d0 2023-10-21T16:26:53.619 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.618+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c072460 con 0x7f5e3c1542d0 2023-10-21T16:26:53.703 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.701+0000 7f8b88eda040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-21T16:26:53.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.814+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400ba50 con 0x7f5e3c1542d0 2023-10-21T16:26:53.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.814+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bdc0 con 0x7f5e3c1542d0 2023-10-21T16:26:53.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.814+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e34003cd0 con 0x7f5e3c1542d0 2023-10-21T16:26:53.817 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.814+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5e3401d890 con 0x7f5e3c1542d0 2023-10-21T16:26:53.817 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.814+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5e34018020 con 0x7f5e3c1542d0 2023-10-21T16:26:53.872 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.870+0000 7f8b88eda040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-21T16:26:53.911 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:53.909+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37a14876-5214-46f1-9297-6343b877e3b0", "id": 3} v 0) v1 -- 0x7f5e3c146b30 con 0x7f5e3c1542d0 2023-10-21T16:26:53.926 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:53.925+0000 7f8b88eda040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-21T16:26:54.099 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:54.097+0000 7f8b88eda040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-21T16:26:54.124 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.122+0000 7f5e23fff640 1 -- 172.21.15.99:0/261161937 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37a14876-5214-46f1-9297-6343b877e3b0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e3402b0b0 con 0x7f5e3c1542d0 2023-10-21T16:26:54.125 INFO:teuthology.orchestra.run.smithi099.stdout:3 2023-10-21T16:26:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 msgr2=0x7f5e3c14ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0bf460 tx=0x7f5e3400eea0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 shutdown_connections 2023-10-21T16:26:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e3c1542d0 0x7f5e3c14ba00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.127 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e3c1f2980 0x7f5e3c14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.127 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 --2- 172.21.15.99:0/261161937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240047c0 0x7f5e3c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.127 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.123+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 >> 172.21.15.99:0/261161937 conn(0x7f5e3c06aef0 msgr2=0x7f5e3c0c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:54.127 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.124+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 shutdown_connections 2023-10-21T16:26:54.127 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.124+0000 7f5e4191d640 1 -- 172.21.15.99:0/261161937 wait complete. 2023-10-21T16:26:54.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new f1664a67-35e2-4203-adc3-a2bd755cea53 4 2023-10-21T16:26:54.137 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:54.134+0000 7ffb9360f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-21T16:26:54.236 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.234+0000 7f2c2a533640 1 Processor -- start 2023-10-21T16:26:54.237 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.234+0000 7f2c2a533640 1 -- start start 2023-10-21T16:26:54.237 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.235+0000 7f2c2a533640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 0x7f2c2415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.235+0000 7f2c2a533640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c240c7d20 0x7f2c2415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.235+0000 7f2c2a533640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240c8d80 con 0x7f2c241512f0 2023-10-21T16:26:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.235+0000 7f2c2a533640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240c9ee0 con 0x7f2c240c7d20 2023-10-21T16:26:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.235+0000 7f2c2a533640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240c7650 con 0x7f2c240c68a0 2023-10-21T16:26:54.239 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.236+0000 7f2c237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 0x7f2c2415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.239 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.236+0000 7f2c23fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2c241512f0 0x7f2c240cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51392/0 (socket says 172.21.15.99:51392) 2023-10-21T16:26:54.239 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.236+0000 7f2c23fff640 1 -- 172.21.15.99:0/547651102 learned_addr learned my addr 172.21.15.99:0/547651102 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-10-21T16:26:54.240 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.237+0000 7f2c28ad0640 1 --2- 172.21.15.99:0/547651102 >> v2:172.21.15.12:3300/0 conn(0x7f2c240c7d20 0x7f2c2415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.240 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.238+0000 7f2c237fe640 1 -- 172.21.15.99:0/547651102 >> v2:172.21.15.12:3300/0 conn(0x7f2c240c7d20 msgr2=0x7f2c2415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.238+0000 7f2c237fe640 1 --2- 172.21.15.99:0/547651102 >> v2:172.21.15.12:3300/0 conn(0x7f2c240c7d20 0x7f2c2415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.238+0000 7f2c237fe640 1 -- 172.21.15.99:0/547651102 >> v1:172.21.15.99:6789/0 conn(0x7f2c241512f0 legacy=0x7f2c240cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.238+0000 7f2c237fe640 1 -- 172.21.15.99:0/547651102 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c241516d0 con 0x7f2c240c68a0 2023-10-21T16:26:54.242 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.240+0000 7f2c237fe640 1 --2- 172.21.15.99:0/547651102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 0x7f2c2415a600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c140097a0 tx=0x7f2c1402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965e42ac335ff126 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c22ffd640 1 -- 172.21.15.99:0/547651102 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1402e070 con 0x7f2c240c68a0 2023-10-21T16:26:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c22ffd640 1 -- 172.21.15.99:0/547651102 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140315a0 con 0x7f2c240c68a0 2023-10-21T16:26:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c22ffd640 1 -- 172.21.15.99:0/547651102 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14031930 con 0x7f2c240c68a0 2023-10-21T16:26:54.247 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 -- 172.21.15.99:0/547651102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 msgr2=0x7f2c2415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.247 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 --2- 172.21.15.99:0/547651102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 0x7f2c2415a600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c140097a0 tx=0x7f2c1402b840 comp rx=0 tx=0).stop 2023-10-21T16:26:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 -- 172.21.15.99:0/547651102 shutdown_connections 2023-10-21T16:26:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 --2- 172.21.15.99:0/547651102 >> v2:172.21.15.12:3300/0 conn(0x7f2c240c7d20 0x7f2c2415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 --2- 172.21.15.99:0/547651102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c68a0 0x7f2c2415a600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 -- 172.21.15.99:0/547651102 >> 172.21.15.99:0/547651102 conn(0x7f2c2406e020 msgr2=0x7f2c2406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 -- 172.21.15.99:0/547651102 shutdown_connections 2023-10-21T16:26:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.244+0000 7f2c2a533640 1 -- 172.21.15.99:0/547651102 wait complete. 2023-10-21T16:26:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.246+0000 7f2c2a533640 1 Processor -- start 2023-10-21T16:26:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.246+0000 7f2c2a533640 1 -- start start 2023-10-21T16:26:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c240c68a0 0x7f2c24159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c241512f0 0x7f2c241ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24148aa0 con 0x7f2c240c68a0 2023-10-21T16:26:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24148270 con 0x7f2c241512f0 2023-10-21T16:26:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c2a533640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2414a410 con 0x7f2c240c7d20 2023-10-21T16:26:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.247+0000 7f2c28ad0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c241512f0 0x7f2c241ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.248+0000 7f2c237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33834/0 (socket says 172.21.15.99:33834) 2023-10-21T16:26:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.248+0000 7f2c237fe640 1 -- 172.21.15.99:0/3958978616 learned_addr learned my addr 172.21.15.99:0/3958978616 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:54.253 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.249+0000 7f2c23fff640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c240c68a0 0x7f2c24159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.253 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.251+0000 7f2c237fe640 1 -- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c241512f0 msgr2=0x7f2c241ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.253 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.251+0000 7f2c237fe640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c241512f0 0x7f2c241ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.251+0000 7f2c237fe640 1 -- 172.21.15.99:0/3958978616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c240c68a0 msgr2=0x7f2c24159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.251+0000 7f2c237fe640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c240c68a0 0x7f2c24159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.251+0000 7f2c237fe640 1 -- 172.21.15.99:0/3958978616 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14009400 con 0x7f2c240c7d20 2023-10-21T16:26:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.253+0000 7f2c237fe640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c140098c0 tx=0x7f2c140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.256+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14032900 con 0x7f2c240c7d20 2023-10-21T16:26:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.256+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14032a80 con 0x7f2c240c7d20 2023-10-21T16:26:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.256+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14032e30 con 0x7f2c240c7d20 2023-10-21T16:26:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.256+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c241484e0 con 0x7f2c240c7d20 2023-10-21T16:26:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.256+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240cb680 con 0x7f2c240c7d20 2023-10-21T16:26:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.257+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c24067560 con 0x7f2c240c7d20 2023-10-21T16:26:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.260+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c1404e730 con 0x7f2c240c7d20 2023-10-21T16:26:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.260+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2c1403b900 con 0x7f2c240c7d20 2023-10-21T16:26:54.359 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.357+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2c1403b3f0 con 0x7f2c240c7d20 2023-10-21T16:26:54.425 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:54.423+0000 7ffb9360f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-21T16:26:54.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.429+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f1664a67-35e2-4203-adc3-a2bd755cea53", "id": 4} v 0) v1 -- 0x7f2c240c7b00 con 0x7f2c240c7d20 2023-10-21T16:26:54.479 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:54.477+0000 7ffb9360f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-21T16:26:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.556+0000 7f2c20ff9640 1 -- 172.21.15.99:0/3958978616 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1664a67-35e2-4203-adc3-a2bd755cea53", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2c1403b640 con 0x7f2c240c7d20 2023-10-21T16:26:54.558 INFO:teuthology.orchestra.run.smithi099.stdout:4 2023-10-21T16:26:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.556+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 msgr2=0x7f2c241edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.556+0000 7f2c2a533640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c140098c0 tx=0x7f2c140046c0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 shutdown_connections 2023-10-21T16:26:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c241512f0 0x7f2c241ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c240c7d20 0x7f2c241edbd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 --2- 172.21.15.99:0/3958978616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c240c68a0 0x7f2c24159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 >> 172.21.15.99:0/3958978616 conn(0x7f2c2406e020 msgr2=0x7f2c241505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 shutdown_connections 2023-10-21T16:26:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.557+0000 7f2c2a533640 1 -- 172.21.15.99:0/3958978616 wait complete. 2023-10-21T16:26:54.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 760f1bc6-c39e-46f1-963f-e13af4e31d0d 5 2023-10-21T16:26:54.588 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:54.586+0000 7ffb9360f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-21T16:26:54.667 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.665+0000 7f1f27ad7640 1 Processor -- start 2023-10-21T16:26:54.669 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.665+0000 7f1f27ad7640 1 -- start start 2023-10-21T16:26:54.670 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.666+0000 7f1f27ad7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 0x7f1f200c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.670 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.666+0000 7f1f27ad7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f200ca2f0 con 0x7f1f20159c10 2023-10-21T16:26:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.666+0000 7f1f27ad7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2015c810 con 0x7f1f200c39f0 2023-10-21T16:26:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.666+0000 7f1f27ad7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015d490 con 0x7f1f20153610 2023-10-21T16:26:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.667+0000 7f1f26074640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1f200c39f0 0x7f1f200c3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51396/0 (socket says 172.21.15.99:51396) 2023-10-21T16:26:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.667+0000 7f1f26074640 1 -- 172.21.15.99:0/2340305618 learned_addr learned my addr 172.21.15.99:0/2340305618 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-10-21T16:26:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.667+0000 7f1f25873640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 0x7f1f200c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.669+0000 7f1f25873640 1 -- 172.21.15.99:0/2340305618 >> v1:172.21.15.99:6789/0 conn(0x7f1f200c39f0 legacy=0x7f1f200c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.669+0000 7f1f25873640 1 -- 172.21.15.99:0/2340305618 >> v1:172.21.15.12:6789/0 conn(0x7f1f20159c10 legacy=0x7f1f200ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:54.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.669+0000 7f1f25873640 1 -- 172.21.15.99:0/2340305618 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2015caf0 con 0x7f1f20153610 2023-10-21T16:26:54.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.671+0000 7f1f25873640 1 --2- 172.21.15.99:0/2340305618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 0x7f1f200c9bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009dc0 tx=0x7f1f1c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77092d321af3358 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:54.676 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.674+0000 7f1f24871640 1 -- 172.21.15.99:0/2340305618 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c02cc40 con 0x7f1f20153610 2023-10-21T16:26:54.676 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.674+0000 7f1f24871640 1 -- 172.21.15.99:0/2340305618 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c02cda0 con 0x7f1f20153610 2023-10-21T16:26:54.677 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.674+0000 7f1f24871640 1 -- 172.21.15.99:0/2340305618 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c034660 con 0x7f1f20153610 2023-10-21T16:26:54.677 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2340305618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 msgr2=0x7f1f200c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.678 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2340305618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 0x7f1f200c9bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009dc0 tx=0x7f1f1c02be90 comp rx=0 tx=0).stop 2023-10-21T16:26:54.678 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2340305618 shutdown_connections 2023-10-21T16:26:54.678 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2340305618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f20153610 0x7f1f200c9bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.678 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2340305618 >> 172.21.15.99:0/2340305618 conn(0x7f1f2006add0 msgr2=0x7f1f2006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:54.679 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2340305618 shutdown_connections 2023-10-21T16:26:54.679 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.675+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2340305618 wait complete. 2023-10-21T16:26:54.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.676+0000 7f1f27ad7640 1 Processor -- start 2023-10-21T16:26:54.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.676+0000 7f1f27ad7640 1 -- start start 2023-10-21T16:26:54.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f200c39f0 0x7f1f201f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f20153610 0x7f1f20158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:54.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f200ca110 con 0x7f1f20153610 2023-10-21T16:26:54.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f201e33b0 con 0x7f1f20159c10 2023-10-21T16:26:54.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f27ad7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f201ef220 con 0x7f1f200c39f0 2023-10-21T16:26:54.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.677+0000 7f1f26074640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.678+0000 7f1f25873640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f200c39f0 0x7f1f201f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:54.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.678+0000 7f1f26074640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52112/0 (socket says 172.21.15.99:52112) 2023-10-21T16:26:54.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.678+0000 7f1f26074640 1 -- 172.21.15.99:0/2029934360 learned_addr learned my addr 172.21.15.99:0/2029934360 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:54.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.681+0000 7f1f26074640 1 -- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f200c39f0 msgr2=0x7f1f201f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.681+0000 7f1f26074640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f200c39f0 0x7f1f201f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.681+0000 7f1f26074640 1 -- 172.21.15.99:0/2029934360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f20153610 msgr2=0x7f1f20158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:54.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.681+0000 7f1f26074640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f20153610 0x7f1f20158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:54.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.681+0000 7f1f26074640 1 -- 172.21.15.99:0/2029934360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c009a70 con 0x7f1f20159c10 2023-10-21T16:26:54.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.683+0000 7f1f26074640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c420 tx=0x7f1f1800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:54.689 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.687+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18005ce0 con 0x7f1f20159c10 2023-10-21T16:26:54.690 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.687+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18005e40 con 0x7f1f20159c10 2023-10-21T16:26:54.690 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.687+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180072d0 con 0x7f1f20159c10 2023-10-21T16:26:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.687+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f200b40b0 con 0x7f1f20159c10 2023-10-21T16:26:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.687+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f200b4670 con 0x7f1f20159c10 2023-10-21T16:26:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.688+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2015d090 con 0x7f1f20159c10 2023-10-21T16:26:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.783+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f1801c440 con 0x7f1f20159c10 2023-10-21T16:26:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.783+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1f180129c0 con 0x7f1f20159c10 2023-10-21T16:26:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.784+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1f2015d090 con 0x7f1f20159c10 2023-10-21T16:26:54.854 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:54.852+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "760f1bc6-c39e-46f1-963f-e13af4e31d0d", "id": 5} v 0) v1 -- 0x7f1f20067560 con 0x7f1f20159c10 2023-10-21T16:26:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:55.219+0000 7f8b88eda040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-21T16:26:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.228+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f1f18012400 con 0x7f1f20159c10 2023-10-21T16:26:55.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.493+0000 7f1f167fc640 1 -- 172.21.15.99:0/2029934360 <== mon.1 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "760f1bc6-c39e-46f1-963f-e13af4e31d0d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f18010d60 con 0x7f1f20159c10 2023-10-21T16:26:55.495 INFO:teuthology.orchestra.run.smithi099.stdout:5 2023-10-21T16:26:55.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 msgr2=0x7f1f201eece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c420 tx=0x7f1f1800c8e0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 shutdown_connections 2023-10-21T16:26:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f20159c10 0x7f1f201eece0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f20153610 0x7f1f20158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 --2- 172.21.15.99:0/2029934360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f200c39f0 0x7f1f201f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 >> 172.21.15.99:0/2029934360 conn(0x7f1f2006add0 msgr2=0x7f1f20066200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 shutdown_connections 2023-10-21T16:26:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.494+0000 7f1f27ad7640 1 -- 172.21.15.99:0/2029934360 wait complete. 2023-10-21T16:26:55.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 473b4fb5-cf27-4ab6-b827-519fb7726953 6 2023-10-21T16:26:55.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:55.572+0000 7f8b88eda040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-21T16:26:55.640 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:55.638+0000 7f8b88eda040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-21T16:26:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.651+0000 7febe0ba9640 1 Processor -- start 2023-10-21T16:26:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.651+0000 7febe0ba9640 1 -- start start 2023-10-21T16:26:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7febdc06b060 0x7febdc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7febdc0bfec0 0x7febdc156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc157050 con 0x7febdc06b060 2023-10-21T16:26:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc071e60 con 0x7febdc0bfec0 2023-10-21T16:26:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.652+0000 7febe0ba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc072390 con 0x7febdc06b440 2023-10-21T16:26:55.663 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.661+0000 7febdad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:55.664 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.662+0000 7febdad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33912/0 (socket says 172.21.15.99:33912) 2023-10-21T16:26:55.664 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.662+0000 7febdad9d640 1 -- 172.21.15.99:0/2510513892 learned_addr learned my addr 172.21.15.99:0/2510513892 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:55.666 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.664+0000 7febdad9d640 1 -- 172.21.15.99:0/2510513892 >> v2:172.21.15.99:3300/0 conn(0x7febdc0bfec0 msgr2=0x7febdc156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:55.666 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.664+0000 7febdad9d640 1 --2- 172.21.15.99:0/2510513892 >> v2:172.21.15.99:3300/0 conn(0x7febdc0bfec0 0x7febdc156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.666 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.664+0000 7febdad9d640 1 -- 172.21.15.99:0/2510513892 >> v2:172.21.15.12:3300/0 conn(0x7febdc06b060 msgr2=0x7febdc06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:55.666 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.664+0000 7febdad9d640 1 --2- 172.21.15.99:0/2510513892 >> v2:172.21.15.12:3300/0 conn(0x7febdc06b060 0x7febdc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.667 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.664+0000 7febdad9d640 1 -- 172.21.15.99:0/2510513892 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0c7550 con 0x7febdc06b440 2023-10-21T16:26:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.670+0000 7febdad9d640 1 --2- 172.21.15.99:0/2510513892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febdc072d50 tx=0x7febd402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105646305edb6dee server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:55.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febd9d9b640 1 -- 172.21.15.99:0/2510513892 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd402c9e0 con 0x7febdc06b440 2023-10-21T16:26:55.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febd9d9b640 1 -- 172.21.15.99:0/2510513892 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd402cb40 con 0x7febdc06b440 2023-10-21T16:26:55.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febd9d9b640 1 -- 172.21.15.99:0/2510513892 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40343f0 con 0x7febdc06b440 2023-10-21T16:26:55.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 -- 172.21.15.99:0/2510513892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 msgr2=0x7febdc065bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:55.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 --2- 172.21.15.99:0/2510513892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febdc072d50 tx=0x7febd402be40 comp rx=0 tx=0).stop 2023-10-21T16:26:55.682 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 -- 172.21.15.99:0/2510513892 shutdown_connections 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 --2- 172.21.15.99:0/2510513892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b440 0x7febdc065bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 --2- 172.21.15.99:0/2510513892 >> v2:172.21.15.99:3300/0 conn(0x7febdc0bfec0 0x7febdc156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 --2- 172.21.15.99:0/2510513892 >> v2:172.21.15.12:3300/0 conn(0x7febdc06b060 0x7febdc06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 -- 172.21.15.99:0/2510513892 >> 172.21.15.99:0/2510513892 conn(0x7febdc06c450 msgr2=0x7febdc06c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 -- 172.21.15.99:0/2510513892 shutdown_connections 2023-10-21T16:26:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.679+0000 7febe0ba9640 1 -- 172.21.15.99:0/2510513892 wait complete. 2023-10-21T16:26:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 Processor -- start 2023-10-21T16:26:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 -- start start 2023-10-21T16:26:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febdc06b440 0x7febdc1f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febdc0bfec0 0x7febdc144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc150c10 con 0x7febdc06b440 2023-10-21T16:26:55.686 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0c5200 con 0x7febdc0bfec0 2023-10-21T16:26:55.686 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.681+0000 7febe0ba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0c4960 con 0x7febdc06b060 2023-10-21T16:26:55.687 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.685+0000 7febda59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:55.690 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.686+0000 7febda59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:33932/0 (socket says 172.21.15.99:33932) 2023-10-21T16:26:55.690 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.686+0000 7febda59c640 1 -- 172.21.15.99:0/3002269295 learned_addr learned my addr 172.21.15.99:0/3002269295 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:55.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.689+0000 7febda59c640 1 -- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febdc0bfec0 msgr2=0x7febdc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:55.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.689+0000 7febda59c640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febdc0bfec0 0x7febdc144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.689+0000 7febda59c640 1 -- 172.21.15.99:0/3002269295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febdc06b440 msgr2=0x7febdc1f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:55.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.690+0000 7febda59c640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febdc06b440 0x7febdc1f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:55.692 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.690+0000 7febda59c640 1 -- 172.21.15.99:0/3002269295 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009b30 con 0x7febdc06b060 2023-10-21T16:26:55.697 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.695+0000 7febda59c640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b410 tx=0x7febcc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.705+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011830 con 0x7febdc06b060 2023-10-21T16:26:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.705+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0119b0 con 0x7febdc06b060 2023-10-21T16:26:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.705+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011d60 con 0x7febdc06b060 2023-10-21T16:26:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.705+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc0c4c40 con 0x7febdc06b060 2023-10-21T16:26:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.706+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc1f2260 con 0x7febdc06b060 2023-10-21T16:26:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.706+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc067560 con 0x7febdc06b060 2023-10-21T16:26:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.726+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7febcc01a400 con 0x7febdc06b060 2023-10-21T16:26:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.727+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7febcc00f2e0 con 0x7febdc06b060 2023-10-21T16:26:55.763 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-21T16:26:55.761+0000 7f8b88eda040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-21T16:26:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.822+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7febcc0233e0 con 0x7febdc06b060 2023-10-21T16:26:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:55.891+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "473b4fb5-cf27-4ab6-b827-519fb7726953", "id": 6} v 0) v1 -- 0x7febdc0b0530 con 0x7febdc06b060 2023-10-21T16:26:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.318+0000 7febd2ffd640 1 -- 172.21.15.99:0/3002269295 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "473b4fb5-cf27-4ab6-b827-519fb7726953", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7febcc028020 con 0x7febdc06b060 2023-10-21T16:26:56.321 INFO:teuthology.orchestra.run.smithi099.stdout:6 2023-10-21T16:26:56.322 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 msgr2=0x7febdc0c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:56.322 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b410 tx=0x7febcc00b8d0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.322 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 shutdown_connections 2023-10-21T16:26:56.323 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febdc0bfec0 0x7febdc144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.323 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febdc06b440 0x7febdc1f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.323 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 --2- 172.21.15.99:0/3002269295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febdc06b060 0x7febdc0c4320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.323 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 >> 172.21.15.99:0/3002269295 conn(0x7febdc06c450 msgr2=0x7febdc0c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:56.323 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 shutdown_connections 2023-10-21T16:26:56.324 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.319+0000 7febe0ba9640 1 -- 172.21.15.99:0/3002269295 wait complete. 2023-10-21T16:26:56.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 4c75a210-8336-4730-a63a-a2d8afc4d4b0 7 2023-10-21T16:26:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.431+0000 7f4585d08640 1 Processor -- start 2023-10-21T16:26:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.431+0000 7f4585d08640 1 -- start start 2023-10-21T16:26:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.432+0000 7f4585d08640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f458015a030 0x7f45800c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.432+0000 7f4585d08640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f458006c310 0x7f458006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.432+0000 7f4585d08640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458015a410 con 0x7f45800c3b20 2023-10-21T16:26:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.432+0000 7f4585d08640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800c7750 con 0x7f458015a030 2023-10-21T16:26:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.432+0000 7f4585d08640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458015c900 con 0x7f458006c310 2023-10-21T16:26:56.445 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.443+0000 7f457ffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45800c3b20 0x7f45800c7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51402/0 (socket says 172.21.15.99:51402) 2023-10-21T16:26:56.445 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.443+0000 7f457ffff640 1 -- 172.21.15.99:0/554708001 learned_addr learned my addr 172.21.15.99:0/554708001 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-10-21T16:26:56.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.460+0000 7f457effd640 1 --2- 172.21.15.99:0/554708001 >> v2:172.21.15.99:3300/0 conn(0x7f458006c310 0x7f458006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:56.463 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.461+0000 7f457e7fc640 1 -- 172.21.15.99:0/554708001 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582297452 0 0) 0x7f458015a410 con 0x7f45800c3b20 2023-10-21T16:26:56.463 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.461+0000 7f457e7fc640 1 -- 172.21.15.99:0/554708001 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568003520 con 0x7f45800c3b20 2023-10-21T16:26:56.465 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.463+0000 7f457effd640 1 -- 172.21.15.99:0/554708001 >> v2:172.21.15.12:3300/0 conn(0x7f458015a030 msgr2=0x7f45800c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:56.465 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.463+0000 7f457effd640 1 --2- 172.21.15.99:0/554708001 >> v2:172.21.15.12:3300/0 conn(0x7f458015a030 0x7f45800c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.465 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.463+0000 7f457effd640 1 -- 172.21.15.99:0/554708001 >> v1:172.21.15.99:6789/0 conn(0x7f45800c3b20 legacy=0x7f45800c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:56.466 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.463+0000 7f457effd640 1 -- 172.21.15.99:0/554708001 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458015cbe0 con 0x7f458006c310 2023-10-21T16:26:56.470 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.469+0000 7f457effd640 1 --2- 172.21.15.99:0/554708001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458006c310 0x7f458006ffc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f458006b850 tx=0x7f457002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d48c1d53238a7e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.472+0000 7f457e7fc640 1 -- 172.21.15.99:0/554708001 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570031830 con 0x7f458006c310 2023-10-21T16:26:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.472+0000 7f457e7fc640 1 -- 172.21.15.99:0/554708001 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570031990 con 0x7f458006c310 2023-10-21T16:26:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.472+0000 7f457e7fc640 1 -- 172.21.15.99:0/554708001 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570031d20 con 0x7f458006c310 2023-10-21T16:26:56.475 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.472+0000 7f4585d08640 1 -- 172.21.15.99:0/554708001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458006c310 msgr2=0x7f458006ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:56.475 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.472+0000 7f4585d08640 1 --2- 172.21.15.99:0/554708001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458006c310 0x7f458006ffc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f458006b850 tx=0x7f457002b8d0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.475 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 -- 172.21.15.99:0/554708001 shutdown_connections 2023-10-21T16:26:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 --2- 172.21.15.99:0/554708001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458006c310 0x7f458006ffc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 --2- 172.21.15.99:0/554708001 >> v2:172.21.15.12:3300/0 conn(0x7f458015a030 0x7f45800c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 -- 172.21.15.99:0/554708001 >> 172.21.15.99:0/554708001 conn(0x7f458006e020 msgr2=0x7f458006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 -- 172.21.15.99:0/554708001 shutdown_connections 2023-10-21T16:26:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.473+0000 7f4585d08640 1 -- 172.21.15.99:0/554708001 wait complete. 2023-10-21T16:26:56.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.474+0000 7f4585d08640 1 Processor -- start 2023-10-21T16:26:56.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.474+0000 7f4585d08640 1 -- start start 2023-10-21T16:26:56.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458006c310 0x7f45800c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:56.478 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 0x7f4580151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800cacc0 con 0x7f458006c310 2023-10-21T16:26:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800ccc90 con 0x7f45800c3b20 2023-10-21T16:26:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f4585d08640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580150b00 con 0x7f458015a030 2023-10-21T16:26:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f457effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f457ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 0x7f4580151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f457effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52234/0 (socket says 172.21.15.99:52234) 2023-10-21T16:26:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.475+0000 7f457effd640 1 -- 172.21.15.99:0/2665657073 learned_addr learned my addr 172.21.15.99:0/2665657073 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-10-21T16:26:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457ffff640 1 -- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 msgr2=0x7f4580151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457ffff640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457ffff640 1 -- 172.21.15.99:0/2665657073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458006c310 msgr2=0x7f45800c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:56.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457ffff640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458006c310 0x7f45800c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:56.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457ffff640 1 -- 172.21.15.99:0/2665657073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570009400 con 0x7f458015a030 2023-10-21T16:26:56.483 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.480+0000 7f457effd640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:26:56.484 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.483+0000 7f457ffff640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 0x7f4580151a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f457800cab0 tx=0x7f457800cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:56.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.486+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800ac30 con 0x7f458015a030 2023-10-21T16:26:56.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.486+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800ad90 con 0x7f458015a030 2023-10-21T16:26:56.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.486+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578012600 con 0x7f458015a030 2023-10-21T16:26:56.489 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.486+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4580151080 con 0x7f458015a030 2023-10-21T16:26:56.489 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.486+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800cc9b0 con 0x7f458015a030 2023-10-21T16:26:56.489 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.487+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580067560 con 0x7f458015a030 2023-10-21T16:26:56.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.591+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f4578007070 con 0x7f458015a030 2023-10-21T16:26:56.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.596+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4578011df0 con 0x7f458015a030 2023-10-21T16:26:56.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.596+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f45780196d0 con 0x7f458015a030 2023-10-21T16:26:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:56.682+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c75a210-8336-4730-a63a-a2d8afc4d4b0", "id": 7} v 0) v1 -- 0x7f45800c7a20 con 0x7f458015a030 2023-10-21T16:26:57.605 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.603+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mgrmap(e 3) v1 ==== 89067+0+0 (secure 0 0 0) 0x7f4578007320 con 0x7f458015a030 2023-10-21T16:26:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.604+0000 7f4567fff640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 0x7f456c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.604+0000 7f457f7fe640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 0x7f456c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:57.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.604+0000 7f457f7fe640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 0x7f456c06d560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4574009710 tx=0x7f4574006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:57.661 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:57.659+0000 7ffb3453d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-21T16:26:57.662 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T16:26:57.660+0000 7ffb3453d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-21T16:26:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.790+0000 7f4567fff640 1 -- 172.21.15.99:0/2665657073 <== mon.2 v2:172.21.15.99:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c75a210-8336-4730-a63a-a2d8afc4d4b0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4578057010 con 0x7f458015a030 2023-10-21T16:26:57.793 INFO:teuthology.orchestra.run.smithi099.stdout:7 2023-10-21T16:26:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 msgr2=0x7f456c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 0x7f456c06d560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4574009710 tx=0x7f4574006c90 comp rx=0 tx=0).stop 2023-10-21T16:26:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 msgr2=0x7f4580151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 0x7f4580151a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f457800cab0 tx=0x7f457800cf70 comp rx=0 tx=0).stop 2023-10-21T16:26:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 shutdown_connections 2023-10-21T16:26:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f456c06b170 0x7f456c06d560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f458015a030 0x7f4580151a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800c3b20 0x7f4580151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 --2- 172.21.15.99:0/2665657073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458006c310 0x7f45800c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.791+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 >> 172.21.15.99:0/2665657073 conn(0x7f458006e020 msgr2=0x7f4580157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.792+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 shutdown_connections 2023-10-21T16:26:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-10-21T16:26:57.792+0000 7f4585d08640 1 -- 172.21.15.99:0/2665657073 wait complete. 2023-10-21T16:26:57.804 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-21T16:26:57.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-10-21T16:26:57.818 INFO:tasks.ceph.osd.0:Started 2023-10-21T16:26:57.818 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-21T16:26:57.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-10-21T16:26:57.832 INFO:tasks.ceph.osd.1:Started 2023-10-21T16:26:57.833 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-21T16:26:57.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-10-21T16:26:57.846 INFO:tasks.ceph.osd.2:Started 2023-10-21T16:26:57.847 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-21T16:26:57.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-10-21T16:26:57.852 INFO:tasks.ceph.osd.3:Started 2023-10-21T16:26:57.852 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-21T16:26:57.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-10-21T16:26:57.855 INFO:tasks.ceph.osd.4:Started 2023-10-21T16:26:57.855 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-21T16:26:57.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-10-21T16:26:57.858 INFO:tasks.ceph.osd.5:Started 2023-10-21T16:26:57.858 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-21T16:26:57.859 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-10-21T16:26:57.863 INFO:tasks.ceph.osd.6:Started 2023-10-21T16:26:57.863 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-21T16:26:57.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-10-21T16:26:57.866 INFO:tasks.ceph.osd.7:Started 2023-10-21T16:26:57.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:26:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.094+0000 7f8b99378640 1 Processor -- start 2023-10-21T16:26:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.094+0000 7f8b99378640 1 -- start start 2023-10-21T16:26:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.095+0000 7f8b99378640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b940c55f0 0x7f8b94157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.096+0000 7f8b99378640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940c23f0 con 0x7f8b94157cc0 2023-10-21T16:26:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.096+0000 7f8b99378640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b94156fa0 con 0x7f8b940c59d0 2023-10-21T16:26:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.096+0000 7f8b99378640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9415aaf0 con 0x7f8b940c55f0 2023-10-21T16:26:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.096+0000 7f8b937fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8b940c59d0 0x7f8b940c7020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:41492/0 (socket says 172.21.15.12:41492) 2023-10-21T16:26:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.096+0000 7f8b937fe640 1 -- 172.21.15.12:0/3911125891 learned_addr learned my addr 172.21.15.12:0/3911125891 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:26:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.150+0000 7f8b92ffd640 1 --2- 172.21.15.12:0/3911125891 >> v2:172.21.15.12:3300/0 conn(0x7f8b940c55f0 0x7f8b94157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.159+0000 7f8b92ffd640 1 -- 172.21.15.12:0/3911125891 >> v1:172.21.15.99:6789/0 conn(0x7f8b940c59d0 legacy=0x7f8b940c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.159+0000 7f8b92ffd640 1 -- 172.21.15.12:0/3911125891 >> v1:172.21.15.12:6789/0 conn(0x7f8b94157cc0 legacy=0x7f8b94150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.159+0000 7f8b92ffd640 1 -- 172.21.15.12:0/3911125891 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9415add0 con 0x7f8b940c55f0 2023-10-21T16:26:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.163+0000 7f8b92ffd640 1 --2- 172.21.15.12:0/3911125891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94157780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009d90 tx=0x7f8b8402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affa1d77db63ae63 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.170+0000 7f8b927fc640 1 -- 172.21.15.12:0/3911125891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8402ccf0 con 0x7f8b940c55f0 2023-10-21T16:26:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.170+0000 7f8b927fc640 1 -- 172.21.15.12:0/3911125891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8402ce50 con 0x7f8b940c55f0 2023-10-21T16:26:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.171+0000 7f8b927fc640 1 -- 172.21.15.12:0/3911125891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84034660 con 0x7f8b940c55f0 2023-10-21T16:26:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.171+0000 7f8b99378640 1 -- 172.21.15.12:0/3911125891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 msgr2=0x7f8b94157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.171+0000 7f8b99378640 1 --2- 172.21.15.12:0/3911125891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94157780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009d90 tx=0x7f8b8402bf40 comp rx=0 tx=0).stop 2023-10-21T16:26:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.172+0000 7f8b99378640 1 -- 172.21.15.12:0/3911125891 shutdown_connections 2023-10-21T16:26:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.172+0000 7f8b99378640 1 --2- 172.21.15.12:0/3911125891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94157780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.172+0000 7f8b99378640 1 -- 172.21.15.12:0/3911125891 >> 172.21.15.12:0/3911125891 conn(0x7f8b94069de0 msgr2=0x7f8b9406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.172+0000 7f8b99378640 1 -- 172.21.15.12:0/3911125891 shutdown_connections 2023-10-21T16:26:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.172+0000 7f8b99378640 1 -- 172.21.15.12:0/3911125891 wait complete. 2023-10-21T16:26:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.175+0000 7f8b99378640 1 Processor -- start 2023-10-21T16:26:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.175+0000 7f8b99378640 1 -- start start 2023-10-21T16:26:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.176+0000 7f8b99378640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b99378640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:58.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b99378640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b94157cc0 0x7f8b941ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:58.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b99378640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9414dd20 con 0x7f8b940c55f0 2023-10-21T16:26:58.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b99378640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941f2170 con 0x7f8b94157cc0 2023-10-21T16:26:58.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b99378640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941f2cb0 con 0x7f8b940c59d0 2023-10-21T16:26:58.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b92ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:58.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.177+0000 7f8b8a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:58.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.178+0000 7f8b8a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:60224/0 (socket says 172.21.15.12:60224) 2023-10-21T16:26:58.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.178+0000 7f8b8a7fc640 1 -- 172.21.15.12:0/1460957990 learned_addr learned my addr 172.21.15.12:0/1460957990 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:26:58.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.181+0000 7f8b8a7fc640 1 -- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b94157cc0 msgr2=0x7f8b941ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.181+0000 7f8b8a7fc640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b94157cc0 0x7f8b941ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.181+0000 7f8b8a7fc640 1 -- 172.21.15.12:0/1460957990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 msgr2=0x7f8b94070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.181+0000 7f8b8a7fc640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.181+0000 7f8b8a7fc640 1 -- 172.21.15.12:0/1460957990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009a70 con 0x7f8b940c59d0 2023-10-21T16:26:58.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.183+0000 7f8b8a7fc640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00b3e0 tx=0x7f8b7c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:58.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.186+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c011830 con 0x7f8b940c59d0 2023-10-21T16:26:58.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.186+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0119b0 con 0x7f8b940c59d0 2023-10-21T16:26:58.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.186+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c011d60 con 0x7f8b940c59d0 2023-10-21T16:26:58.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.186+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b94147390 con 0x7f8b940c59d0 2023-10-21T16:26:58.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.187+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b941f2660 con 0x7f8b940c59d0 2023-10-21T16:26:58.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.188+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9415b370 con 0x7f8b940c59d0 2023-10-21T16:26:58.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.208+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 3) v1 ==== 89067+0+0 (secure 0 0 0) 0x7f8b7c01a400 con 0x7f8b940c59d0 2023-10-21T16:26:58.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.209+0000 7f8b8bfff640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 0x7f8b7406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:58.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.209+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8b7c088720 con 0x7f8b940c59d0 2023-10-21T16:26:58.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.209+0000 7f8b92ffd640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 0x7f8b7406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:58.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.210+0000 7f8b92ffd640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 0x7f8b7406d1d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b84036000 tx=0x7f8b84030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:58.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.458+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b7c054bb0 con 0x7f8b940c59d0 2023-10-21T16:26:58.485 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T16:26:58.483+0000 7ff711410500 -1 Falling back to public interface 2023-10-21T16:26:58.489 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T16:26:58.487+0000 7f6e2f190500 -1 Falling back to public interface 2023-10-21T16:26:58.503 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T16:26:58.501+0000 7fa932aa9500 -1 Falling back to public interface 2023-10-21T16:26:58.519 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T16:26:58.517+0000 7f119ec13500 -1 Falling back to public interface 2023-10-21T16:26:58.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T16:26:58.540+0000 7f175affa500 -1 Falling back to public interface 2023-10-21T16:26:58.580 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T16:26:58.579+0000 7f7e6910e500 -1 Falling back to public interface 2023-10-21T16:26:58.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T16:26:58.582+0000 7f09c991a500 -1 Falling back to public interface 2023-10-21T16:26:58.590 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T16:26:58.588+0000 7f7e680b5640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2023-10-21T16:26:58.592 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T16:26:58.590+0000 7fbd02120500 -1 Falling back to public interface 2023-10-21T16:26:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.645+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f8b7c054f80 con 0x7f8b940c59d0 2023-10-21T16:26:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.688+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b9415b370 con 0x7f8b940c59d0 2023-10-21T16:26:58.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.733+0000 7f8b8bfff640 1 -- 172.21.15.12:0/1460957990 <== mon.2 v2:172.21.15.99:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8b9415b370 con 0x7f8b940c59d0 2023-10-21T16:26:58.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:26:58.735 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:26:57.296744+0000","last_up_change":"0.000000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:26:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 msgr2=0x7f8b7406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 0x7f8b7406d1d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b84036000 tx=0x7f8b84030000 comp rx=0 tx=0).stop 2023-10-21T16:26:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 msgr2=0x7f8b941eec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:58.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00b3e0 tx=0x7f8b7c00b8a0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 shutdown_connections 2023-10-21T16:26:58.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b7406ad10 0x7f8b7406d1d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b94157cc0 0x7f8b941ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b940c59d0 0x7f8b941eec00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 --2- 172.21.15.12:0/1460957990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b940c55f0 0x7f8b94070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:58.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 >> 172.21.15.12:0/1460957990 conn(0x7f8b94069de0 msgr2=0x7f8b94150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:58.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 shutdown_connections 2023-10-21T16:26:58.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:26:58.735+0000 7f8b99378640 1 -- 172.21.15.12:0/1460957990 wait complete. 2023-10-21T16:26:58.755 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-21T16:26:58.756 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-21T16:26:59.562 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-21T16:26:59.758 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.756+0000 7fc1f29f0640 1 Processor -- start 2023-10-21T16:26:59.758 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.756+0000 7fc1f29f0640 1 -- start start 2023-10-21T16:26:59.759 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f29f0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 0x7fc1ec159d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:59.759 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f29f0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 0x7fc1ec070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:59.760 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f29f0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0c6e90 con 0x7fc1ec0c5dc0 2023-10-21T16:26:59.760 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f29f0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec15a270 con 0x7fc1ec0702f0 2023-10-21T16:26:59.760 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f29f0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec070c80 con 0x7fc1ec153480 2023-10-21T16:26:59.761 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 0x7fc1ec159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:59.761 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.758+0000 7fc1f0f8d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 0x7fc1ec070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:59.761 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.759+0000 7fc1f0f8d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 0x7fc1ec070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:40180/0 (socket says 172.21.15.12:40180) 2023-10-21T16:26:59.761 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.759+0000 7fc1f0f8d640 1 -- 172.21.15.12:0/3645765838 learned_addr learned my addr 172.21.15.12:0/3645765838 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:26:59.762 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.759+0000 7fc1eb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc1ec0c5dc0 0x7fc1ec0ca630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47222/0 (socket says 172.21.15.12:47222) 2023-10-21T16:26:59.762 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.761+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3645765838 >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 msgr2=0x7fc1ec070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:26:59.762 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.761+0000 7fc1ebfff640 1 --2- 172.21.15.12:0/3645765838 >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 0x7fc1ec070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:59.763 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.761+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3645765838 >> v1:172.21.15.12:6789/0 conn(0x7fc1ec0c5dc0 legacy=0x7fc1ec0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:59.763 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.761+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3645765838 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0c7130 con 0x7fc1ec153480 2023-10-21T16:26:59.765 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.764+0000 7fc1ebfff640 1 --2- 172.21.15.12:0/3645765838 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 0x7fc1ec159d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0097a0 tx=0x7fc1dc02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6354fee7367727 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:59.785 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.784+0000 7fc1eaffd640 1 -- 172.21.15.12:0/3645765838 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc030800 con 0x7fc1ec153480 2023-10-21T16:26:59.786 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.784+0000 7fc1eaffd640 1 -- 172.21.15.12:0/3645765838 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc030960 con 0x7fc1ec153480 2023-10-21T16:26:59.786 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.784+0000 7fc1eaffd640 1 -- 172.21.15.12:0/3645765838 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc030cf0 con 0x7fc1ec153480 2023-10-21T16:26:59.787 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3645765838 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 msgr2=0x7fc1ec159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:59.787 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3645765838 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 0x7fc1ec159d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0097a0 tx=0x7fc1dc02b940 comp rx=0 tx=0).stop 2023-10-21T16:26:59.787 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3645765838 shutdown_connections 2023-10-21T16:26:59.787 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3645765838 >> v2:172.21.15.99:3300/0 conn(0x7fc1ec0702f0 0x7fc1ec070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:59.788 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3645765838 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec153480 0x7fc1ec159d30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:59.788 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3645765838 >> 172.21.15.12:0/3645765838 conn(0x7fc1ec069de0 msgr2=0x7fc1ec06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:26:59.788 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3645765838 shutdown_connections 2023-10-21T16:26:59.788 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.785+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3645765838 wait complete. 2023-10-21T16:26:59.789 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.787+0000 7fc1f29f0640 1 Processor -- start 2023-10-21T16:26:59.789 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.788+0000 7fc1f29f0640 1 -- start start 2023-10-21T16:26:59.791 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:59.791 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1ec0c5dc0 0x7fc1ec151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:59.791 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1ec153480 0x7fc1ec151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:26:59.791 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1595d0 con 0x7fc1ec153480 2023-10-21T16:26:59.792 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec150cb0 con 0x7fc1ec0c5dc0 2023-10-21T16:26:59.792 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.789+0000 7fc1f29f0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec14d790 con 0x7fc1ec0702f0 2023-10-21T16:26:59.793 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.790+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:59.793 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.790+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1ec0c5dc0 0x7fc1ec151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:26:59.793 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.790+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:60238/0 (socket says 172.21.15.12:60238) 2023-10-21T16:26:59.793 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.790+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3489215835 learned_addr learned my addr 172.21.15.12:0/3489215835 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:26:59.795 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.794+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1ec0c5dc0 msgr2=0x7fc1ec151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:59.795 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.794+0000 7fc1ebfff640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1ec0c5dc0 0x7fc1ec151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:59.795 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.794+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3489215835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1ec153480 msgr2=0x7fc1ec151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:26:59.796 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.794+0000 7fc1ebfff640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1ec153480 0x7fc1ec151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:26:59.796 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.794+0000 7fc1ebfff640 1 -- 172.21.15.12:0/3489215835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009400 con 0x7fc1ec0702f0 2023-10-21T16:26:59.797 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.796+0000 7fc1ebfff640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc02bf50 tx=0x7fc1dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:26:59.802 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.799+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc03e070 con 0x7fc1ec0702f0 2023-10-21T16:26:59.802 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.799+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc039a50 con 0x7fc1ec0702f0 2023-10-21T16:26:59.802 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.799+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc039e00 con 0x7fc1ec0702f0 2023-10-21T16:26:59.803 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.799+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec151e50 con 0x7fc1ec0702f0 2023-10-21T16:26:59.803 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.800+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec1592f0 con 0x7fc1ec0702f0 2023-10-21T16:26:59.804 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:26:59.801+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec0c9be0 con 0x7fc1ec0702f0 2023-10-21T16:27:00.050 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.048+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc1dc0423f0 con 0x7fc1ec0702f0 2023-10-21T16:27:00.052 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.050+0000 7fc1e8ff9640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 0x7fc1d806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:00.052 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.051+0000 7fc1eb7fe640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 0x7fc1d806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:00.054 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.052+0000 7fc1eb7fe640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 0x7fc1d806d2f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ca440 tx=0x7fc1e0007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:00.058 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.057+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc1dc07a690 con 0x7fc1ec0702f0 2023-10-21T16:27:00.060 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.059+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1dc0769d0 con 0x7fc1ec0702f0 2023-10-21T16:27:00.279 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.277+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1ec0619f0 con 0x7fc1ec0702f0 2023-10-21T16:27:00.293 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.292+0000 7fc1e8ff9640 1 -- 172.21.15.12:0/3489215835 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc1dc048020 con 0x7fc1ec0702f0 2023-10-21T16:27:00.294 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-21T16:27:00.294 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:26:57.296744+0000","last_up_change":"0.000000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:00.296 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.294+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 msgr2=0x7fc1d806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:00.297 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.294+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 0x7fc1d806d2f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ca440 tx=0x7fc1e0007e80 comp rx=0 tx=0).stop 2023-10-21T16:27:00.297 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.294+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 msgr2=0x7fc1ec0c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:00.297 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc02bf50 tx=0x7fc1dc0046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:00.297 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 shutdown_connections 2023-10-21T16:27:00.298 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc1d806ae30 0x7fc1d806d2f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:00.298 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1ec153480 0x7fc1ec151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:00.298 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1ec0c5dc0 0x7fc1ec151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:00.298 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 --2- 172.21.15.12:0/3489215835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1ec0702f0 0x7fc1ec0c3e70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:00.298 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 >> 172.21.15.12:0/3489215835 conn(0x7fc1ec069de0 msgr2=0x7fc1ec071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:00.299 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 shutdown_connections 2023-10-21T16:27:00.299 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:00.295+0000 7fc1f29f0640 1 -- 172.21.15.12:0/3489215835 wait complete. 2023-10-21T16:27:00.311 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-21T16:27:01.939 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T16:27:01.937+0000 7ff711410500 -1 osd.7 0 log_to_monitors true 2023-10-21T16:27:01.986 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T16:27:01.984+0000 7fa932aa9500 -1 osd.5 0 log_to_monitors true 2023-10-21T16:27:01.997 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T16:27:01.995+0000 7f6e2f190500 -1 osd.4 0 log_to_monitors true 2023-10-21T16:27:02.019 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T16:27:02.017+0000 7f119ec13500 -1 osd.6 0 log_to_monitors true 2023-10-21T16:27:02.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T16:27:02.072+0000 7f175affa500 -1 osd.0 0 log_to_monitors true 2023-10-21T16:27:02.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T16:27:02.124+0000 7f09c991a500 -1 osd.1 0 log_to_monitors true 2023-10-21T16:27:02.421 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T16:27:02.420+0000 7fbd02120500 -1 osd.3 0 log_to_monitors true 2023-10-21T16:27:02.425 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T16:27:02.423+0000 7f7e6910e500 -1 osd.2 0 log_to_monitors true 2023-10-21T16:27:04.242 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T16:27:04.240+0000 7ff70c552640 -1 osd.7 0 waiting for initial osdmap 2023-10-21T16:27:04.272 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T16:27:04.270+0000 7ff704b85640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.115 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T16:27:06.113+0000 7fa92e212640 -1 osd.5 0 waiting for initial osdmap 2023-10-21T16:27:06.137 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T16:27:06.135+0000 7fa926845640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.157 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T16:27:06.155+0000 7f119b568640 -1 osd.6 0 waiting for initial osdmap 2023-10-21T16:27:06.176 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T16:27:06.174+0000 7f6e2c133640 -1 osd.4 0 waiting for initial osdmap 2023-10-21T16:27:06.245 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T16:27:06.243+0000 7f6e22f2c640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.249 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T16:27:06.247+0000 7f1192361640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.750 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T16:27:06.749+0000 7fbcfd889640 -1 osd.3 0 waiting for initial osdmap 2023-10-21T16:27:06.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T16:27:06.755+0000 7f1756763640 -1 osd.0 0 waiting for initial osdmap 2023-10-21T16:27:06.761 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T16:27:06.759+0000 7fbcf5ebc640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T16:27:06.766+0000 7f174ed96640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.795 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T16:27:06.794+0000 7f7e64877640 -1 osd.2 0 waiting for initial osdmap 2023-10-21T16:27:06.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T16:27:06.806+0000 7f09c5083640 -1 osd.1 0 waiting for initial osdmap 2023-10-21T16:27:06.809 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T16:27:06.808+0000 7f7e5ceaa640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:06.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T16:27:06.834+0000 7f09bd6b6640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-21T16:27:07.118 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:07.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.318+0000 7f19c116c640 1 Processor -- start 2023-10-21T16:27:07.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.318+0000 7f19c116c640 1 -- start start 2023-10-21T16:27:07.321 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.320+0000 7f19c116c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19bc15a540 0x7f19bc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.320+0000 7f19c116c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.320+0000 7f19c116c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0c9a60 con 0x7f19bc153460 2023-10-21T16:27:07.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.320+0000 7f19c116c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0cc220 con 0x7f19bc15a540 2023-10-21T16:27:07.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.320+0000 7f19c116c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc153840 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.321+0000 7f19c096b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:07.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.321+0000 7f19bb7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19bc15a540 0x7f19bc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:07.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.321+0000 7f19c096b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34346/0 (socket says 172.21.15.12:34346) 2023-10-21T16:27:07.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.321+0000 7f19c096b640 1 -- 172.21.15.12:0/3534122532 learned_addr learned my addr 172.21.15.12:0/3534122532 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:07.325 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.323+0000 7f19c096b640 1 -- 172.21.15.12:0/3534122532 >> v2:172.21.15.99:3300/0 conn(0x7f19bc15a540 msgr2=0x7f19bc0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:07.325 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.323+0000 7f19c096b640 1 --2- 172.21.15.12:0/3534122532 >> v2:172.21.15.99:3300/0 conn(0x7f19bc15a540 0x7f19bc0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.325 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.323+0000 7f19c096b640 1 -- 172.21.15.12:0/3534122532 >> v1:172.21.15.99:6789/0 conn(0x7f19bc153460 legacy=0x7f19bc15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:07.325 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.323+0000 7f19c096b640 1 -- 172.21.15.12:0/3534122532 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc15d080 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.327 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.325+0000 7f19c096b640 1 --2- 172.21.15.12:0/3534122532 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009e50 tx=0x7f19b402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b20cbdedfe55c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:07.328 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.327+0000 7f19baffd640 1 -- 172.21.15.12:0/3534122532 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b402cb90 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19baffd640 1 -- 172.21.15.12:0/3534122532 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b402ccf0 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19baffd640 1 -- 172.21.15.12:0/3534122532 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4034610 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.332 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 -- 172.21.15.12:0/3534122532 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 msgr2=0x7f19bc0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:07.332 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 --2- 172.21.15.12:0/3534122532 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009e50 tx=0x7f19b402bff0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.332 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 -- 172.21.15.12:0/3534122532 shutdown_connections 2023-10-21T16:27:07.332 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 --2- 172.21.15.12:0/3534122532 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc0c9cb0 0x7f19bc0ca520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.332 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 --2- 172.21.15.12:0/3534122532 >> v2:172.21.15.99:3300/0 conn(0x7f19bc15a540 0x7f19bc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.333 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 -- 172.21.15.12:0/3534122532 >> 172.21.15.12:0/3534122532 conn(0x7f19bc06ab00 msgr2=0x7f19bc06aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:07.333 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.329+0000 7f19c116c640 1 -- 172.21.15.12:0/3534122532 shutdown_connections 2023-10-21T16:27:07.333 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.330+0000 7f19c116c640 1 -- 172.21.15.12:0/3534122532 wait complete. 2023-10-21T16:27:07.334 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.331+0000 7f19c116c640 1 Processor -- start 2023-10-21T16:27:07.334 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.331+0000 7f19c116c640 1 -- start start 2023-10-21T16:27:07.334 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 0x7f19bc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.335 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19bc153460 0x7f19bc1e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.335 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 0x7f19bc1e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.335 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc156f40 con 0x7f19bc153460 2023-10-21T16:27:07.335 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc157220 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.335 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.332+0000 7f19c116c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1e4990 con 0x7f19bc15a540 2023-10-21T16:27:07.336 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.333+0000 7f19c096b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 0x7f19bc1e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:07.336 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.333+0000 7f19bbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 0x7f19bc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:07.337 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.333+0000 7f19c096b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 0x7f19bc1e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34354/0 (socket says 172.21.15.12:34354) 2023-10-21T16:27:07.337 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.333+0000 7f19c096b640 1 -- 172.21.15.12:0/2961168365 learned_addr learned my addr 172.21.15.12:0/2961168365 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:07.338 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.336+0000 7f19bbfff640 1 -- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 msgr2=0x7f19bc1e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:07.338 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.336+0000 7f19bbfff640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 0x7f19bc1e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.338 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.336+0000 7f19bbfff640 1 -- 172.21.15.12:0/2961168365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19bc153460 msgr2=0x7f19bc1e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:07.339 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.336+0000 7f19bbfff640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19bc153460 0x7f19bc1e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:07.339 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.336+0000 7f19bbfff640 1 -- 172.21.15.12:0/2961168365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009b30 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.340 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.339+0000 7f19bbfff640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 0x7f19bc153a40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c390 tx=0x7f19ac00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:07.344 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.342+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0052d0 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.344 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.342+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac005430 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.344 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.342+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003830 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.344 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.342+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc1e4c70 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.345 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.343+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc1e43c0 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.345 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.344+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc1e4580 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.364 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.362+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f19ac003990 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.364 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.363+0000 7f19b8ff9640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 0x7f19a806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:07.365 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.363+0000 7f19bb7fe640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 0x7f19a806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:07.366 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.364+0000 7f19bb7fe640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 0x7f19a806d2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19b0006a90 tx=0x7f19b0006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:07.598 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.596+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f19ac057d80 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.611 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.609+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19ac0540c0 con 0x7f19bc0c9cb0 2023-10-21T16:27:07.830 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:07.828+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19bc0619f0 con 0x7f19bc0c9cb0 2023-10-21T16:27:08.031 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.029+0000 7f19b8ff9640 1 -- 172.21.15.12:0/2961168365 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8987 (secure 0 0 0) 0x7f19ac0576e0 con 0x7f19bc0c9cb0 2023-10-21T16:27:08.031 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-21T16:27:08.032 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":15,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:06.723075+0000","last_up_change":"2023-10-21T16:27:06.723075+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:08.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.032+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 msgr2=0x7f19a806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:08.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.032+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 0x7f19a806d2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19b0006a90 tx=0x7f19b0006a20 comp rx=0 tx=0).stop 2023-10-21T16:27:08.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.032+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 msgr2=0x7f19bc153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:08.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.032+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 0x7f19bc153a40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c390 tx=0x7f19ac00c850 comp rx=0 tx=0).stop 2023-10-21T16:27:08.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 shutdown_connections 2023-10-21T16:27:08.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f19a806ae30 0x7f19a806d2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:08.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19bc15a540 0x7f19bc1e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:08.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19bc153460 0x7f19bc1e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:08.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 --2- 172.21.15.12:0/2961168365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19bc0c9cb0 0x7f19bc153a40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:08.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 >> 172.21.15.12:0/2961168365 conn(0x7f19bc06ab00 msgr2=0x7f19bc14e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:08.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 shutdown_connections 2023-10-21T16:27:08.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:08.033+0000 7f19c116c640 1 -- 172.21.15.12:0/2961168365 wait complete. 2023-10-21T16:27:08.051 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-21T16:27:14.858 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:15.055 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.054+0000 7fa68e733640 1 Processor -- start 2023-10-21T16:27:15.055 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.054+0000 7fa68e733640 1 -- start start 2023-10-21T16:27:15.057 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.057 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa68806fde0 0x7fa6881567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.057 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa6880ca630 0x7fa6880caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.057 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6880c4160 con 0x7fa6880ca630 2023-10-21T16:27:15.058 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6880c4440 con 0x7fa68806fde0 2023-10-21T16:27:15.058 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.056+0000 7fa68e733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880c4720 con 0x7fa688150140 2023-10-21T16:27:15.059 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.057+0000 7fa687fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.059 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.057+0000 7fa687fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51416/0 (socket says 172.21.15.12:51416) 2023-10-21T16:27:15.059 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.057+0000 7fa67ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa68806fde0 0x7fa6881567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.059 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.057+0000 7fa687fff640 1 -- 172.21.15.12:0/1836049458 learned_addr learned my addr 172.21.15.12:0/1836049458 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:15.060 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.060+0000 7fa687fff640 1 -- 172.21.15.12:0/1836049458 >> v2:172.21.15.99:3300/0 conn(0x7fa68806fde0 msgr2=0x7fa6881567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:15.060 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.060+0000 7fa687fff640 1 --2- 172.21.15.12:0/1836049458 >> v2:172.21.15.99:3300/0 conn(0x7fa68806fde0 0x7fa6881567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.061 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.060+0000 7fa687fff640 1 -- 172.21.15.12:0/1836049458 >> v2:172.21.15.12:3300/0 conn(0x7fa6880ca630 msgr2=0x7fa6880caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:15.061 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.060+0000 7fa687fff640 1 --2- 172.21.15.12:0/1836049458 >> v2:172.21.15.12:3300/0 conn(0x7fa6880ca630 0x7fa6880caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.061 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.060+0000 7fa687fff640 1 -- 172.21.15.12:0/1836049458 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6880c4a00 con 0x7fa688150140 2023-10-21T16:27:15.063 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.063+0000 7fa687fff640 1 --2- 172.21.15.12:0/1836049458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa6880cb2b0 tx=0x7fa67802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc6ce423d03bc096 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:15.068 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.067+0000 7fa6877fe640 1 -- 172.21.15.12:0/1836049458 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678030860 con 0x7fa688150140 2023-10-21T16:27:15.068 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.067+0000 7fa6877fe640 1 -- 172.21.15.12:0/1836049458 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6780309c0 con 0x7fa688150140 2023-10-21T16:27:15.068 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.067+0000 7fa6877fe640 1 -- 172.21.15.12:0/1836049458 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678030d50 con 0x7fa688150140 2023-10-21T16:27:15.069 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.067+0000 7fa68e733640 1 -- 172.21.15.12:0/1836049458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 msgr2=0x7fa688070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:15.069 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.067+0000 7fa68e733640 1 --2- 172.21.15.12:0/1836049458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa6880cb2b0 tx=0x7fa67802b9a0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.071 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 -- 172.21.15.12:0/1836049458 shutdown_connections 2023-10-21T16:27:15.071 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 --2- 172.21.15.12:0/1836049458 >> v2:172.21.15.12:3300/0 conn(0x7fa6880ca630 0x7fa6880caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.071 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 --2- 172.21.15.12:0/1836049458 >> v2:172.21.15.99:3300/0 conn(0x7fa68806fde0 0x7fa6881567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.072 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 --2- 172.21.15.12:0/1836049458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa688150140 0x7fa688070360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.072 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 -- 172.21.15.12:0/1836049458 >> 172.21.15.12:0/1836049458 conn(0x7fa688069de0 msgr2=0x7fa68806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:15.072 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 -- 172.21.15.12:0/1836049458 shutdown_connections 2023-10-21T16:27:15.072 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.068+0000 7fa68e733640 1 -- 172.21.15.12:0/1836049458 wait complete. 2023-10-21T16:27:15.072 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.070+0000 7fa68e733640 1 Processor -- start 2023-10-21T16:27:15.073 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.070+0000 7fa68e733640 1 -- start start 2023-10-21T16:27:15.073 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.074 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880ca630 0x7fa688153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.074 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa688150140 0x7fa688151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.074 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa688159390 con 0x7fa688150140 2023-10-21T16:27:15.074 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881ed6b0 con 0x7fa6880ca630 2023-10-21T16:27:15.075 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.071+0000 7fa68e733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881edc70 con 0x7fa68806fde0 2023-10-21T16:27:15.075 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.072+0000 7fa687fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.075 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.072+0000 7fa687fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51424/0 (socket says 172.21.15.12:51424) 2023-10-21T16:27:15.076 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.072+0000 7fa687fff640 1 -- 172.21.15.12:0/4222914038 learned_addr learned my addr 172.21.15.12:0/4222914038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:15.076 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.072+0000 7fa68ccd0640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa688150140 0x7fa688151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.076 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.072+0000 7fa67ffff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880ca630 0x7fa688153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.077 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.075+0000 7fa687fff640 1 -- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880ca630 msgr2=0x7fa688153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:15.077 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.075+0000 7fa687fff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880ca630 0x7fa688153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.077 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.075+0000 7fa687fff640 1 -- 172.21.15.12:0/4222914038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa688150140 msgr2=0x7fa688151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:15.077 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.075+0000 7fa687fff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa688150140 0x7fa688151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.078 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.075+0000 7fa687fff640 1 -- 172.21.15.12:0/4222914038 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780094d0 con 0x7fa68806fde0 2023-10-21T16:27:15.078 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.078+0000 7fa687fff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa67802b9e0 tx=0x7fa678004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:15.082 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.081+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678039c90 con 0x7fa68806fde0 2023-10-21T16:27:15.082 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.081+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678039e10 con 0x7fa68806fde0 2023-10-21T16:27:15.083 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.082+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678043640 con 0x7fa68806fde0 2023-10-21T16:27:15.083 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.082+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6881ee640 con 0x7fa68806fde0 2023-10-21T16:27:15.083 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.082+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa688157730 con 0x7fa68806fde0 2023-10-21T16:27:15.084 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.083+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa688159500 con 0x7fa68806fde0 2023-10-21T16:27:15.341 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.340+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6780437a0 con 0x7fa68806fde0 2023-10-21T16:27:15.342 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.341+0000 7fa6857fa640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 0x7fa66806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:15.342 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.342+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa67803e070 con 0x7fa68806fde0 2023-10-21T16:27:15.343 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.342+0000 7fa67ffff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 0x7fa66806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:15.343 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.343+0000 7fa67ffff640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 0x7fa66806d3b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa688158620 tx=0x7fa670009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:15.352 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.351+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa678077fc0 con 0x7fa68806fde0 2023-10-21T16:27:15.570 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.570+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa688159500 con 0x7fa68806fde0 2023-10-21T16:27:15.890 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.890+0000 7fa6857fa640 1 -- 172.21.15.12:0/4222914038 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7fa688159500 con 0x7fa68806fde0 2023-10-21T16:27:15.891 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-21T16:27:15.892 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":19,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:11.996243+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:15.894 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.893+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 msgr2=0x7fa66806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:15.895 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.893+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 0x7fa66806d3b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa688158620 tx=0x7fa670009190 comp rx=0 tx=0).stop 2023-10-21T16:27:15.895 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.893+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 msgr2=0x7fa6881ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:15.895 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.893+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa67802b9e0 tx=0x7fa678004730 comp rx=0 tx=0).stop 2023-10-21T16:27:15.895 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 shutdown_connections 2023-10-21T16:27:15.896 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66806aef0 0x7fa66806d3b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.896 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa688150140 0x7fa688151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.896 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880ca630 0x7fa688153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.896 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 --2- 172.21.15.12:0/4222914038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806fde0 0x7fa6881ee100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:15.896 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 >> 172.21.15.12:0/4222914038 conn(0x7fa688069de0 msgr2=0x7fa688071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:15.897 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 shutdown_connections 2023-10-21T16:27:15.897 INFO:teuthology.misc.health.smithi012.stderr:2023-10-21T16:27:15.894+0000 7fa68e733640 1 -- 172.21.15.12:0/4222914038 wait complete. 2023-10-21T16:27:15.911 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-21T16:27:15.912 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-21T16:27:15.912 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.912 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-21T16:27:15.913 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-10-21T16:27:15.922 INFO:tasks.ceph.mds.a:Started 2023-10-21T16:27:15.922 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.923 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-21T16:27:15.923 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-10-21T16:27:15.932 INFO:tasks.ceph.mds.c:Started 2023-10-21T16:27:15.932 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.932 INFO:tasks.ceph.mds.e:Restarting daemon 2023-10-21T16:27:15.933 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-10-21T16:27:15.940 INFO:tasks.ceph.mds.e:Started 2023-10-21T16:27:15.940 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.940 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-21T16:27:15.941 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-10-21T16:27:15.943 INFO:tasks.ceph.mds.b:Started 2023-10-21T16:27:15.944 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.944 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-21T16:27:15.944 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-10-21T16:27:15.946 INFO:tasks.ceph.mds.d:Started 2023-10-21T16:27:15.947 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-21T16:27:15.947 INFO:tasks.ceph.mds.f:Restarting daemon 2023-10-21T16:27:15.947 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-10-21T16:27:15.950 INFO:tasks.ceph.mds.f:Started 2023-10-21T16:27:15.950 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-21T16:27:15.951 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.143+0000 7ff4f6dbd640 1 Processor -- start 2023-10-21T16:27:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.144+0000 7ff4f6dbd640 1 -- start start 2023-10-21T16:27:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.145+0000 7ff4f6dbd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4f00c9830 0x7ff4f0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.145+0000 7ff4f6dbd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f015d050 con 0x7ff4f00cb1e0 2023-10-21T16:27:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.145+0000 7ff4f6dbd640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00ca180 con 0x7ff4f014fa60 2023-10-21T16:27:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.145+0000 7ff4f6dbd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f0159fc0 con 0x7ff4f00c9830 2023-10-21T16:27:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.146+0000 7ff4f5dbb640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff4f014fa60 0x7ff4f00b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:55368/0 (socket says 172.21.15.12:55368) 2023-10-21T16:27:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.146+0000 7ff4f5dbb640 1 -- 172.21.15.12:0/466082089 learned_addr learned my addr 172.21.15.12:0/466082089 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.146+0000 7ff4f55ba640 1 --2- 172.21.15.12:0/466082089 >> v2:172.21.15.12:3300/0 conn(0x7ff4f00c9830 0x7ff4f0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.149+0000 7ff4f4db9640 1 -- 172.21.15.12:0/466082089 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287644198 0 0) 0x7ff4f00ca180 con 0x7ff4f014fa60 2023-10-21T16:27:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.149+0000 7ff4f4db9640 1 -- 172.21.15.12:0/466082089 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4dc003520 con 0x7ff4f014fa60 2023-10-21T16:27:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.151+0000 7ff4f55ba640 1 -- 172.21.15.12:0/466082089 >> v1:172.21.15.99:6789/0 conn(0x7ff4f014fa60 legacy=0x7ff4f00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.151+0000 7ff4f55ba640 1 -- 172.21.15.12:0/466082089 >> v1:172.21.15.12:6789/0 conn(0x7ff4f00cb1e0 legacy=0x7ff4f0163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.151+0000 7ff4f55ba640 1 -- 172.21.15.12:0/466082089 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00c9ec0 con 0x7ff4f00c9830 2023-10-21T16:27:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.156+0000 7ff4f55ba640 1 --2- 172.21.15.12:0/466082089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f0159a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097a0 tx=0x7ff4e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ee6b0441afacfb server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:16.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.162+0000 7ff4f4db9640 1 -- 172.21.15.12:0/466082089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e002e070 con 0x7ff4f00c9830 2023-10-21T16:27:16.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.162+0000 7ff4f4db9640 1 -- 172.21.15.12:0/466082089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00315a0 con 0x7ff4f00c9830 2023-10-21T16:27:16.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.162+0000 7ff4f4db9640 1 -- 172.21.15.12:0/466082089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0031930 con 0x7ff4f00c9830 2023-10-21T16:27:16.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.163+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/466082089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 msgr2=0x7ff4f0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.163+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/466082089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f0159a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097a0 tx=0x7ff4e002b840 comp rx=0 tx=0).stop 2023-10-21T16:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.164+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/466082089 shutdown_connections 2023-10-21T16:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.164+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/466082089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f0159a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.164+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/466082089 >> 172.21.15.12:0/466082089 conn(0x7ff4f00716f0 msgr2=0x7ff4f006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.164+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/466082089 shutdown_connections 2023-10-21T16:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.164+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/466082089 wait complete. 2023-10-21T16:27:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.167+0000 7ff4f6dbd640 1 Processor -- start 2023-10-21T16:27:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.167+0000 7ff4f6dbd640 1 -- start start 2023-10-21T16:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f01e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4f00cb1e0 0x7ff4f01ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00ce3c0 con 0x7ff4f00c9830 2023-10-21T16:27:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f01eeee0 con 0x7ff4f00cb1e0 2023-10-21T16:27:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.168+0000 7ff4f6dbd640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f014c6e0 con 0x7ff4f014fa60 2023-10-21T16:27:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.169+0000 7ff4f55ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4f00cb1e0 0x7ff4f01ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.169+0000 7ff4f65bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.169+0000 7ff4f5dbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f01e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.170+0000 7ff4f65bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51432/0 (socket says 172.21.15.12:51432) 2023-10-21T16:27:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.170+0000 7ff4f65bc640 1 -- 172.21.15.12:0/965733372 learned_addr learned my addr 172.21.15.12:0/965733372 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.173+0000 7ff4f65bc640 1 -- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4f00cb1e0 msgr2=0x7ff4f01ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.173+0000 7ff4f65bc640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4f00cb1e0 0x7ff4f01ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.173+0000 7ff4f65bc640 1 -- 172.21.15.12:0/965733372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 msgr2=0x7ff4f01e2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.173+0000 7ff4f65bc640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f01e2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.173+0000 7ff4f65bc640 1 -- 172.21.15.12:0/965733372 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009400 con 0x7ff4f014fa60 2023-10-21T16:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.176+0000 7ff4f65bc640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c6b0 tx=0x7ff4e800cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.179+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8003b70 con 0x7ff4f014fa60 2023-10-21T16:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.179+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f01e2410 con 0x7ff4f014fa60 2023-10-21T16:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.179+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00b4500 con 0x7ff4f014fa60 2023-10-21T16:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.180+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f00c9260 con 0x7ff4f014fa60 2023-10-21T16:27:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.459+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8001790 con 0x7ff4f014fa60 2023-10-21T16:27:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.459+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80050d0 con 0x7ff4f014fa60 2023-10-21T16:27:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.463+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4e80052f0 con 0x7ff4f014fa60 2023-10-21T16:27:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.464+0000 7ff4e67fc640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 0x7ff4d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.465+0000 7ff4f5dbb640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 0x7ff4d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.465+0000 7ff4f5dbb640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 0x7ff4d406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0011e0 tx=0x7ff4ec007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:16.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.467+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4e8058b50 con 0x7ff4f014fa60 2023-10-21T16:27:16.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.485+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4e8058920 con 0x7ff4f014fa60 2023-10-21T16:27:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.860+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f0067560 con 0x7ff4f014fa60 2023-10-21T16:27:16.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.888+0000 7ff4e67fc640 1 -- 172.21.15.12:0/965733372 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7ff4e80584b0 con 0x7ff4f014fa60 2023-10-21T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:11.996243+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:16.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 msgr2=0x7ff4d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 0x7ff4d406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0011e0 tx=0x7ff4ec007d30 comp rx=0 tx=0).stop 2023-10-21T16:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 msgr2=0x7ff4f01e4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c6b0 tx=0x7ff4e800cb70 comp rx=0 tx=0).stop 2023-10-21T16:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 shutdown_connections 2023-10-21T16:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff4d406ae70 0x7ff4d406d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4f014fa60 0x7ff4f01e4a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4f00cb1e0 0x7ff4f01ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 --2- 172.21.15.12:0/965733372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00c9830 0x7ff4f01e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 >> 172.21.15.12:0/965733372 conn(0x7ff4f00716f0 msgr2=0x7ff4f014e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 shutdown_connections 2023-10-21T16:27:16.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:16.892+0000 7ff4f6dbd640 1 -- 172.21.15.12:0/965733372 wait complete. 2023-10-21T16:27:16.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-21T16:27:08.552678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-21T16:27:16.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-21T16:27:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.108+0000 7fa5b0d4e640 1 Processor -- start 2023-10-21T16:27:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.109+0000 7fa5b0d4e640 1 -- start start 2023-10-21T16:27:17.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.110+0000 7fa5b0d4e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 0x7fa5ac06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:17.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.110+0000 7fa5b0d4e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac157990 con 0x7fa5ac0c7a50 2023-10-21T16:27:17.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.110+0000 7fa5b0d4e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c6df0 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.110+0000 7fa5b0d4e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac156e50 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.111+0000 7fa5ab7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 0x7fa5ac06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:17.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.111+0000 7fa5abfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5ac0c3e40 0x7fa5ac1617d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:55378/0 (socket says 172.21.15.12:55378) 2023-10-21T16:27:17.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.111+0000 7fa5abfff640 1 -- 172.21.15.12:0/3491061027 learned_addr learned my addr 172.21.15.12:0/3491061027 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:17.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.113+0000 7fa5aa7fc640 1 -- 172.21.15.12:0/3491061027 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667341868 0 0) 0x7fa5ac0c6df0 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.113+0000 7fa5aa7fc640 1 -- 172.21.15.12:0/3491061027 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa594003520 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.114+0000 7fa5ab7fe640 1 -- 172.21.15.12:0/3491061027 >> v1:172.21.15.99:6789/0 conn(0x7fa5ac0c3e40 legacy=0x7fa5ac1617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.114+0000 7fa5ab7fe640 1 -- 172.21.15.12:0/3491061027 >> v1:172.21.15.12:6789/0 conn(0x7fa5ac0c7a50 legacy=0x7fa5ac15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.114+0000 7fa5ab7fe640 1 -- 172.21.15.12:0/3491061027 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c42d0 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.117+0000 7fa5ab7fe640 1 --2- 172.21.15.12:0/3491061027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 0x7fa5ac06fac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0097d0 tx=0x7fa59c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cc43f1c7d079bf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:17.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.121+0000 7fa5aa7fc640 1 -- 172.21.15.12:0/3491061027 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c030800 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5aa7fc640 1 -- 172.21.15.12:0/3491061027 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c030960 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5aa7fc640 1 -- 172.21.15.12:0/3491061027 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c030cf0 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3491061027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 msgr2=0x7fa5ac06fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3491061027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 0x7fa5ac06fac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0097d0 tx=0x7fa59c02b940 comp rx=0 tx=0).stop 2023-10-21T16:27:17.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3491061027 shutdown_connections 2023-10-21T16:27:17.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3491061027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c3a60 0x7fa5ac06fac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3491061027 >> 172.21.15.12:0/3491061027 conn(0x7fa5ac06d6b0 msgr2=0x7fa5ac06dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:17.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3491061027 shutdown_connections 2023-10-21T16:27:17.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.122+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3491061027 wait complete. 2023-10-21T16:27:17.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.124+0000 7fa5b0d4e640 1 Processor -- start 2023-10-21T16:27:17.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.124+0000 7fa5b0d4e640 1 -- start start 2023-10-21T16:27:17.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5ac0c3a60 0x7fa5ac146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:17.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 0x7fa5ac1f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:17.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 0x7fa5ac1f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:17.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac14dc00 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c2340 con 0x7fa5ac0c3a60 2023-10-21T16:27:17.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.125+0000 7fa5b0d4e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1e2740 con 0x7fa5ac0c7a50 2023-10-21T16:27:17.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.126+0000 7fa5abfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 0x7fa5ac1f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:17.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.126+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 0x7fa5ac1f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:17.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.126+0000 7fa5ab7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5ac0c3a60 0x7fa5ac146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:17.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.126+0000 7fa5abfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 0x7fa5ac1f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51458/0 (socket says 172.21.15.12:51458) 2023-10-21T16:27:17.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.126+0000 7fa5abfff640 1 -- 172.21.15.12:0/3334624146 learned_addr learned my addr 172.21.15.12:0/3334624146 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:17.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.131+0000 7fa5aaffd640 1 -- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 msgr2=0x7fa5ac1f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.131+0000 7fa5aaffd640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 0x7fa5ac1f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.131+0000 7fa5aaffd640 1 -- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5ac0c3a60 msgr2=0x7fa5ac146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.131+0000 7fa5aaffd640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5ac0c3a60 0x7fa5ac146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.131+0000 7fa5aaffd640 1 -- 172.21.15.12:0/3334624146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009400 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.134+0000 7fa5aaffd640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 0x7fa5ac1f18a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c390 tx=0x7fa5a000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:17.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.139+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00052d0 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.139+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a0005430 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.140+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0003830 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.140+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac1f24b0 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.140+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac1e2c30 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.141+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac157e00 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.196+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5a0003990 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.197+0000 7fa593fff640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 0x7fa59806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.198+0000 7fa5ab7fe640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 0x7fa59806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:17.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.198+0000 7fa5ab7fe640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 0x7fa59806d380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa59c036000 tx=0x7fa59c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.509+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa5a0057bd0 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.510+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5a0053f10 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.716+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5ac157e00 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.812+0000 7fa593fff640 1 -- 172.21.15.12:0/3334624146 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac157e00 con 0x7fa5ac0c3e40 2023-10-21T16:27:17.813 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-21T16:27:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 msgr2=0x7fa59806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 0x7fa59806d380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa59c036000 tx=0x7fa59c03b040 comp rx=0 tx=0).stop 2023-10-21T16:27:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 msgr2=0x7fa5ac1f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 0x7fa5ac1f18a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c390 tx=0x7fa5a000c850 comp rx=0 tx=0).stop 2023-10-21T16:27:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 shutdown_connections 2023-10-21T16:27:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa59806aec0 0x7fa59806d380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5ac0c7a50 0x7fa5ac1f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5ac0c3e40 0x7fa5ac1f18a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 --2- 172.21.15.12:0/3334624146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5ac0c3a60 0x7fa5ac146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 >> 172.21.15.12:0/3334624146 conn(0x7fa5ac06d6b0 msgr2=0x7fa5ac0c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 shutdown_connections 2023-10-21T16:27:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:17.815+0000 7fa5b0d4e640 1 -- 172.21.15.12:0/3334624146 wait complete. 2023-10-21T16:27:17.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:27:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.017+0000 7f1e0142d640 1 Processor -- start 2023-10-21T16:27:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.017+0000 7f1e0142d640 1 -- start start 2023-10-21T16:27:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.018+0000 7f1e0142d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dfc0c55f0 0x7f1dfc157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1e0142d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc0c23f0 con 0x7f1dfc157cc0 2023-10-21T16:27:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1e0142d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc156fa0 con 0x7f1dfc0c59d0 2023-10-21T16:27:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1e0142d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15aaf0 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1dfb7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1dfc0c59d0 0x7f1dfc0c7020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:55394/0 (socket says 172.21.15.12:55394) 2023-10-21T16:27:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1dfb7fe640 1 -- 172.21.15.12:0/248372321 learned_addr learned my addr 172.21.15.12:0/248372321 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:18.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.019+0000 7f1dfaffd640 1 --2- 172.21.15.12:0/248372321 >> v2:172.21.15.12:3300/0 conn(0x7f1dfc0c55f0 0x7f1dfc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:18.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.023+0000 7f1df9ffb640 1 -- 172.21.15.12:0/248372321 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291065035 0 0) 0x7f1dfc156fa0 con 0x7f1dfc0c59d0 2023-10-21T16:27:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.023+0000 7f1df9ffb640 1 -- 172.21.15.12:0/248372321 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de4003520 con 0x7f1dfc0c59d0 2023-10-21T16:27:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.025+0000 7f1dfaffd640 1 -- 172.21.15.12:0/248372321 >> v1:172.21.15.99:6789/0 conn(0x7f1dfc0c59d0 legacy=0x7f1dfc0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.025+0000 7f1dfaffd640 1 -- 172.21.15.12:0/248372321 >> v1:172.21.15.12:6789/0 conn(0x7f1dfc157cc0 legacy=0x7f1dfc150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.025+0000 7f1dfaffd640 1 -- 172.21.15.12:0/248372321 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc15add0 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.032+0000 7f1dfaffd640 1 --2- 172.21.15.12:0/248372321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc157780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0097a0 tx=0x7f1dec02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813c9cf3dfd848fe server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.042+0000 7f1df9ffb640 1 -- 172.21.15.12:0/248372321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec02f810 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.042+0000 7f1df9ffb640 1 -- 172.21.15.12:0/248372321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec02f970 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.042+0000 7f1df9ffb640 1 -- 172.21.15.12:0/248372321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec02fd00 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 -- 172.21.15.12:0/248372321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c55f0 msgr2=0x7f1dfc157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 --2- 172.21.15.12:0/248372321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc157780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0097a0 tx=0x7f1dec02b9f0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 -- 172.21.15.12:0/248372321 shutdown_connections 2023-10-21T16:27:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 --2- 172.21.15.12:0/248372321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc157780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 -- 172.21.15.12:0/248372321 >> 172.21.15.12:0/248372321 conn(0x7f1dfc069de0 msgr2=0x7f1dfc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:18.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 -- 172.21.15.12:0/248372321 shutdown_connections 2023-10-21T16:27:18.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.043+0000 7f1e0142d640 1 -- 172.21.15.12:0/248372321 wait complete. 2023-10-21T16:27:18.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.046+0000 7f1e0142d640 1 Processor -- start 2023-10-21T16:27:18.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.046+0000 7f1e0142d640 1 -- start start 2023-10-21T16:27:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c59d0 0x7f1dfc15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c7950 con 0x7f1dfc0c59d0 2023-10-21T16:27:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f1880 con 0x7f1dfc0c55f0 2023-10-21T16:27:18.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.047+0000 7f1e0142d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc156770 con 0x7f1dfc157cc0 2023-10-21T16:27:18.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.048+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.048+0000 7f1dfaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.048+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51468/0 (socket says 172.21.15.12:51468) 2023-10-21T16:27:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.048+0000 7f1dfb7fe640 1 -- 172.21.15.12:0/3936520754 learned_addr learned my addr 172.21.15.12:0/3936520754 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.049+0000 7f1dfa7fc640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c59d0 0x7f1dfc15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.052+0000 7f1dfb7fe640 1 -- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dfc0c55f0 msgr2=0x7f1dfc158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.052+0000 7f1dfb7fe640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.052+0000 7f1dfb7fe640 1 -- 172.21.15.12:0/3936520754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c59d0 msgr2=0x7f1dfc15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.052+0000 7f1dfb7fe640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c59d0 0x7f1dfc15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.052+0000 7f1dfb7fe640 1 -- 172.21.15.12:0/3936520754 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009400 con 0x7f1dfc157cc0 2023-10-21T16:27:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.054+0000 7f1dfb7fe640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1df400ca30 tx=0x7f1df400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.059+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400abd0 con 0x7f1dfc157cc0 2023-10-21T16:27:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.059+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400ad30 con 0x7f1dfc157cc0 2023-10-21T16:27:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.059+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4012640 con 0x7f1dfc157cc0 2023-10-21T16:27:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.059+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc156a50 con 0x7f1dfc157cc0 2023-10-21T16:27:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.060+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc1f1ad0 con 0x7f1dfc157cc0 2023-10-21T16:27:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.061+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc156f70 con 0x7f1dfc157cc0 2023-10-21T16:27:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.086+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1df4007070 con 0x7f1dfc157cc0 2023-10-21T16:27:18.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.087+0000 7f1de37fe640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 0x7f1de806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:18.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.087+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1df4089580 con 0x7f1dfc157cc0 2023-10-21T16:27:18.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.088+0000 7f1dfaffd640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 0x7f1de806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.088+0000 7f1dfaffd640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 0x7f1de806d380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dec036000 tx=0x7f1dec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:18.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.344+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1df4054a80 con 0x7f1dfc157cc0 2023-10-21T16:27:18.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.578+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dfc0619f0 con 0x7f1dfc157cc0 2023-10-21T16:27:18.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.598+0000 7f1de37fe640 1 -- 172.21.15.12:0/3936520754 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f1df4017020 con 0x7f1dfc157cc0 2023-10-21T16:27:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:18.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-21T16:27:18.600 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2023-10-21T16:27:18.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 msgr2=0x7f1de806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 0x7f1de806d380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dec036000 tx=0x7f1dec008030 comp rx=0 tx=0).stop 2023-10-21T16:27:18.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 msgr2=0x7f1dfc1f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:18.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1df400ca30 tx=0x7f1df400cef0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 shutdown_connections 2023-10-21T16:27:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1de806aec0 0x7f1de806d380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dfc157cc0 0x7f1dfc1f22d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc0c59d0 0x7f1dfc15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 --2- 172.21.15.12:0/3936520754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dfc0c55f0 0x7f1dfc158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 >> 172.21.15.12:0/3936520754 conn(0x7f1dfc069de0 msgr2=0x7f1dfc06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:18.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 shutdown_connections 2023-10-21T16:27:18.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:18.601+0000 7f1e0142d640 1 -- 172.21.15.12:0/3936520754 wait complete. 2023-10-21T16:27:20.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:27:20.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.819+0000 7fd3e8875640 1 Processor -- start 2023-10-21T16:27:20.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.819+0000 7fd3e8875640 1 -- start start 2023-10-21T16:27:20.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.820+0000 7fd3e8875640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e4153300 0x7fd3e40c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.820+0000 7fd3e8875640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3e40c3fc0 0x7fd3e415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.820+0000 7fd3e8875640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e415c550 con 0x7fd3e4158f60 2023-10-21T16:27:20.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.820+0000 7fd3e8875640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40b23e0 con 0x7fd3e40c3fc0 2023-10-21T16:27:20.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.820+0000 7fd3e8875640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e41536e0 con 0x7fd3e4153300 2023-10-21T16:27:20.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.821+0000 7fd3e37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e4153300 0x7fd3e40c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.821+0000 7fd3e2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3e40c3fc0 0x7fd3e415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.821+0000 7fd3e37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e4153300 0x7fd3e40c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:50472/0 (socket says 172.21.15.12:50472) 2023-10-21T16:27:20.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.821+0000 7fd3e37fe640 1 -- 172.21.15.12:0/1843518665 learned_addr learned my addr 172.21.15.12:0/1843518665 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:20.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.825+0000 7fd3e37fe640 1 -- 172.21.15.12:0/1843518665 >> v2:172.21.15.12:3300/0 conn(0x7fd3e40c3fc0 msgr2=0x7fd3e415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:20.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.825+0000 7fd3e37fe640 1 --2- 172.21.15.12:0/1843518665 >> v2:172.21.15.12:3300/0 conn(0x7fd3e40c3fc0 0x7fd3e415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.825+0000 7fd3e37fe640 1 -- 172.21.15.12:0/1843518665 >> v1:172.21.15.12:6789/0 conn(0x7fd3e4158f60 legacy=0x7fd3e40ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:20.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.825+0000 7fd3e37fe640 1 -- 172.21.15.12:0/1843518665 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e415cb10 con 0x7fd3e4153300 2023-10-21T16:27:20.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.828+0000 7fd3e37fe640 1 --2- 172.21.15.12:0/1843518665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40c3a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40c9270 tx=0x7fd3d402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b451f3080f101e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:20.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.832+0000 7fd3e27fc640 1 -- 172.21.15.12:0/1843518665 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4030860 con 0x7fd3e4153300 2023-10-21T16:27:20.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.832+0000 7fd3e27fc640 1 -- 172.21.15.12:0/1843518665 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40309c0 con 0x7fd3e4153300 2023-10-21T16:27:20.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.832+0000 7fd3e27fc640 1 -- 172.21.15.12:0/1843518665 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4030d50 con 0x7fd3e4153300 2023-10-21T16:27:20.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.832+0000 7fd3e8875640 1 -- 172.21.15.12:0/1843518665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 msgr2=0x7fd3e40c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.832+0000 7fd3e8875640 1 --2- 172.21.15.12:0/1843518665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40c3a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40c9270 tx=0x7fd3d402b9a0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 -- 172.21.15.12:0/1843518665 shutdown_connections 2023-10-21T16:27:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 --2- 172.21.15.12:0/1843518665 >> v2:172.21.15.12:3300/0 conn(0x7fd3e40c3fc0 0x7fd3e415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 --2- 172.21.15.12:0/1843518665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40c3a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 -- 172.21.15.12:0/1843518665 >> 172.21.15.12:0/1843518665 conn(0x7fd3e4071510 msgr2=0x7fd3e406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 -- 172.21.15.12:0/1843518665 shutdown_connections 2023-10-21T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.833+0000 7fd3e8875640 1 -- 172.21.15.12:0/1843518665 wait complete. 2023-10-21T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.835+0000 7fd3e8875640 1 Processor -- start 2023-10-21T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.836+0000 7fd3e8875640 1 -- start start 2023-10-21T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e40c3fc0 0x7fd3e40c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 0x7fd3e41f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41f1930 con 0x7fd3e4158f60 2023-10-21T16:27:20.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41f1c10 con 0x7fd3e4153300 2023-10-21T16:27:20.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.837+0000 7fd3e8875640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e415b4c0 con 0x7fd3e40c3fc0 2023-10-21T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.838+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.838+0000 7fd3e37fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e40c3fc0 0x7fd3e40c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.838+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:50476/0 (socket says 172.21.15.12:50476) 2023-10-21T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.838+0000 7fd3e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 0x7fd3e41f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.838+0000 7fd3e2ffd640 1 -- 172.21.15.12:0/597669824 learned_addr learned my addr 172.21.15.12:0/597669824 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:20.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.843+0000 7fd3e3fff640 1 -- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e40c3fc0 msgr2=0x7fd3e40c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:20.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.843+0000 7fd3e3fff640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e40c3fc0 0x7fd3e40c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.843+0000 7fd3e3fff640 1 -- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 msgr2=0x7fd3e40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:20.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.843+0000 7fd3e3fff640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:20.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.843+0000 7fd3e3fff640 1 -- 172.21.15.12:0/597669824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40094d0 con 0x7fd3e4158f60 2023-10-21T16:27:20.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.846+0000 7fd3e3fff640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 0x7fd3e41f20a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c730 tx=0x7fd3dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.851+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc003b70 con 0x7fd3e4158f60 2023-10-21T16:27:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.851+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc003cd0 con 0x7fd3e4158f60 2023-10-21T16:27:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.851+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc005310 con 0x7fd3e4158f60 2023-10-21T16:27:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.851+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e40c6670 con 0x7fd3e4158f60 2023-10-21T16:27:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.852+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e415b1f0 con 0x7fd3e4158f60 2023-10-21T16:27:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.853+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e41f1da0 con 0x7fd3e4158f60 2023-10-21T16:27:20.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.879+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd3dc005680 con 0x7fd3e4158f60 2023-10-21T16:27:20.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.881+0000 7fd3cbfff640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 0x7fd3d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.881+0000 7fd3e37fe640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 0x7fd3d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:20.882+0000 7fd3e37fe640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 0x7fd3d006d380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4036000 tx=0x7fd3d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.165+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3dc058c80 con 0x7fd3e4158f60 2023-10-21T16:27:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.166+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3dc054fc0 con 0x7fd3e4158f60 2023-10-21T16:27:21.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:27:21.223 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:27:21.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.473+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3e4067560 con 0x7fd3e4158f60 2023-10-21T16:27:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.500+0000 7fd3cbfff640 1 -- 172.21.15.12:0/597669824 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fd3dc0585e0 con 0x7fd3e4158f60 2023-10-21T16:27:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:21.501 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-21T16:27:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2023-10-21T16:27:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 msgr2=0x7fd3d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 0x7fd3d006d380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4036000 tx=0x7fd3d4008030 comp rx=0 tx=0).stop 2023-10-21T16:27:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 msgr2=0x7fd3e41f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 0x7fd3e41f20a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c730 tx=0x7fd3dc00cbf0 comp rx=0 tx=0).stop 2023-10-21T16:27:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 shutdown_connections 2023-10-21T16:27:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd3d006aec0 0x7fd3d006d380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e4158f60 0x7fd3e41f20a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e4153300 0x7fd3e40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 --2- 172.21.15.12:0/597669824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e40c3fc0 0x7fd3e40c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 >> 172.21.15.12:0/597669824 conn(0x7fd3e4071510 msgr2=0x7fd3e40c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 shutdown_connections 2023-10-21T16:27:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:21.503+0000 7fd3e8875640 1 -- 172.21.15.12:0/597669824 wait complete. 2023-10-21T16:27:22.286 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2023-10-21T16:27:22.290 INFO:tasks.ceph.mds.f.smithi099.stdout:starting mds.f at 2023-10-21T16:27:22.292 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2023-10-21T16:27:23.146 INFO:tasks.ceph.mds.e.smithi012.stdout:starting mds.e at 2023-10-21T16:27:23.229 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-21T16:27:23.358 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-21T16:27:23.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:27:23.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.705+0000 7f3d0759e640 1 Processor -- start 2023-10-21T16:27:23.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.706+0000 7f3d0759e640 1 -- start start 2023-10-21T16:27:23.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.708+0000 7f3d0759e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d0814fec0 0x7f3d0806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.708+0000 7f3d0759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d080708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.708+0000 7f3d0759e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080c38e0 con 0x7f3d08155cf0 2023-10-21T16:27:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.708+0000 7f3d0759e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0806d450 con 0x7f3d0814fec0 2023-10-21T16:27:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.708+0000 7f3d0759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081562a0 con 0x7f3d0806e100 2023-10-21T16:27:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.709+0000 7f3d06d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3d08155cf0 0x7f3d080ca780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:40952/0 (socket says 172.21.15.12:40952) 2023-10-21T16:27:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.709+0000 7f3d06d9d640 1 -- 172.21.15.12:0/2056305520 learned_addr learned my addr 172.21.15.12:0/2056305520 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.709+0000 7f3cfffff640 1 --2- 172.21.15.12:0/2056305520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d080708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.709+0000 7f3d0659c640 1 --2- 172.21.15.12:0/2056305520 >> v2:172.21.15.12:3300/0 conn(0x7f3d0814fec0 0x7f3d0806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.711+0000 7f3d05d9b640 1 -- 172.21.15.12:0/2056305520 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701504331 0 0) 0x7f3d080c38e0 con 0x7f3d08155cf0 2023-10-21T16:27:23.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.711+0000 7f3d05d9b640 1 -- 172.21.15.12:0/2056305520 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf4005730 con 0x7f3d08155cf0 2023-10-21T16:27:23.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.712+0000 7f3cfffff640 1 -- 172.21.15.12:0/2056305520 >> v2:172.21.15.12:3300/0 conn(0x7f3d0814fec0 msgr2=0x7f3d0806dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:23.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.712+0000 7f3cfffff640 1 --2- 172.21.15.12:0/2056305520 >> v2:172.21.15.12:3300/0 conn(0x7f3d0814fec0 0x7f3d0806dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.712+0000 7f3cfffff640 1 -- 172.21.15.12:0/2056305520 >> v1:172.21.15.99:6789/0 conn(0x7f3d08155cf0 legacy=0x7f3d080ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:23.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.712+0000 7f3cfffff640 1 -- 172.21.15.12:0/2056305520 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08156560 con 0x7f3d0806e100 2023-10-21T16:27:23.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.714+0000 7f3cfffff640 1 --2- 172.21.15.12:0/2056305520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d080708b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097a0 tx=0x7f3cf002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=726edc31cebafa14 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:23.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.718+0000 7f3d05d9b640 1 -- 172.21.15.12:0/2056305520 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0031830 con 0x7f3d0806e100 2023-10-21T16:27:23.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.718+0000 7f3d05d9b640 1 -- 172.21.15.12:0/2056305520 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0031990 con 0x7f3d0806e100 2023-10-21T16:27:23.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.718+0000 7f3d05d9b640 1 -- 172.21.15.12:0/2056305520 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0031d20 con 0x7f3d0806e100 2023-10-21T16:27:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.718+0000 7f3d0759e640 1 -- 172.21.15.12:0/2056305520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 msgr2=0x7f3d080708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.718+0000 7f3d0759e640 1 --2- 172.21.15.12:0/2056305520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d080708b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097a0 tx=0x7f3cf002b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 -- 172.21.15.12:0/2056305520 shutdown_connections 2023-10-21T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 --2- 172.21.15.12:0/2056305520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d080708b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 --2- 172.21.15.12:0/2056305520 >> v2:172.21.15.12:3300/0 conn(0x7f3d0814fec0 0x7f3d0806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 -- 172.21.15.12:0/2056305520 >> 172.21.15.12:0/2056305520 conn(0x7f3d0806bac0 msgr2=0x7f3d0806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 -- 172.21.15.12:0/2056305520 shutdown_connections 2023-10-21T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.719+0000 7f3d0759e640 1 -- 172.21.15.12:0/2056305520 wait complete. 2023-10-21T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.720+0000 7f3d0759e640 1 Processor -- start 2023-10-21T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 -- start start 2023-10-21T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d081421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0814fec0 0x7f3d081ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081ee750 con 0x7f3d0814fec0 2023-10-21T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081eecb0 con 0x7f3d08155cf0 2023-10-21T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.721+0000 7f3d0759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081f2bc0 con 0x7f3d0806e100 2023-10-21T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.722+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.722+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0814fec0 0x7f3d081ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.722+0000 7f3d0659c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d081421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.723+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39250/0 (socket says 172.21.15.12:39250) 2023-10-21T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.723+0000 7f3d06d9d640 1 -- 172.21.15.12:0/1512278132 learned_addr learned my addr 172.21.15.12:0/1512278132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:23.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.727+0000 7f3d06d9d640 1 -- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 msgr2=0x7f3d081421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:23.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.727+0000 7f3d06d9d640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d081421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.727+0000 7f3d06d9d640 1 -- 172.21.15.12:0/1512278132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0814fec0 msgr2=0x7f3d081ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.727+0000 7f3d06d9d640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0814fec0 0x7f3d081ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.727+0000 7f3d06d9d640 1 -- 172.21.15.12:0/1512278132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009400 con 0x7f3d08155cf0 2023-10-21T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.729+0000 7f3d06d9d640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000caa0 tx=0x7f3d0000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:23.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.733+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000ac00 con 0x7f3d08155cf0 2023-10-21T16:27:23.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.733+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000ad60 con 0x7f3d08155cf0 2023-10-21T16:27:23.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.733+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00012620 con 0x7f3d08155cf0 2023-10-21T16:27:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.733+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d08149810 con 0x7f3d08155cf0 2023-10-21T16:27:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.734+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081ef680 con 0x7f3d08155cf0 2023-10-21T16:27:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.735+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08067560 con 0x7f3d08155cf0 2023-10-21T16:27:23.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.981+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d00007070 con 0x7f3d08155cf0 2023-10-21T16:27:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.983+0000 7f3cfeffd640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 0x7f3ce806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:23.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.983+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d000896f0 con 0x7f3d08155cf0 2023-10-21T16:27:23.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.983+0000 7f3d0659c640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 0x7f3ce806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:23.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.984+0000 7f3d0659c640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 0x7f3ce806d380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b40 tx=0x7f3cf8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:23.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:23.992+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d00054b70 con 0x7f3d08155cf0 2023-10-21T16:27:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.264+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d081eedf0 con 0x7f3d08155cf0 2023-10-21T16:27:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.495+0000 7f3cfeffd640 1 -- 172.21.15.12:0/1512278132 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5271 (secure 0 0 0) 0x7f3d00017020 con 0x7f3d08155cf0 2023-10-21T16:27:24.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:24.496 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-21T16:27:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2023-10-21T16:27:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 msgr2=0x7f3ce806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 0x7f3ce806d380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b40 tx=0x7f3cf8009190 comp rx=0 tx=0).stop 2023-10-21T16:27:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 msgr2=0x7f3d0814b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000caa0 tx=0x7f3d0000cf60 comp rx=0 tx=0).stop 2023-10-21T16:27:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 shutdown_connections 2023-10-21T16:27:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3ce806aec0 0x7f3ce806d380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d08155cf0 0x7f3d0814b2e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0814fec0 0x7f3d081ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 --2- 172.21.15.12:0/1512278132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0806e100 0x7f3d081421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 >> 172.21.15.12:0/1512278132 conn(0x7f3d0806bac0 msgr2=0x7f3d080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 shutdown_connections 2023-10-21T16:27:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.499+0000 7f3d0759e640 1 -- 172.21.15.12:0/1512278132 wait complete. 2023-10-21T16:27:24.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:24.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.744+0000 7f6466973640 1 Processor -- start 2023-10-21T16:27:24.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.744+0000 7f6466973640 1 -- start start 2023-10-21T16:27:24.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.745+0000 7f6466973640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f646014fa60 0x7f64600c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6466973640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6460159a80 0x7f64600b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6466973640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646015d050 con 0x7f64600b2f90 2023-10-21T16:27:24.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6466973640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646015d4e0 con 0x7f6460159a80 2023-10-21T16:27:24.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6466973640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600ca180 con 0x7f646014fa60 2023-10-21T16:27:24.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6465170640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6460159a80 0x7f64600b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.746+0000 7f6465971640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f646014fa60 0x7f64600c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.747+0000 7f6465170640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6460159a80 0x7f64600b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39262/0 (socket says 172.21.15.12:39262) 2023-10-21T16:27:24.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.747+0000 7f6465170640 1 -- 172.21.15.12:0/855637023 learned_addr learned my addr 172.21.15.12:0/855637023 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:24.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.749+0000 7f6465170640 1 -- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f646014fa60 msgr2=0x7f64600c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:24.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.749+0000 7f6465170640 1 --2- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f646014fa60 0x7f64600c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.749+0000 7f6465170640 1 -- 172.21.15.12:0/855637023 >> v1:172.21.15.12:6789/0 conn(0x7f64600b2f90 legacy=0x7f64600cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.749+0000 7f6465170640 1 -- 172.21.15.12:0/855637023 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600c9ec0 con 0x7f6460159a80 2023-10-21T16:27:24.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.751+0000 7f6465170640 1 --2- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6460159a80 0x7f64600b2a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64600ca0b0 tx=0x7f645002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1a02d72cfb357a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:24.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.755+0000 7f646496f640 1 -- 172.21.15.12:0/855637023 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500317c0 con 0x7f6460159a80 2023-10-21T16:27:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.755+0000 7f646496f640 1 -- 172.21.15.12:0/855637023 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450031920 con 0x7f6460159a80 2023-10-21T16:27:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.755+0000 7f646496f640 1 -- 172.21.15.12:0/855637023 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450031cb0 con 0x7f6460159a80 2023-10-21T16:27:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 -- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6460159a80 msgr2=0x7f64600b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 --2- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6460159a80 0x7f64600b2a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64600ca0b0 tx=0x7f645002b860 comp rx=0 tx=0).stop 2023-10-21T16:27:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 -- 172.21.15.12:0/855637023 shutdown_connections 2023-10-21T16:27:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 --2- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6460159a80 0x7f64600b2a50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 --2- 172.21.15.12:0/855637023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f646014fa60 0x7f64600c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 -- 172.21.15.12:0/855637023 >> 172.21.15.12:0/855637023 conn(0x7f64600716f0 msgr2=0x7f646006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 -- 172.21.15.12:0/855637023 shutdown_connections 2023-10-21T16:27:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.756+0000 7f6466973640 1 -- 172.21.15.12:0/855637023 wait complete. 2023-10-21T16:27:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.758+0000 7f6466973640 1 Processor -- start 2023-10-21T16:27:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.758+0000 7f6466973640 1 -- start start 2023-10-21T16:27:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 0x7f64601493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460159a80 0x7f64601eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460158da0 con 0x7f6460159a80 2023-10-21T16:27:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64601f2a40 con 0x7f646014fa60 2023-10-21T16:27:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.759+0000 7f6466973640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c8650 con 0x7f64600b2f90 2023-10-21T16:27:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6465170640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 0x7f64601493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6465971640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6466172640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460159a80 0x7f64601eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6465971640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46704/0 (socket says 172.21.15.12:46704) 2023-10-21T16:27:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6465170640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 0x7f64601493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39276/0 (socket says 172.21.15.12:39276) 2023-10-21T16:27:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.760+0000 7f6465971640 1 -- 172.21.15.12:0/1910961603 learned_addr learned my addr 172.21.15.12:0/1910961603 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.763+0000 7f6465971640 1 -- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 msgr2=0x7f64601493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.763+0000 7f6465971640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 0x7f64601493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.763+0000 7f6465971640 1 -- 172.21.15.12:0/1910961603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460159a80 msgr2=0x7f64601eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.763+0000 7f6465971640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460159a80 0x7f64601eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.763+0000 7f6465971640 1 -- 172.21.15.12:0/1910961603 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500094d0 con 0x7f64600b2f90 2023-10-21T16:27:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.766+0000 7f6465971640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f645c00efc0 tx=0x7f645c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.769+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c009b80 con 0x7f64600b2f90 2023-10-21T16:27:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.769+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00f040 con 0x7f64600b2f90 2023-10-21T16:27:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.769+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0146a0 con 0x7f64600b2f90 2023-10-21T16:27:24.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.769+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600c88f0 con 0x7f64600b2f90 2023-10-21T16:27:24.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.770+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64601592d0 con 0x7f64600b2f90 2023-10-21T16:27:24.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.771+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600b2600 con 0x7f64600b2f90 2023-10-21T16:27:24.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.790+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f645c014800 con 0x7f64600b2f90 2023-10-21T16:27:24.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.791+0000 7f64567fc640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 0x7f644406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:24.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.791+0000 7f6465170640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 0x7f644406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:24.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.791+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f645c0595d0 con 0x7f64600b2f90 2023-10-21T16:27:24.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:24.792+0000 7f6465170640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 0x7f644406d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6450036000 tx=0x7f645003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:25.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.026+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f645c055910 con 0x7f64600b2f90 2023-10-21T16:27:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.233+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6460067560 con 0x7f64600b2f90 2023-10-21T16:27:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.350+0000 7f64567fc640 1 -- 172.21.15.12:0/1910961603 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f645c058f30 con 0x7f64600b2f90 2023-10-21T16:27:25.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:25.352 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:11.996243+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.355+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 msgr2=0x7f644406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.355+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 0x7f644406d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6450036000 tx=0x7f645003d040 comp rx=0 tx=0).stop 2023-10-21T16:27:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.355+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 msgr2=0x7f64601f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.355+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f645c00efc0 tx=0x7f645c00c490 comp rx=0 tx=0).stop 2023-10-21T16:27:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 shutdown_connections 2023-10-21T16:27:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f644406aec0 0x7f644406d380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460159a80 0x7f64601eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f646014fa60 0x7f64601493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 --2- 172.21.15.12:0/1910961603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f64600b2f90 0x7f64601f2500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 >> 172.21.15.12:0/1910961603 conn(0x7f64600716f0 msgr2=0x7f64600b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 shutdown_connections 2023-10-21T16:27:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.356+0000 7f6466973640 1 -- 172.21.15.12:0/1910961603 wait complete. 2023-10-21T16:27:25.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-21T16:27:08.552678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-21T16:27:25.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-21T16:27:25.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.598+0000 7ff30e044640 1 Processor -- start 2023-10-21T16:27:25.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.599+0000 7ff30e044640 1 -- start start 2023-10-21T16:27:25.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.600+0000 7ff30e044640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff3080c7010 0x7ff3080c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.600+0000 7ff30e044640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.600+0000 7ff30e044640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff308157750 con 0x7ff3080c1a00 2023-10-21T16:27:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.600+0000 7ff30e044640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3080723b0 con 0x7ff3080c7010 2023-10-21T16:27:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.600+0000 7ff30e044640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080c7930 con 0x7ff3080c10c0 2023-10-21T16:27:25.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.601+0000 7ff307fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.601+0000 7ff3077fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff3080c7010 0x7ff3080c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.601+0000 7ff307fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46708/0 (socket says 172.21.15.12:46708) 2023-10-21T16:27:25.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.601+0000 7ff307fff640 1 -- 172.21.15.12:0/557719681 learned_addr learned my addr 172.21.15.12:0/557719681 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:25.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.603+0000 7ff307fff640 1 -- 172.21.15.12:0/557719681 >> v2:172.21.15.12:3300/0 conn(0x7ff3080c7010 msgr2=0x7ff3080c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:25.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.603+0000 7ff307fff640 1 --2- 172.21.15.12:0/557719681 >> v2:172.21.15.12:3300/0 conn(0x7ff3080c7010 0x7ff3080c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.603+0000 7ff307fff640 1 -- 172.21.15.12:0/557719681 >> v1:172.21.15.99:6789/0 conn(0x7ff3080c1a00 legacy=0x7ff308156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.603+0000 7ff307fff640 1 -- 172.21.15.12:0/557719681 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308157a30 con 0x7ff3080c10c0 2023-10-21T16:27:25.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.606+0000 7ff307fff640 1 --2- 172.21.15.12:0/557719681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff300009870 tx=0x7ff30002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef8ae6f25258a172 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.608+0000 7ff3067fc640 1 -- 172.21.15.12:0/557719681 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30002f830 con 0x7ff3080c10c0 2023-10-21T16:27:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff3067fc640 1 -- 172.21.15.12:0/557719681 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30002f990 con 0x7ff3080c10c0 2023-10-21T16:27:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff3067fc640 1 -- 172.21.15.12:0/557719681 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30002fd20 con 0x7ff3080c10c0 2023-10-21T16:27:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 -- 172.21.15.12:0/557719681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 msgr2=0x7ff30815af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 --2- 172.21.15.12:0/557719681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff300009870 tx=0x7ff30002ba10 comp rx=0 tx=0).stop 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 -- 172.21.15.12:0/557719681 shutdown_connections 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 --2- 172.21.15.12:0/557719681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c10c0 0x7ff30815af10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 --2- 172.21.15.12:0/557719681 >> v2:172.21.15.12:3300/0 conn(0x7ff3080c7010 0x7ff3080c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 -- 172.21.15.12:0/557719681 >> 172.21.15.12:0/557719681 conn(0x7ff308069de0 msgr2=0x7ff30806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.610+0000 7ff30e044640 1 -- 172.21.15.12:0/557719681 shutdown_connections 2023-10-21T16:27:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.611+0000 7ff30e044640 1 -- 172.21.15.12:0/557719681 wait complete. 2023-10-21T16:27:25.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.612+0000 7ff30e044640 1 Processor -- start 2023-10-21T16:27:25.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.612+0000 7ff30e044640 1 -- start start 2023-10-21T16:27:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 0x7ff308143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 0x7ff308151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 0x7ff308152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff308151920 con 0x7ff3080c7010 2023-10-21T16:27:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3081e2b20 con 0x7ff3080c10c0 2023-10-21T16:27:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.613+0000 7ff30e044640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff308156df0 con 0x7ff3080c1a00 2023-10-21T16:27:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.614+0000 7ff3077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 0x7ff308143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.614+0000 7ff306ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 0x7ff308151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.614+0000 7ff307fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 0x7ff308152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.615+0000 7ff306ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 0x7ff308151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46718/0 (socket says 172.21.15.12:46718) 2023-10-21T16:27:25.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.615+0000 7ff3077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 0x7ff308143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39278/0 (socket says 172.21.15.12:39278) 2023-10-21T16:27:25.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.615+0000 7ff306ffd640 1 -- 172.21.15.12:0/511154709 learned_addr learned my addr 172.21.15.12:0/511154709 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:25.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.619+0000 7ff307fff640 1 -- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 msgr2=0x7ff308151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.619+0000 7ff307fff640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 0x7ff308151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.619+0000 7ff307fff640 1 -- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 msgr2=0x7ff308143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.619+0000 7ff307fff640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 0x7ff308143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.619+0000 7ff307fff640 1 -- 172.21.15.12:0/511154709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000094d0 con 0x7ff3080c7010 2023-10-21T16:27:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.622+0000 7ff307fff640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 0x7ff308152280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff3080c8490 tx=0x7ff300004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.628+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300037c40 con 0x7ff3080c7010 2023-10-21T16:27:25.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.628+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300037dc0 con 0x7ff3080c7010 2023-10-21T16:27:25.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.628+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000426c0 con 0x7ff3080c7010 2023-10-21T16:27:25.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.628+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3080c5750 con 0x7ff3080c7010 2023-10-21T16:27:25.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.628+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff308157040 con 0x7ff3080c7010 2023-10-21T16:27:25.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.629+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff308151a60 con 0x7ff3080c7010 2023-10-21T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.932+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff30002d3c0 con 0x7ff3080c7010 2023-10-21T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.933+0000 7ff2fffff640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 0x7ff2e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.934+0000 7ff3077fe640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 0x7ff2e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.934+0000 7ff3077fe640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 0x7ff2e806d380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009aa0 tx=0x7ff2f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:25.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.962+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff30003c070 con 0x7ff3080c7010 2023-10-21T16:27:25.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:25.964+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3000772d0 con 0x7ff3080c7010 2023-10-21T16:27:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.186+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff308151a60 con 0x7ff3080c7010 2023-10-21T16:27:26.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.298+0000 7ff2fffff640 1 -- 172.21.15.12:0/511154709 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff308151a60 con 0x7ff3080c7010 2023-10-21T16:27:26.300 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-21T16:27:26.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 msgr2=0x7ff2e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 0x7ff2e806d380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009aa0 tx=0x7ff2f0009190 comp rx=0 tx=0).stop 2023-10-21T16:27:26.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 msgr2=0x7ff308152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 0x7ff308152280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff3080c8490 tx=0x7ff300004730 comp rx=0 tx=0).stop 2023-10-21T16:27:26.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 shutdown_connections 2023-10-21T16:27:26.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2e806aec0 0x7ff2e806d380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3080c7010 0x7ff308152280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3080c1a00 0x7ff308151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 --2- 172.21.15.12:0/511154709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3080c10c0 0x7ff308143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.302+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 >> 172.21.15.12:0/511154709 conn(0x7ff308069de0 msgr2=0x7ff3080c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.303+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 shutdown_connections 2023-10-21T16:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.303+0000 7ff30e044640 1 -- 172.21.15.12:0/511154709 wait complete. 2023-10-21T16:27:26.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-21T16:27:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.530+0000 7fcf63541640 1 Processor -- start 2023-10-21T16:27:26.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.530+0000 7fcf63541640 1 -- start start 2023-10-21T16:27:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.531+0000 7fcf63541640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf5c1500d0 0x7fcf5c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.531+0000 7fcf63541640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 0x7fcf5c156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.531+0000 7fcf63541640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c15a450 con 0x7fcf5c071510 2023-10-21T16:27:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.531+0000 7fcf63541640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c156ea0 con 0x7fcf5c1500d0 2023-10-21T16:27:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.531+0000 7fcf63541640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c156050 con 0x7fcf5c156530 2023-10-21T16:27:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.532+0000 7fcf61ade640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 0x7fcf5c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.532+0000 7fcf612dd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf5c1500d0 0x7fcf5c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.532+0000 7fcf612dd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf5c1500d0 0x7fcf5c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39294/0 (socket says 172.21.15.12:39294) 2023-10-21T16:27:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.532+0000 7fcf61ade640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 0x7fcf5c156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46734/0 (socket says 172.21.15.12:46734) 2023-10-21T16:27:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.532+0000 7fcf612dd640 1 -- 172.21.15.12:0/2212470862 learned_addr learned my addr 172.21.15.12:0/2212470862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.535+0000 7fcf612dd640 1 -- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 msgr2=0x7fcf5c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.535+0000 7fcf612dd640 1 --2- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 0x7fcf5c156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.535+0000 7fcf612dd640 1 -- 172.21.15.12:0/2212470862 >> v1:172.21.15.12:6789/0 conn(0x7fcf5c071510 legacy=0x7fcf5c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.535+0000 7fcf612dd640 1 -- 172.21.15.12:0/2212470862 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c159eb0 con 0x7fcf5c1500d0 2023-10-21T16:27:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.537+0000 7fcf612dd640 1 --2- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c06fd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009870 tx=0x7fcf5802dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f9e5f842edc15a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf53fff640 1 -- 172.21.15.12:0/2212470862 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5802e9e0 con 0x7fcf5c1500d0 2023-10-21T16:27:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf53fff640 1 -- 172.21.15.12:0/2212470862 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5802eb40 con 0x7fcf5c1500d0 2023-10-21T16:27:26.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf53fff640 1 -- 172.21.15.12:0/2212470862 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58036440 con 0x7fcf5c1500d0 2023-10-21T16:27:26.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 -- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c1500d0 msgr2=0x7fcf5c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 --2- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c06fd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009870 tx=0x7fcf5802dc30 comp rx=0 tx=0).stop 2023-10-21T16:27:26.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 -- 172.21.15.12:0/2212470862 shutdown_connections 2023-10-21T16:27:26.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 --2- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c156530 0x7fcf5c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 --2- 172.21.15.12:0/2212470862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c06fd70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.541+0000 7fcf63541640 1 -- 172.21.15.12:0/2212470862 >> 172.21.15.12:0/2212470862 conn(0x7fcf5c069de0 msgr2=0x7fcf5c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:26.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.542+0000 7fcf63541640 1 -- 172.21.15.12:0/2212470862 shutdown_connections 2023-10-21T16:27:26.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.542+0000 7fcf63541640 1 -- 172.21.15.12:0/2212470862 wait complete. 2023-10-21T16:27:26.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.543+0000 7fcf63541640 1 Processor -- start 2023-10-21T16:27:26.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.544+0000 7fcf63541640 1 -- start start 2023-10-21T16:27:26.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.544+0000 7fcf63541640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 0x7fcf5c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.544+0000 7fcf63541640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf63541640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf63541640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1586e0 con 0x7fcf5c1500d0 2023-10-21T16:27:26.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf63541640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1eefe0 con 0x7fcf5c156530 2023-10-21T16:27:26.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf63541640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1eed00 con 0x7fcf5c071510 2023-10-21T16:27:26.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf61ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf612dd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 0x7fcf5c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.545+0000 7fcf60adc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.546+0000 7fcf61ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39304/0 (socket says 172.21.15.12:39304) 2023-10-21T16:27:26.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.546+0000 7fcf61ade640 1 -- 172.21.15.12:0/2452901082 learned_addr learned my addr 172.21.15.12:0/2452901082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:26.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.546+0000 7fcf612dd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 0x7fcf5c0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46750/0 (socket says 172.21.15.12:46750) 2023-10-21T16:27:26.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.549+0000 7fcf61ade640 1 -- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 msgr2=0x7fcf5c0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.549+0000 7fcf61ade640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 0x7fcf5c0cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.549+0000 7fcf61ade640 1 -- 172.21.15.12:0/2452901082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c1500d0 msgr2=0x7fcf5c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:26.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.549+0000 7fcf61ade640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:26.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.549+0000 7fcf61ade640 1 -- 172.21.15.12:0/2452901082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580094d0 con 0x7fcf5c156530 2023-10-21T16:27:26.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.551+0000 7fcf61ade640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400efc0 tx=0x7fcf5400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:26.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.554+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54009b10 con 0x7fcf5c156530 2023-10-21T16:27:26.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.555+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400f040 con 0x7fcf5c156530 2023-10-21T16:27:26.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.555+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540146c0 con 0x7fcf5c156530 2023-10-21T16:27:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.555+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0ca5c0 con 0x7fcf5c156530 2023-10-21T16:27:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.555+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0cab80 con 0x7fcf5c156530 2023-10-21T16:27:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.556+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0619f0 con 0x7fcf5c156530 2023-10-21T16:27:26.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.574+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf54014820 con 0x7fcf5c156530 2023-10-21T16:27:26.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.575+0000 7fcf51ffb640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 0x7fcf4006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:26.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.575+0000 7fcf612dd640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 0x7fcf4006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:26.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.576+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf54059600 con 0x7fcf5c156530 2023-10-21T16:27:26.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.576+0000 7fcf612dd640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 0x7fcf4006d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf58038000 tx=0x7fcf58032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:26.812+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf54055940 con 0x7fcf5c156530 2023-10-21T16:27:27.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.018+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcf5c071ed0 con 0x7fcf5c156530 2023-10-21T16:27:27.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.024+0000 7fcf51ffb640 1 -- 172.21.15.12:0/2452901082 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcf54018070 con 0x7fcf5c156530 2023-10-21T16:27:27.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:27.025 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-21T16:27:27.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-21T16:27:27.025 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-21T16:27:27.026 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-21T16:27:27.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-21T16:27:27.026 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-21T16:27:27.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.026+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 msgr2=0x7fcf4006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.026+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 0x7fcf4006d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf58038000 tx=0x7fcf58032000 comp rx=0 tx=0).stop 2023-10-21T16:27:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.026+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 msgr2=0x7fcf5c0c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.026+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400efc0 tx=0x7fcf5400c490 comp rx=0 tx=0).stop 2023-10-21T16:27:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 shutdown_connections 2023-10-21T16:27:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf4006aec0 0x7fcf4006d380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf5c156530 0x7fcf5c0c6850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c1500d0 0x7fcf5c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 --2- 172.21.15.12:0/2452901082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf5c071510 0x7fcf5c0cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 >> 172.21.15.12:0/2452901082 conn(0x7fcf5c069de0 msgr2=0x7fcf5c0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:27.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 shutdown_connections 2023-10-21T16:27:27.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.027+0000 7fcf63541640 1 -- 172.21.15.12:0/2452901082 wait complete. 2023-10-21T16:27:27.046 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-21T16:27:27.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-21T16:27:27.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.270+0000 7f1396df4640 1 Processor -- start 2023-10-21T16:27:27.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.271+0000 7f1396df4640 1 -- start start 2023-10-21T16:27:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.272+0000 7f1396df4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f139006ebc0 0x7f13900c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.272+0000 7f1396df4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13900c5e20 con 0x7f1390151070 2023-10-21T16:27:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.272+0000 7f1396df4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13900c60c0 con 0x7f139006b4a0 2023-10-21T16:27:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.272+0000 7f1396df4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1390156cc0 con 0x7f139006ebc0 2023-10-21T16:27:27.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.273+0000 7f13955f1640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f139006b4a0 0x7f139015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:40970/0 (socket says 172.21.15.12:40970) 2023-10-21T16:27:27.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.273+0000 7f13955f1640 1 -- 172.21.15.12:0/698097331 learned_addr learned my addr 172.21.15.12:0/698097331 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:27.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.276+0000 7f13965f3640 1 --2- 172.21.15.12:0/698097331 >> v2:172.21.15.99:3300/0 conn(0x7f139006ebc0 0x7f13900c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:27.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.276+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39727495 0 0) 0x7f13900c60c0 con 0x7f139006b4a0 2023-10-21T16:27:27.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.277+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f137c003520 con 0x7f139006b4a0 2023-10-21T16:27:27.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.279+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160616824 0 0) 0x7f13900c5e20 con 0x7f1390151070 2023-10-21T16:27:27.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.279+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13900c60c0 con 0x7f1390151070 2023-10-21T16:27:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.282+0000 7f13965f3640 1 -- 172.21.15.12:0/698097331 >> v1:172.21.15.99:6789/0 conn(0x7f139006b4a0 legacy=0x7f139015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.282+0000 7f13965f3640 1 -- 172.21.15.12:0/698097331 >> v1:172.21.15.12:6789/0 conn(0x7f1390151070 legacy=0x7f13900c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.282+0000 7f13965f3640 1 -- 172.21.15.12:0/698097331 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390156ed0 con 0x7f139006ebc0 2023-10-21T16:27:27.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.286+0000 7f13965f3640 1 --2- 172.21.15.12:0/698097331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139006ebc0 0x7f13900c7560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388009d90 tx=0x7f138802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a30bcc842b2f10a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:27.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.290+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138802cc60 con 0x7f139006ebc0 2023-10-21T16:27:27.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.290+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138802cdc0 con 0x7f139006ebc0 2023-10-21T16:27:27.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.290+0000 7f1394df0640 1 -- 172.21.15.12:0/698097331 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388034660 con 0x7f139006ebc0 2023-10-21T16:27:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 -- 172.21.15.12:0/698097331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139006ebc0 msgr2=0x7f13900c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 --2- 172.21.15.12:0/698097331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139006ebc0 0x7f13900c7560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388009d90 tx=0x7f138802beb0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 -- 172.21.15.12:0/698097331 shutdown_connections 2023-10-21T16:27:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 --2- 172.21.15.12:0/698097331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139006ebc0 0x7f13900c7560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 -- 172.21.15.12:0/698097331 >> 172.21.15.12:0/698097331 conn(0x7f1390070c40 msgr2=0x7f1390071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 -- 172.21.15.12:0/698097331 shutdown_connections 2023-10-21T16:27:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.291+0000 7f1396df4640 1 -- 172.21.15.12:0/698097331 wait complete. 2023-10-21T16:27:27.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.294+0000 7f1396df4640 1 Processor -- start 2023-10-21T16:27:27.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.294+0000 7f1396df4640 1 -- start start 2023-10-21T16:27:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f139006b4a0 0x7f13901413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f139006ebc0 0x7f13901ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139014cc30 con 0x7f139006b4a0 2023-10-21T16:27:27.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139014c320 con 0x7f1390151070 2023-10-21T16:27:27.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.296+0000 7f1396df4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1390151750 con 0x7f139006ebc0 2023-10-21T16:27:27.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.297+0000 7f1395df2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f139006b4a0 0x7f13901413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:27.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.297+0000 7f13965f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:27.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.297+0000 7f13955f1640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f139006ebc0 0x7f13901ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:27.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.297+0000 7f13965f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:39318/0 (socket says 172.21.15.12:39318) 2023-10-21T16:27:27.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.297+0000 7f13965f3640 1 -- 172.21.15.12:0/290497091 learned_addr learned my addr 172.21.15.12:0/290497091 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:27.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.300+0000 7f13965f3640 1 -- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f139006ebc0 msgr2=0x7f13901ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.300+0000 7f13965f3640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f139006ebc0 0x7f13901ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.300+0000 7f13965f3640 1 -- 172.21.15.12:0/290497091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f139006b4a0 msgr2=0x7f13901413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:27.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.300+0000 7f13965f3640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f139006b4a0 0x7f13901413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:27.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.300+0000 7f13965f3640 1 -- 172.21.15.12:0/290497091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009a70 con 0x7f1390151070 2023-10-21T16:27:27.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.303+0000 7f13965f3640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1388009d90 tx=0x7f1388004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:27.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.305+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388040650 con 0x7f1390151070 2023-10-21T16:27:27.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.305+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1390151a30 con 0x7f1390151070 2023-10-21T16:27:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.305+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139014c8c0 con 0x7f1390151070 2023-10-21T16:27:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.306+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388009450 con 0x7f1390151070 2023-10-21T16:27:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.306+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139014cda0 con 0x7f1390151070 2023-10-21T16:27:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.306+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880409b0 con 0x7f1390151070 2023-10-21T16:27:27.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.556+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1388040b10 con 0x7f1390151070 2023-10-21T16:27:27.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.558+0000 7f13867fc640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 0x7f137406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:27.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.559+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13880ac490 con 0x7f1390151070 2023-10-21T16:27:27.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.559+0000 7f1395df2640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 0x7f137406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:27.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.560+0000 7f1395df2640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 0x7f137406d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f138c0011e0 tx=0x7f138c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.568+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1388077bd0 con 0x7f1390151070 2023-10-21T16:27:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:27.790+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f139006e170 con 0x7f1390151070 2023-10-21T16:27:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.156+0000 7f13867fc640 1 -- 172.21.15.12:0/290497091 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f138807b1f0 con 0x7f1390151070 2023-10-21T16:27:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-21T16:27:29.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.159+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 msgr2=0x7f137406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.159+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 0x7f137406d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f138c0011e0 tx=0x7f138c009040 comp rx=0 tx=0).stop 2023-10-21T16:27:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.159+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 msgr2=0x7f139013f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.159+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1388009d90 tx=0x7f1388004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 shutdown_connections 2023-10-21T16:27:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f137406aea0 0x7f137406d360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1390151070 0x7f139013f380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f139006ebc0 0x7f13901ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 --2- 172.21.15.12:0/290497091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f139006b4a0 0x7f13901413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 >> 172.21.15.12:0/290497091 conn(0x7f1390070c40 msgr2=0x7f1390155740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 shutdown_connections 2023-10-21T16:27:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.160+0000 7f1396df4640 1 -- 172.21.15.12:0/290497091 wait complete. 2023-10-21T16:27:29.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-21T16:27:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.414+0000 7fc362cdf640 1 Processor -- start 2023-10-21T16:27:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.414+0000 7fc362cdf640 1 -- start start 2023-10-21T16:27:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc35c0c6af0 0x7fc35c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc35c0c3fb0 0x7fc35c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0c59a0 con 0x7fc35c0c3fb0 2023-10-21T16:27:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0c4d10 con 0x7fc35c0c6af0 2023-10-21T16:27:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.416+0000 7fc362cdf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1512e0 con 0x7fc35c150f00 2023-10-21T16:27:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.417+0000 7fc361cdd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.417+0000 7fc3614dc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc35c0c6af0 0x7fc35c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.417+0000 7fc3624de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc35c0c3fb0 0x7fc35c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.417+0000 7fc361cdd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46768/0 (socket says 172.21.15.12:46768) 2023-10-21T16:27:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.417+0000 7fc361cdd640 1 -- 172.21.15.12:0/2167476141 learned_addr learned my addr 172.21.15.12:0/2167476141 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc3614dc640 1 -- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 msgr2=0x7fc35c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc3614dc640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc3614dc640 1 -- 172.21.15.12:0/2167476141 >> v2:172.21.15.12:3300/0 conn(0x7fc35c0c3fb0 msgr2=0x7fc35c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc3614dc640 1 --2- 172.21.15.12:0/2167476141 >> v2:172.21.15.12:3300/0 conn(0x7fc35c0c3fb0 0x7fc35c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc3614dc640 1 -- 172.21.15.12:0/2167476141 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0c78f0 con 0x7fc35c0c6af0 2023-10-21T16:27:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.419+0000 7fc361cdd640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:27:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.421+0000 7fc3614dc640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c0c3a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0c4640 tx=0x7fc34c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0dae90104869612 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.425+0000 7fc360cdb640 1 -- 172.21.15.12:0/2167476141 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c02e070 con 0x7fc35c0c6af0 2023-10-21T16:27:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.425+0000 7fc360cdb640 1 -- 172.21.15.12:0/2167476141 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0315a0 con 0x7fc35c0c6af0 2023-10-21T16:27:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.425+0000 7fc360cdb640 1 -- 172.21.15.12:0/2167476141 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c031930 con 0x7fc35c0c6af0 2023-10-21T16:27:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 -- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 msgr2=0x7fc35c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c0c3a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0c4640 tx=0x7fc34c02b840 comp rx=0 tx=0).stop 2023-10-21T16:27:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 -- 172.21.15.12:0/2167476141 shutdown_connections 2023-10-21T16:27:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 --2- 172.21.15.12:0/2167476141 >> v2:172.21.15.12:3300/0 conn(0x7fc35c0c3fb0 0x7fc35c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c0c3a70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 --2- 172.21.15.12:0/2167476141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c150f00 0x7fc35c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 -- 172.21.15.12:0/2167476141 >> 172.21.15.12:0/2167476141 conn(0x7fc35c065ab0 msgr2=0x7fc35c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 -- 172.21.15.12:0/2167476141 shutdown_connections 2023-10-21T16:27:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.426+0000 7fc362cdf640 1 -- 172.21.15.12:0/2167476141 wait complete. 2023-10-21T16:27:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.428+0000 7fc362cdf640 1 Processor -- start 2023-10-21T16:27:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.428+0000 7fc362cdf640 1 -- start start 2023-10-21T16:27:29.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 0x7fc35c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 0x7fc35c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1ef040 con 0x7fc35c150f00 2023-10-21T16:27:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1ef530 con 0x7fc35c0c6af0 2023-10-21T16:27:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc362cdf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c159820 con 0x7fc35c0c3fb0 2023-10-21T16:27:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc361cdd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 0x7fc35c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.429+0000 7fc3614dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.430+0000 7fc3624de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 0x7fc35c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.430+0000 7fc361cdd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 0x7fc35c1516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46778/0 (socket says 172.21.15.12:46778) 2023-10-21T16:27:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.430+0000 7fc361cdd640 1 -- 172.21.15.12:0/771250774 learned_addr learned my addr 172.21.15.12:0/771250774 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.434+0000 7fc3624de640 1 -- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 msgr2=0x7fc35c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.434+0000 7fc3624de640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 0x7fc35c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.434+0000 7fc3624de640 1 -- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 msgr2=0x7fc35c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.434+0000 7fc3624de640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.434+0000 7fc3624de640 1 -- 172.21.15.12:0/771250774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009460 con 0x7fc35c150f00 2023-10-21T16:27:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.437+0000 7fc3624de640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 0x7fc35c15ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc35400efc0 tx=0x7fc35400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.442+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354009c00 con 0x7fc35c150f00 2023-10-21T16:27:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.442+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400f040 con 0x7fc35c150f00 2023-10-21T16:27:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.442+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540146c0 con 0x7fc35c150f00 2023-10-21T16:27:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.442+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c009400 con 0x7fc35c150f00 2023-10-21T16:27:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.442+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c066030 con 0x7fc35c150f00 2023-10-21T16:27:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.444+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c151510 con 0x7fc35c150f00 2023-10-21T16:27:29.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.471+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc354014820 con 0x7fc35c150f00 2023-10-21T16:27:29.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.472+0000 7fc3527fc640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 0x7fc34006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:29.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.472+0000 7fc361cdd640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 0x7fc34006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:29.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.473+0000 7fc361cdd640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 0x7fc34006d3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c60 tx=0x7fc358009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:29.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.477+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc354059760 con 0x7fc35c150f00 2023-10-21T16:27:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.775+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc354055aa0 con 0x7fc35c150f00 2023-10-21T16:27:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:29.986+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc35c067560 con 0x7fc35c150f00 2023-10-21T16:27:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.359+0000 7fc3527fc640 1 -- 172.21.15.12:0/771250774 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc354018020 con 0x7fc35c150f00 2023-10-21T16:27:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-21T16:27:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 msgr2=0x7fc34006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 0x7fc34006d3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c60 tx=0x7fc358009210 comp rx=0 tx=0).stop 2023-10-21T16:27:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 msgr2=0x7fc35c15ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 0x7fc35c15ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc35400efc0 tx=0x7fc35400c490 comp rx=0 tx=0).stop 2023-10-21T16:27:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 shutdown_connections 2023-10-21T16:27:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc34006aef0 0x7fc34006d3b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc35c150f00 0x7fc35c15ab40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc35c0c6af0 0x7fc35c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 --2- 172.21.15.12:0/771250774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc35c0c3fb0 0x7fc35c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 >> 172.21.15.12:0/771250774 conn(0x7fc35c065ab0 msgr2=0x7fc35c06de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 shutdown_connections 2023-10-21T16:27:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.363+0000 7fc362cdf640 1 -- 172.21.15.12:0/771250774 wait complete. 2023-10-21T16:27:30.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-21T16:27:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.582+0000 7fa686f0f640 1 Processor -- start 2023-10-21T16:27:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.583+0000 7fa686f0f640 1 -- start start 2023-10-21T16:27:30.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.584+0000 7fa686f0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.584+0000 7fa686f0f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa6800c7540 0x7fa6800c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.584+0000 7fa686f0f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa680159430 con 0x7fa6801531e0 2023-10-21T16:27:30.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.584+0000 7fa686f0f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6801596f0 con 0x7fa6800c7540 2023-10-21T16:27:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.584+0000 7fa686f0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6801599d0 con 0x7fa6801535c0 2023-10-21T16:27:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.585+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.585+0000 7fa6854ac640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa6800c7540 0x7fa6800c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.585+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46790/0 (socket says 172.21.15.12:46790) 2023-10-21T16:27:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.585+0000 7fa67ffff640 1 -- 172.21.15.12:0/3481658452 learned_addr learned my addr 172.21.15.12:0/3481658452 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.587+0000 7fa67ffff640 1 -- 172.21.15.12:0/3481658452 >> v2:172.21.15.99:3300/0 conn(0x7fa6800c7540 msgr2=0x7fa6800c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.587+0000 7fa67ffff640 1 --2- 172.21.15.12:0/3481658452 >> v2:172.21.15.99:3300/0 conn(0x7fa6800c7540 0x7fa6800c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.587+0000 7fa67ffff640 1 -- 172.21.15.12:0/3481658452 >> v1:172.21.15.99:6789/0 conn(0x7fa6801531e0 legacy=0x7fa68006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.587+0000 7fa67ffff640 1 -- 172.21.15.12:0/3481658452 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680159cb0 con 0x7fa6801535c0 2023-10-21T16:27:30.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.590+0000 7fa67ffff640 1 --2- 172.21.15.12:0/3481658452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41c1d0752fdae8c server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.593+0000 7fa67f7fe640 1 -- 172.21.15.12:0/3481658452 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c030840 con 0x7fa6801535c0 2023-10-21T16:27:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.593+0000 7fa67f7fe640 1 -- 172.21.15.12:0/3481658452 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0309a0 con 0x7fa6801535c0 2023-10-21T16:27:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.593+0000 7fa67f7fe640 1 -- 172.21.15.12:0/3481658452 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c030d30 con 0x7fa6801535c0 2023-10-21T16:27:30.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 -- 172.21.15.12:0/3481658452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 msgr2=0x7fa6800c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3481658452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c02b980 comp rx=0 tx=0).stop 2023-10-21T16:27:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 -- 172.21.15.12:0/3481658452 shutdown_connections 2023-10-21T16:27:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3481658452 >> v2:172.21.15.99:3300/0 conn(0x7fa6800c7540 0x7fa6800c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3481658452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6801535c0 0x7fa6800c83d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 -- 172.21.15.12:0/3481658452 >> 172.21.15.12:0/3481658452 conn(0x7fa68006b0d0 msgr2=0x7fa68006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 -- 172.21.15.12:0/3481658452 shutdown_connections 2023-10-21T16:27:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.594+0000 7fa686f0f640 1 -- 172.21.15.12:0/3481658452 wait complete. 2023-10-21T16:27:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.596+0000 7fa686f0f640 1 Processor -- start 2023-10-21T16:27:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.597+0000 7fa686f0f640 1 -- start start 2023-10-21T16:27:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.597+0000 7fa686f0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.597+0000 7fa686f0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6801531e0 0x7fa68014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa686f0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6801535c0 0x7fa68014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa686f0f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015c1d0 con 0x7fa6801531e0 2023-10-21T16:27:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa686f0f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015bc10 con 0x7fa6801535c0 2023-10-21T16:27:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa686f0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015bef0 con 0x7fa6800c7540 2023-10-21T16:27:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa684cab640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa6854ac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6801535c0 0x7fa68014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa684cab640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:46802/0 (socket says 172.21.15.12:46802) 2023-10-21T16:27:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.598+0000 7fa684cab640 1 -- 172.21.15.12:0/3952373668 learned_addr learned my addr 172.21.15.12:0/3952373668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.602+0000 7fa684cab640 1 -- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6801535c0 msgr2=0x7fa68014a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.602+0000 7fa684cab640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6801535c0 0x7fa68014a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.602+0000 7fa684cab640 1 -- 172.21.15.12:0/3952373668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6801531e0 msgr2=0x7fa68014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.602+0000 7fa684cab640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6801531e0 0x7fa68014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.602+0000 7fa684cab640 1 -- 172.21.15.12:0/3952373668 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0094d0 con 0x7fa6800c7540 2023-10-21T16:27:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.604+0000 7fa684cab640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c450 tx=0x7fa67400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.607+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740052d0 con 0x7fa6800c7540 2023-10-21T16:27:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.607+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674005430 con 0x7fa6800c7540 2023-10-21T16:27:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.607+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674012870 con 0x7fa6800c7540 2023-10-21T16:27:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.607+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6801eea20 con 0x7fa6800c7540 2023-10-21T16:27:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.608+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6801eefe0 con 0x7fa6800c7540 2023-10-21T16:27:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.609+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa680067560 con 0x7fa6800c7540 2023-10-21T16:27:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.885+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6740129d0 con 0x7fa6800c7540 2023-10-21T16:27:30.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.888+0000 7fa67d7fa640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 0x7fa66406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:30.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.888+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa674089a40 con 0x7fa6800c7540 2023-10-21T16:27:30.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.888+0000 7fa67ffff640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 0x7fa66406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:30.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.889+0000 7fa67ffff640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 0x7fa66406d380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa66c036000 tx=0x7fa66c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:30.900+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa674054c30 con 0x7fa6800c7540 2023-10-21T16:27:31.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:31.143+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa680070f10 con 0x7fa6800c7540 2023-10-21T16:27:32.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.772+0000 7fa67d7fa640 1 -- 172.21.15.12:0/3952373668 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa674058250 con 0x7fa6800c7540 2023-10-21T16:27:32.774 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2023-10-21T16:27:32.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 msgr2=0x7fa66406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:32.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 0x7fa66406d380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa66c036000 tx=0x7fa66c03b040 comp rx=0 tx=0).stop 2023-10-21T16:27:32.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 msgr2=0x7fa680149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:32.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c450 tx=0x7fa67400c910 comp rx=0 tx=0).stop 2023-10-21T16:27:32.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 shutdown_connections 2023-10-21T16:27:32.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa66406aec0 0x7fa66406d380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:32.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6801535c0 0x7fa68014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:32.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6801531e0 0x7fa68014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:32.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 --2- 172.21.15.12:0/3952373668 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6800c7540 0x7fa680149f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:32.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 >> 172.21.15.12:0/3952373668 conn(0x7fa68006b0d0 msgr2=0x7fa680149520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:32.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 shutdown_connections 2023-10-21T16:27:32.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:32.776+0000 7fa686f0f640 1 -- 172.21.15.12:0/3952373668 wait complete. 2023-10-21T16:27:32.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.011+0000 7f8363b6c640 1 Processor -- start 2023-10-21T16:27:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.012+0000 7f8363b6c640 1 -- start start 2023-10-21T16:27:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.013+0000 7f8363b6c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f835c0c8ca0 0x7f835c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.013+0000 7f8363b6c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f835c0ca760 0x7f835c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.013+0000 7f8363b6c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c0cab90 con 0x7f835c14f6a0 2023-10-21T16:27:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.013+0000 7f8363b6c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c0c61d0 con 0x7f835c0ca760 2023-10-21T16:27:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.013+0000 7f8363b6c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c0c1000 con 0x7f835c0c8ca0 2023-10-21T16:27:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.014+0000 7f8361107640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f835c0c8ca0 0x7f835c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.014+0000 7f8361908640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f835c14f6a0 0x7f835c0c08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:36510/0 (socket says 172.21.15.12:36510) 2023-10-21T16:27:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.014+0000 7f8361908640 1 -- 172.21.15.12:0/2463819194 learned_addr learned my addr 172.21.15.12:0/2463819194 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.017+0000 7f8361107640 1 -- 172.21.15.12:0/2463819194 >> v2:172.21.15.12:3300/0 conn(0x7f835c0ca760 msgr2=0x7f835c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.017+0000 7f8361107640 1 --2- 172.21.15.12:0/2463819194 >> v2:172.21.15.12:3300/0 conn(0x7f835c0ca760 0x7f835c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.017+0000 7f8361107640 1 -- 172.21.15.12:0/2463819194 >> v1:172.21.15.99:6789/0 conn(0x7f835c14f6a0 legacy=0x7f835c0c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.017+0000 7f8361107640 1 -- 172.21.15.12:0/2463819194 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0c9d90 con 0x7f835c0c8ca0 2023-10-21T16:27:33.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.022+0000 7f8361107640 1 --2- 172.21.15.12:0/2463819194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c0c8ca0 0x7f835c0c5810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f835c06caf0 tx=0x7f835002ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc779602ac57b461 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.026+0000 7f8360906640 1 -- 172.21.15.12:0/2463819194 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835002e830 con 0x7f835c0c8ca0 2023-10-21T16:27:33.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.026+0000 7f8360906640 1 -- 172.21.15.12:0/2463819194 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835002e990 con 0x7f835c0c8ca0 2023-10-21T16:27:33.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.026+0000 7f8360906640 1 -- 172.21.15.12:0/2463819194 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835002ed20 con 0x7f835c0c8ca0 2023-10-21T16:27:33.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 -- 172.21.15.12:0/2463819194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c0c8ca0 msgr2=0x7f835c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 --2- 172.21.15.12:0/2463819194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c0c8ca0 0x7f835c0c5810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f835c06caf0 tx=0x7f835002ca70 comp rx=0 tx=0).stop 2023-10-21T16:27:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 -- 172.21.15.12:0/2463819194 shutdown_connections 2023-10-21T16:27:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 --2- 172.21.15.12:0/2463819194 >> v2:172.21.15.12:3300/0 conn(0x7f835c0ca760 0x7f835c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 --2- 172.21.15.12:0/2463819194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c0c8ca0 0x7f835c0c5810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.027+0000 7f8363b6c640 1 -- 172.21.15.12:0/2463819194 >> 172.21.15.12:0/2463819194 conn(0x7f835c0cb200 msgr2=0x7f835c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.028+0000 7f8363b6c640 1 -- 172.21.15.12:0/2463819194 shutdown_connections 2023-10-21T16:27:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.028+0000 7f8363b6c640 1 -- 172.21.15.12:0/2463819194 wait complete. 2023-10-21T16:27:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.029+0000 7f8363b6c640 1 Processor -- start 2023-10-21T16:27:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.030+0000 7f8363b6c640 1 -- start start 2023-10-21T16:27:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f835c0ca760 0x7f835c1de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c14f6a0 0x7f835c1de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1dde50 con 0x7f835c0ca760 2023-10-21T16:27:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1ea870 con 0x7f835c14f6a0 2023-10-21T16:27:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8363b6c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1df580 con 0x7f835c0c8ca0 2023-10-21T16:27:33.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.031+0000 7f8361908640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.032+0000 7f8361908640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54204/0 (socket says 172.21.15.12:54204) 2023-10-21T16:27:33.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.032+0000 7f8361908640 1 -- 172.21.15.12:0/3738955333 learned_addr learned my addr 172.21.15.12:0/3738955333 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.032+0000 7f8362109640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c14f6a0 0x7f835c1de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.035+0000 7f8361908640 1 -- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c14f6a0 msgr2=0x7f835c1de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.035+0000 7f8361908640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c14f6a0 0x7f835c1de820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.035+0000 7f8361908640 1 -- 172.21.15.12:0/3738955333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f835c0ca760 msgr2=0x7f835c1de2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.035+0000 7f8361908640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f835c0ca760 0x7f835c1de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.035+0000 7f8361908640 1 -- 172.21.15.12:0/3738955333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009400 con 0x7f835c0c8ca0 2023-10-21T16:27:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.039+0000 7f8361908640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f834c00cba0 tx=0x7f834c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.043+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ad40 con 0x7f835c0c8ca0 2023-10-21T16:27:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.043+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c012400 con 0x7f835c0c8ca0 2023-10-21T16:27:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.043+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00aea0 con 0x7f835c0c8ca0 2023-10-21T16:27:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.043+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c1dd800 con 0x7f835c0c8ca0 2023-10-21T16:27:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.044+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c1ea540 con 0x7f835c0c8ca0 2023-10-21T16:27:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.045+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c0671f0 con 0x7f835c0c8ca0 2023-10-21T16:27:33.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.064+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f834c007070 con 0x7f835c0c8ca0 2023-10-21T16:27:33.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.065+0000 7f835a7fc640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 0x7f834806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.065+0000 7f8361107640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 0x7f834806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.066+0000 7f8361107640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 0x7f834806d3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8350037000 tx=0x7f8350031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.066+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f834c058820 con 0x7f835c0c8ca0 2023-10-21T16:27:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.302+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f834c054b60 con 0x7f835c0c8ca0 2023-10-21T16:27:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.507+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f835c0619f0 con 0x7f835c0c8ca0 2023-10-21T16:27:33.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.550+0000 7f835a7fc640 1 -- 172.21.15.12:0/3738955333 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f834c017090 con 0x7f835c0c8ca0 2023-10-21T16:27:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:33.552 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:33.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 msgr2=0x7f834806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 0x7f834806d3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8350037000 tx=0x7f8350031000 comp rx=0 tx=0).stop 2023-10-21T16:27:33.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 msgr2=0x7f835c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f834c00cba0 tx=0x7f834c00a430 comp rx=0 tx=0).stop 2023-10-21T16:27:33.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 shutdown_connections 2023-10-21T16:27:33.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f834806aef0 0x7f834806d3b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f835c14f6a0 0x7f835c1de820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f835c0ca760 0x7f835c1de2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 --2- 172.21.15.12:0/3738955333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f835c0c8ca0 0x7f835c0718c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 >> 172.21.15.12:0/3738955333 conn(0x7f835c0cb200 msgr2=0x7f835c1df8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:33.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 shutdown_connections 2023-10-21T16:27:33.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.553+0000 7f8363b6c640 1 -- 172.21.15.12:0/3738955333 wait complete. 2023-10-21T16:27:33.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.790+0000 7f6c2a283640 1 Processor -- start 2023-10-21T16:27:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.790+0000 7f6c2a283640 1 -- start start 2023-10-21T16:27:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.792+0000 7f6c2a283640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6c241510c0 0x7f6c240c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.792+0000 7f6c2a283640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240c7660 con 0x7f6c2415a800 2023-10-21T16:27:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.792+0000 7f6c2a283640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240c91e0 con 0x7f6c240c7150 2023-10-21T16:27:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.792+0000 7f6c2a283640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240c94c0 con 0x7f6c241510c0 2023-10-21T16:27:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.793+0000 7f6c23fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6c241510c0 0x7f6c240c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.793+0000 7f6c237fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6c240c7150 0x7f6c240c82b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:36512/0 (socket says 172.21.15.12:36512) 2023-10-21T16:27:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.793+0000 7f6c237fe640 1 -- 172.21.15.12:0/12802119 learned_addr learned my addr 172.21.15.12:0/12802119 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.796+0000 7f6c23fff640 1 -- 172.21.15.12:0/12802119 >> v1:172.21.15.99:6789/0 conn(0x7f6c240c7150 legacy=0x7f6c240c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.796+0000 7f6c23fff640 1 -- 172.21.15.12:0/12802119 >> v1:172.21.15.12:6789/0 conn(0x7f6c2415a800 legacy=0x7f6c2415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.796+0000 7f6c23fff640 1 -- 172.21.15.12:0/12802119 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240c97a0 con 0x7f6c241510c0 2023-10-21T16:27:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.800+0000 7f6c23fff640 1 --2- 172.21.15.12:0/12802119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c241510c0 0x7f6c240c1770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c140097a0 tx=0x7f6c1402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3e31a3db6171c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.804+0000 7f6c22ffd640 1 -- 172.21.15.12:0/12802119 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1402f810 con 0x7f6c241510c0 2023-10-21T16:27:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.804+0000 7f6c22ffd640 1 -- 172.21.15.12:0/12802119 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1402f970 con 0x7f6c241510c0 2023-10-21T16:27:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.804+0000 7f6c22ffd640 1 -- 172.21.15.12:0/12802119 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1402fd00 con 0x7f6c241510c0 2023-10-21T16:27:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 -- 172.21.15.12:0/12802119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c241510c0 msgr2=0x7f6c240c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 --2- 172.21.15.12:0/12802119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c241510c0 0x7f6c240c1770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c140097a0 tx=0x7f6c1402b9f0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 -- 172.21.15.12:0/12802119 shutdown_connections 2023-10-21T16:27:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 --2- 172.21.15.12:0/12802119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c241510c0 0x7f6c240c1770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 -- 172.21.15.12:0/12802119 >> 172.21.15.12:0/12802119 conn(0x7f6c24065ab0 msgr2=0x7f6c24065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 -- 172.21.15.12:0/12802119 shutdown_connections 2023-10-21T16:27:33.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.805+0000 7f6c2a283640 1 -- 172.21.15.12:0/12802119 wait complete. 2023-10-21T16:27:33.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.808+0000 7f6c2a283640 1 Processor -- start 2023-10-21T16:27:33.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.808+0000 7f6c2a283640 1 -- start start 2023-10-21T16:27:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c240c7150 0x7f6c241edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c241510c0 0x7f6c240b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241f03f0 con 0x7f6c240c7150 2023-10-21T16:27:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c55a0 con 0x7f6c2415a800 2023-10-21T16:27:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.809+0000 7f6c2a283640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c5840 con 0x7f6c241510c0 2023-10-21T16:27:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.810+0000 7f6c28820640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.810+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c241510c0 0x7f6c240b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.810+0000 7f6c28820640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38416/0 (socket says 172.21.15.12:38416) 2023-10-21T16:27:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.810+0000 7f6c28820640 1 -- 172.21.15.12:0/1065514467 learned_addr learned my addr 172.21.15.12:0/1065514467 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:33.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.813+0000 7f6c28820640 1 -- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c241510c0 msgr2=0x7f6c240b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.813+0000 7f6c28820640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c241510c0 0x7f6c240b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.813+0000 7f6c28820640 1 -- 172.21.15.12:0/1065514467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c240c7150 msgr2=0x7f6c241edfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:33.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.813+0000 7f6c28820640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c240c7150 0x7f6c241edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:33.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.814+0000 7f6c28820640 1 -- 172.21.15.12:0/1065514467 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14009400 con 0x7f6c2415a800 2023-10-21T16:27:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.816+0000 7f6c28820640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c7d0 tx=0x7f6c1c00cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.819+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c003b70 con 0x7f6c2415a800 2023-10-21T16:27:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.819+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c003cf0 con 0x7f6c2415a800 2023-10-21T16:27:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.819+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00aa90 con 0x7f6c2415a800 2023-10-21T16:27:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.819+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c240c5b20 con 0x7f6c2415a800 2023-10-21T16:27:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.819+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c240c60e0 con 0x7f6c2415a800 2023-10-21T16:27:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.821+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c240c6300 con 0x7f6c2415a800 2023-10-21T16:27:33.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.839+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c1c00abf0 con 0x7f6c2415a800 2023-10-21T16:27:33.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.840+0000 7f6c20ff9640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 0x7f6c10071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:33.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.840+0000 7f6c23fff640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 0x7f6c10071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:33.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.841+0000 7f6c23fff640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 0x7f6c10071790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c14036000 tx=0x7f6c14039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:33.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:33.841+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c1c0592e0 con 0x7f6c2415a800 2023-10-21T16:27:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.080+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c1c054f20 con 0x7f6c2415a800 2023-10-21T16:27:34.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.297+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c240619f0 con 0x7f6c2415a800 2023-10-21T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.455+0000 7f6c20ff9640 1 -- 172.21.15.12:0/1065514467 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f6c1c003e60 con 0x7f6c2415a800 2023-10-21T16:27:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:34.457 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:34.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 msgr2=0x7f6c10071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 0x7f6c10071790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c14036000 tx=0x7f6c14039040 comp rx=0 tx=0).stop 2023-10-21T16:27:34.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 msgr2=0x7f6c241413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c7d0 tx=0x7f6c1c00cc90 comp rx=0 tx=0).stop 2023-10-21T16:27:34.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 shutdown_connections 2023-10-21T16:27:34.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6c1006f2d0 0x7f6c10071790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c2415a800 0x7f6c241413e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c241510c0 0x7f6c240b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 --2- 172.21.15.12:0/1065514467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c240c7150 0x7f6c241edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.460+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 >> 172.21.15.12:0/1065514467 conn(0x7f6c24065ab0 msgr2=0x7f6c240cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:34.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.461+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 shutdown_connections 2023-10-21T16:27:34.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.461+0000 7f6c2a283640 1 -- 172.21.15.12:0/1065514467 wait complete. 2023-10-21T16:27:34.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-21T16:27:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.710+0000 7fd1056e5640 1 Processor -- start 2023-10-21T16:27:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.711+0000 7fd1056e5640 1 -- start start 2023-10-21T16:27:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.712+0000 7fd1056e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.712+0000 7fd1056e5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1000c9740 0x7fd1000c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd1056e5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd100159370 con 0x7fd1000ce730 2023-10-21T16:27:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd1056e5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000ca130 con 0x7fd1000c9740 2023-10-21T16:27:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd1056e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001535b0 con 0x7fd1001531d0 2023-10-21T16:27:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd104ee4640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd1000ce730 0x7fd10015c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:36514/0 (socket says 172.21.15.12:36514) 2023-10-21T16:27:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.713+0000 7fd104ee4640 1 -- 172.21.15.12:0/2342318888 learned_addr learned my addr 172.21.15.12:0/2342318888 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.714+0000 7fd0f7fff640 1 --2- 172.21.15.12:0/2342318888 >> v2:172.21.15.12:3300/0 conn(0x7fd1000c9740 0x7fd1000c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.716+0000 7fd0fffff640 1 -- 172.21.15.12:0/2342318888 >> v2:172.21.15.12:3300/0 conn(0x7fd1000c9740 msgr2=0x7fd1000c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.716+0000 7fd0fffff640 1 --2- 172.21.15.12:0/2342318888 >> v2:172.21.15.12:3300/0 conn(0x7fd1000c9740 0x7fd1000c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.716+0000 7fd0fffff640 1 -- 172.21.15.12:0/2342318888 >> v1:172.21.15.99:6789/0 conn(0x7fd1000ce730 legacy=0x7fd10015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.716+0000 7fd0fffff640 1 -- 172.21.15.12:0/2342318888 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100159600 con 0x7fd1001531d0 2023-10-21T16:27:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.718+0000 7fd0fffff640 1 --2- 172.21.15.12:0/2342318888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100158e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097a0 tx=0x7fd0f002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e9cf513cae0e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.722+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/2342318888 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0030800 con 0x7fd1001531d0 2023-10-21T16:27:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.722+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/2342318888 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0030960 con 0x7fd1001531d0 2023-10-21T16:27:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.722+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/2342318888 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0030cf0 con 0x7fd1001531d0 2023-10-21T16:27:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 -- 172.21.15.12:0/2342318888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 msgr2=0x7fd100158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 --2- 172.21.15.12:0/2342318888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100158e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097a0 tx=0x7fd0f002b940 comp rx=0 tx=0).stop 2023-10-21T16:27:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 -- 172.21.15.12:0/2342318888 shutdown_connections 2023-10-21T16:27:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 --2- 172.21.15.12:0/2342318888 >> v2:172.21.15.12:3300/0 conn(0x7fd1000c9740 0x7fd1000c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 --2- 172.21.15.12:0/2342318888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100158e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 -- 172.21.15.12:0/2342318888 >> 172.21.15.12:0/2342318888 conn(0x7fd100071510 msgr2=0x7fd1000718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 -- 172.21.15.12:0/2342318888 shutdown_connections 2023-10-21T16:27:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.723+0000 7fd1056e5640 1 -- 172.21.15.12:0/2342318888 wait complete. 2023-10-21T16:27:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.725+0000 7fd1056e5640 1 Processor -- start 2023-10-21T16:27:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.725+0000 7fd1056e5640 1 -- start start 2023-10-21T16:27:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1000c9740 0x7fd1000cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001e3ed0 con 0x7fd1000c9740 2023-10-21T16:27:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001e4680 con 0x7fd1000ce730 2023-10-21T16:27:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.726+0000 7fd1056e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001e4960 con 0x7fd1001531d0 2023-10-21T16:27:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1000c9740 0x7fd1000cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd0f7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd104ee4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd104ee4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54246/0 (socket says 172.21.15.12:54246) 2023-10-21T16:27:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd0f7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38426/0 (socket says 172.21.15.12:38426) 2023-10-21T16:27:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.727+0000 7fd104ee4640 1 -- 172.21.15.12:0/928212593 learned_addr learned my addr 172.21.15.12:0/928212593 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.731+0000 7fd0f7fff640 1 -- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 msgr2=0x7fd100142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.731+0000 7fd0f7fff640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.731+0000 7fd0f7fff640 1 -- 172.21.15.12:0/928212593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1000c9740 msgr2=0x7fd1000cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.731+0000 7fd0f7fff640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1000c9740 0x7fd1000cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.731+0000 7fd0f7fff640 1 -- 172.21.15.12:0/928212593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009400 con 0x7fd1000ce730 2023-10-21T16:27:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.733+0000 7fd0f7fff640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800e850 tx=0x7fd0e800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.736+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80095b0 con 0x7fd1000ce730 2023-10-21T16:27:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.736+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800c940 con 0x7fd1000ce730 2023-10-21T16:27:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.736+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800ccd0 con 0x7fd1000ce730 2023-10-21T16:27:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.736+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd100157110 con 0x7fd1000ce730 2023-10-21T16:27:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.737+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1001576d0 con 0x7fd1000ce730 2023-10-21T16:27:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.738+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd100156f70 con 0x7fd1000ce730 2023-10-21T16:27:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.986+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0e8013470 con 0x7fd1000ce730 2023-10-21T16:27:34.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.988+0000 7fd0fd7fa640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 0x7fd0e006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:34.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.989+0000 7fd0fffff640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 0x7fd0e006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.990+0000 7fd0fffff640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 0x7fd0e006d3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0036000 tx=0x7fd0f003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:34.998+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e800ce30 con 0x7fd1000ce730 2023-10-21T16:27:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:35.011+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0e8054e40 con 0x7fd1000ce730 2023-10-21T16:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:35.261+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd100156f70 con 0x7fd1000ce730 2023-10-21T16:27:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.646+0000 7fd0fd7fa640 1 -- 172.21.15.12:0/928212593 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd100156f70 con 0x7fd1000ce730 2023-10-21T16:27:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.650+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 msgr2=0x7fd0e006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.650+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 0x7fd0e006d3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0036000 tx=0x7fd0f003b040 comp rx=0 tx=0).stop 2023-10-21T16:27:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.650+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 msgr2=0x7fd100142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.650+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800e850 tx=0x7fd0e800ed10 comp rx=0 tx=0).stop 2023-10-21T16:27:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 shutdown_connections 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd0e006aef0 0x7fd0e006d3b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1001531d0 0x7fd100142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1000ce730 0x7fd100142130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 --2- 172.21.15.12:0/928212593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1000c9740 0x7fd1000cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 >> 172.21.15.12:0/928212593 conn(0x7fd100071510 msgr2=0x7fd100152060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 shutdown_connections 2023-10-21T16:27:36.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.651+0000 7fd1056e5640 1 -- 172.21.15.12:0/928212593 wait complete. 2023-10-21T16:27:36.673 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2023-10-21T16:27:36.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-21T16:27:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.901+0000 7f4a44863640 1 Processor -- start 2023-10-21T16:27:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.901+0000 7f4a44863640 1 -- start start 2023-10-21T16:27:36.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.903+0000 7f4a44863640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a40150f00 0x7f4a4015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.903+0000 7f4a44863640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.903+0000 7f4a44863640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a400c4d10 con 0x7f4a400c3fb0 2023-10-21T16:27:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.903+0000 7f4a44863640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400c59a0 con 0x7f4a40150f00 2023-10-21T16:27:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.903+0000 7f4a44863640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401512e0 con 0x7f4a400c6af0 2023-10-21T16:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.904+0000 7f4a37fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.904+0000 7f4a3ed9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a40150f00 0x7f4a4015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.904+0000 7f4a37fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54252/0 (socket says 172.21.15.12:54252) 2023-10-21T16:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.904+0000 7f4a3f59e640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4a400c3fb0 0x7f4a40156d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:36526/0 (socket says 172.21.15.12:36526) 2023-10-21T16:27:36.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.904+0000 7f4a37fff640 1 -- 172.21.15.12:0/107223834 learned_addr learned my addr 172.21.15.12:0/107223834 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.906+0000 7f4a37fff640 1 -- 172.21.15.12:0/107223834 >> v2:172.21.15.99:3300/0 conn(0x7f4a40150f00 msgr2=0x7f4a4015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.906+0000 7f4a37fff640 1 --2- 172.21.15.12:0/107223834 >> v2:172.21.15.99:3300/0 conn(0x7f4a40150f00 0x7f4a4015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.906+0000 7f4a37fff640 1 -- 172.21.15.12:0/107223834 >> v1:172.21.15.99:6789/0 conn(0x7f4a400c3fb0 legacy=0x7f4a40156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.906+0000 7f4a37fff640 1 -- 172.21.15.12:0/107223834 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400c78f0 con 0x7f4a400c6af0 2023-10-21T16:27:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.909+0000 7f4a37fff640 1 --2- 172.21.15.12:0/107223834 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dbc50e9d5d97e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:36.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.912+0000 7f4a3e59c640 1 -- 172.21.15.12:0/107223834 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28030840 con 0x7f4a400c6af0 2023-10-21T16:27:36.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.913+0000 7f4a3e59c640 1 -- 172.21.15.12:0/107223834 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280309a0 con 0x7f4a400c6af0 2023-10-21T16:27:36.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a3e59c640 1 -- 172.21.15.12:0/107223834 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28030d30 con 0x7f4a400c6af0 2023-10-21T16:27:36.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 -- 172.21.15.12:0/107223834 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 msgr2=0x7f4a400c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 --2- 172.21.15.12:0/107223834 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2802b980 comp rx=0 tx=0).stop 2023-10-21T16:27:36.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 -- 172.21.15.12:0/107223834 shutdown_connections 2023-10-21T16:27:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 --2- 172.21.15.12:0/107223834 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a400c3a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 --2- 172.21.15.12:0/107223834 >> v2:172.21.15.99:3300/0 conn(0x7f4a40150f00 0x7f4a4015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 -- 172.21.15.12:0/107223834 >> 172.21.15.12:0/107223834 conn(0x7f4a40065ab0 msgr2=0x7f4a40065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 -- 172.21.15.12:0/107223834 shutdown_connections 2023-10-21T16:27:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.914+0000 7f4a44863640 1 -- 172.21.15.12:0/107223834 wait complete. 2023-10-21T16:27:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.916+0000 7f4a44863640 1 Processor -- start 2023-10-21T16:27:36.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.916+0000 7f4a44863640 1 -- start start 2023-10-21T16:27:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.917+0000 7f4a44863640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a400c3fb0 0x7f4a40154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.917+0000 7f4a44863640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.917+0000 7f4a44863640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 0x7f4a401e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:36.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a44863640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401e2a10 con 0x7f4a400c3fb0 2023-10-21T16:27:36.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a44863640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401ef120 con 0x7f4a40150f00 2023-10-21T16:27:36.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a44863640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401ef650 con 0x7f4a400c6af0 2023-10-21T16:27:36.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a400c3fb0 0x7f4a40154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:36.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a3f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 0x7f4a401e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a37fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a37fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54254/0 (socket says 172.21.15.12:54254) 2023-10-21T16:27:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a37fff640 1 -- 172.21.15.12:0/124730690 learned_addr learned my addr 172.21.15.12:0/124730690 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.918+0000 7f4a3f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 0x7f4a401e5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38446/0 (socket says 172.21.15.12:38446) 2023-10-21T16:27:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.922+0000 7f4a37fff640 1 -- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 msgr2=0x7f4a401e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.922+0000 7f4a37fff640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 0x7f4a401e5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.922+0000 7f4a37fff640 1 -- 172.21.15.12:0/124730690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a400c3fb0 msgr2=0x7f4a40154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.922+0000 7f4a37fff640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a400c3fb0 0x7f4a40154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.922+0000 7f4a37fff640 1 -- 172.21.15.12:0/124730690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280094d0 con 0x7f4a400c6af0 2023-10-21T16:27:36.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.924+0000 7f4a37fff640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a28004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:36.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.928+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28039c90 con 0x7f4a400c6af0 2023-10-21T16:27:36.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.928+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28039e10 con 0x7f4a400c6af0 2023-10-21T16:27:36.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.928+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28043640 con 0x7f4a400c6af0 2023-10-21T16:27:36.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.928+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a401e1570 con 0x7f4a400c6af0 2023-10-21T16:27:36.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.928+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a401e2c00 con 0x7f4a400c6af0 2023-10-21T16:27:36.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:36.929+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a40067560 con 0x7f4a400c6af0 2023-10-21T16:27:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.174+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a280437a0 con 0x7f4a400c6af0 2023-10-21T16:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.177+0000 7f4a377fe640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 0x7f4a2006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.177+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a2803e070 con 0x7f4a400c6af0 2023-10-21T16:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.177+0000 7f4a3ed9d640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 0x7f4a2006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.178+0000 7f4a3ed9d640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 0x7f4a2006d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009a90 tx=0x7f4a30009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.188+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a28078130 con 0x7f4a400c6af0 2023-10-21T16:27:37.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:37.465+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a401506b0 con 0x7f4a400c6af0 2023-10-21T16:27:38.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.494+0000 7f4a377fe640 1 -- 172.21.15.12:0/124730690 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a2807b750 con 0x7f4a400c6af0 2023-10-21T16:27:38.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 msgr2=0x7f4a2006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 0x7f4a2006d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009a90 tx=0x7f4a30009110 comp rx=0 tx=0).stop 2023-10-21T16:27:38.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 msgr2=0x7f4a401e1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a28004730 comp rx=0 tx=0).stop 2023-10-21T16:27:38.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 shutdown_connections 2023-10-21T16:27:38.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4a2006aec0 0x7f4a2006d380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a40150f00 0x7f4a401e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4a400c6af0 0x7f4a401e1a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 --2- 172.21.15.12:0/124730690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a400c3fb0 0x7f4a40154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 >> 172.21.15.12:0/124730690 conn(0x7f4a40065ab0 msgr2=0x7f4a4006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:38.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 shutdown_connections 2023-10-21T16:27:38.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.498+0000 7f4a44863640 1 -- 172.21.15.12:0/124730690 wait complete. 2023-10-21T16:27:38.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-21T16:27:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.746+0000 7f0cb0578640 1 Processor -- start 2023-10-21T16:27:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.746+0000 7f0cb0578640 1 -- start start 2023-10-21T16:27:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.748+0000 7f0cb0578640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ca8156670 0x7f0ca8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.748+0000 7f0cb0578640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0ca806f090 0x7f0ca80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.748+0000 7f0cb0578640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca806bb90 con 0x7f0ca80cca70 2023-10-21T16:27:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.748+0000 7f0cb0578640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca8159320 con 0x7f0ca8156670 2023-10-21T16:27:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.748+0000 7f0cb0578640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80c86a0 con 0x7f0ca806f090 2023-10-21T16:27:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.749+0000 7f0cadb13640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0ca80cca70 0x7f0ca806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:36536/0 (socket says 172.21.15.12:36536) 2023-10-21T16:27:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.749+0000 7f0cadb13640 1 -- 172.21.15.12:0/2585100514 learned_addr learned my addr 172.21.15.12:0/2585100514 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.749+0000 7f0caeb15640 1 --2- 172.21.15.12:0/2585100514 >> v2:172.21.15.99:3300/0 conn(0x7f0ca806f090 0x7f0ca80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.750+0000 7f0cae314640 1 --2- 172.21.15.12:0/2585100514 >> v2:172.21.15.12:3300/0 conn(0x7f0ca8156670 0x7f0ca8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.753+0000 7f0caeb15640 1 -- 172.21.15.12:0/2585100514 >> v2:172.21.15.12:3300/0 conn(0x7f0ca8156670 msgr2=0x7f0ca8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.753+0000 7f0caeb15640 1 --2- 172.21.15.12:0/2585100514 >> v2:172.21.15.12:3300/0 conn(0x7f0ca8156670 0x7f0ca8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.753+0000 7f0caeb15640 1 -- 172.21.15.12:0/2585100514 >> v1:172.21.15.99:6789/0 conn(0x7f0ca80cca70 legacy=0x7f0ca806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.753+0000 7f0caeb15640 1 -- 172.21.15.12:0/2585100514 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80c7e00 con 0x7f0ca806f090 2023-10-21T16:27:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.756+0000 7f0caeb15640 1 --2- 172.21.15.12:0/2585100514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca806f090 0x7f0ca80ccee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806c6e0 tx=0x7f0ca002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba659421dc64685 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:38.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.760+0000 7f0cad312640 1 -- 172.21.15.12:0/2585100514 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca002cc70 con 0x7f0ca806f090 2023-10-21T16:27:38.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.761+0000 7f0cad312640 1 -- 172.21.15.12:0/2585100514 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca002cdd0 con 0x7f0ca806f090 2023-10-21T16:27:38.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.761+0000 7f0cad312640 1 -- 172.21.15.12:0/2585100514 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0034660 con 0x7f0ca806f090 2023-10-21T16:27:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.761+0000 7f0cb0578640 1 -- 172.21.15.12:0/2585100514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca806f090 msgr2=0x7f0ca80ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.761+0000 7f0cb0578640 1 --2- 172.21.15.12:0/2585100514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca806f090 0x7f0ca80ccee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806c6e0 tx=0x7f0ca002bec0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 -- 172.21.15.12:0/2585100514 shutdown_connections 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 --2- 172.21.15.12:0/2585100514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca806f090 0x7f0ca80ccee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 --2- 172.21.15.12:0/2585100514 >> v2:172.21.15.12:3300/0 conn(0x7f0ca8156670 0x7f0ca8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 -- 172.21.15.12:0/2585100514 >> 172.21.15.12:0/2585100514 conn(0x7f0ca8065c90 msgr2=0x7f0ca80660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 -- 172.21.15.12:0/2585100514 shutdown_connections 2023-10-21T16:27:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.762+0000 7f0cb0578640 1 -- 172.21.15.12:0/2585100514 wait complete. 2023-10-21T16:27:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.765+0000 7f0cb0578640 1 Processor -- start 2023-10-21T16:27:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.766+0000 7f0cb0578640 1 -- start start 2023-10-21T16:27:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 0x7f0ca8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca80cca70 0x7f0ca81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 0x7f0ca8157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81ef0f0 con 0x7f0ca80cca70 2023-10-21T16:27:38.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81ef620 con 0x7f0ca8156670 2023-10-21T16:27:38.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.768+0000 7f0cb0578640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81ef340 con 0x7f0ca806f090 2023-10-21T16:27:38.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.769+0000 7f0cae314640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 0x7f0ca8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.769+0000 7f0caeb15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 0x7f0ca8157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.769+0000 7f0cadb13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca80cca70 0x7f0ca81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.769+0000 7f0cae314640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 0x7f0ca8152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54258/0 (socket says 172.21.15.12:54258) 2023-10-21T16:27:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.769+0000 7f0cae314640 1 -- 172.21.15.12:0/1021896120 learned_addr learned my addr 172.21.15.12:0/1021896120 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.773+0000 7f0caeb15640 1 -- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 msgr2=0x7f0ca8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.773+0000 7f0caeb15640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 0x7f0ca8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.773+0000 7f0caeb15640 1 -- 172.21.15.12:0/1021896120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca80cca70 msgr2=0x7f0ca81576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.773+0000 7f0caeb15640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca80cca70 0x7f0ca81576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.773+0000 7f0caeb15640 1 -- 172.21.15.12:0/1021896120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009a70 con 0x7f0ca8156670 2023-10-21T16:27:38.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.775+0000 7f0caeb15640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 0x7f0ca8157c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.778+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca003e610 con 0x7f0ca8156670 2023-10-21T16:27:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.779+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca003e770 con 0x7f0ca8156670 2023-10-21T16:27:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.779+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca003eb20 con 0x7f0ca8156670 2023-10-21T16:27:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.779+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca8156c10 con 0x7f0ca8156670 2023-10-21T16:27:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.779+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca81571d0 con 0x7f0ca8156670 2023-10-21T16:27:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.780+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80619f0 con 0x7f0ca8156670 2023-10-21T16:27:38.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.798+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ca003b050 con 0x7f0ca8156670 2023-10-21T16:27:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.799+0000 7f0c9effd640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 0x7f0c8c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.799+0000 7f0cae314640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 0x7f0c8c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.800+0000 7f0cae314640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 0x7f0c8c06d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009b60 tx=0x7f0ca4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:38.800+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ca007b080 con 0x7f0ca8156670 2023-10-21T16:27:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.037+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ca00773c0 con 0x7f0ca8156670 2023-10-21T16:27:39.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.294+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f0ca81489b0 con 0x7f0ca8156670 2023-10-21T16:27:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.750+0000 7f0c9effd640 1 -- 172.21.15.12:0/1021896120 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0ca00390b0 con 0x7f0ca8156670 2023-10-21T16:27:39.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.753+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 msgr2=0x7f0c8c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:39.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.753+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 0x7f0c8c06d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009b60 tx=0x7f0ca4009190 comp rx=0 tx=0).stop 2023-10-21T16:27:39.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.753+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 msgr2=0x7f0ca8157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:39.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.753+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 0x7f0ca8157c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca0004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:39.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 shutdown_connections 2023-10-21T16:27:39.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0c8c06aec0 0x7f0c8c06d380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:39.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ca8156670 0x7f0ca8157c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:39.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca80cca70 0x7f0ca81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:39.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 --2- 172.21.15.12:0/1021896120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0ca806f090 0x7f0ca8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:39.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 >> 172.21.15.12:0/1021896120 conn(0x7f0ca8065c90 msgr2=0x7f0ca81599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:39.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 shutdown_connections 2023-10-21T16:27:39.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.754+0000 7f0cb0578640 1 -- 172.21.15.12:0/1021896120 wait complete. 2023-10-21T16:27:39.776 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-21T16:27:39.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:27:39.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.988+0000 7fe57f347640 1 Processor -- start 2023-10-21T16:27:39.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.988+0000 7fe57f347640 1 -- start start 2023-10-21T16:27:39.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.989+0000 7fe57f347640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe57814fec0 0x7fe57806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:39.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.989+0000 7fe57f347640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe578155cf0 0x7fe5780ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:39.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.990+0000 7fe57f347640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5780c38e0 con 0x7fe57806e100 2023-10-21T16:27:39.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.990+0000 7fe57f347640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57806d450 con 0x7fe57814fec0 2023-10-21T16:27:39.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.990+0000 7fe57f347640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5781562a0 con 0x7fe578155cf0 2023-10-21T16:27:39.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.990+0000 7fe57e345640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe57814fec0 0x7fe57806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:39.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.990+0000 7fe57eb46640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe578155cf0 0x7fe5780ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:39.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.991+0000 7fe57eb46640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe578155cf0 0x7fe5780ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38478/0 (socket says 172.21.15.12:38478) 2023-10-21T16:27:39.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.991+0000 7fe57eb46640 1 -- 172.21.15.12:0/349471928 learned_addr learned my addr 172.21.15.12:0/349471928 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:39.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.993+0000 7fe57eb46640 1 -- 172.21.15.12:0/349471928 >> v2:172.21.15.12:3300/0 conn(0x7fe57814fec0 msgr2=0x7fe57806dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:39.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.993+0000 7fe57eb46640 1 --2- 172.21.15.12:0/349471928 >> v2:172.21.15.12:3300/0 conn(0x7fe57814fec0 0x7fe57806dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:39.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.993+0000 7fe57eb46640 1 -- 172.21.15.12:0/349471928 >> v1:172.21.15.12:6789/0 conn(0x7fe57806e100 legacy=0x7fe5780708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:39.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.993+0000 7fe57eb46640 1 -- 172.21.15.12:0/349471928 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe578156560 con 0x7fe578155cf0 2023-10-21T16:27:39.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.995+0000 7fe57eb46640 1 --2- 172.21.15.12:0/349471928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe578155cf0 0x7fe5780ca780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe578156180 tx=0x7fe57002e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19264f8bdfc7fdeb server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:40.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.999+0000 7fe57d343640 1 -- 172.21.15.12:0/349471928 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000b0d0 con 0x7fe578155cf0 2023-10-21T16:27:40.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.999+0000 7fe57d343640 1 -- 172.21.15.12:0/349471928 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000b230 con 0x7fe578155cf0 2023-10-21T16:27:40.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.999+0000 7fe57d343640 1 -- 172.21.15.12:0/349471928 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570009600 con 0x7fe578155cf0 2023-10-21T16:27:40.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.999+0000 7fe57f347640 1 -- 172.21.15.12:0/349471928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe578155cf0 msgr2=0x7fe5780ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:39.999+0000 7fe57f347640 1 --2- 172.21.15.12:0/349471928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe578155cf0 0x7fe5780ca780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe578156180 tx=0x7fe57002e180 comp rx=0 tx=0).stop 2023-10-21T16:27:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 -- 172.21.15.12:0/349471928 shutdown_connections 2023-10-21T16:27:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 --2- 172.21.15.12:0/349471928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe578155cf0 0x7fe5780ca780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 --2- 172.21.15.12:0/349471928 >> v2:172.21.15.12:3300/0 conn(0x7fe57814fec0 0x7fe57806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 -- 172.21.15.12:0/349471928 >> 172.21.15.12:0/349471928 conn(0x7fe57806bac0 msgr2=0x7fe57806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:40.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 -- 172.21.15.12:0/349471928 shutdown_connections 2023-10-21T16:27:40.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.000+0000 7fe57f347640 1 -- 172.21.15.12:0/349471928 wait complete. 2023-10-21T16:27:40.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.002+0000 7fe57f347640 1 Processor -- start 2023-10-21T16:27:40.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.002+0000 7fe57f347640 1 -- start start 2023-10-21T16:27:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 0x7fe5781e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 0x7fe578140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe578155cf0 0x7fe578141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57814ee40 con 0x7fe57806e100 2023-10-21T16:27:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5781e1c10 con 0x7fe57814fec0 2023-10-21T16:27:40.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.003+0000 7fe57f347640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5781f1fc0 con 0x7fe578155cf0 2023-10-21T16:27:40.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.004+0000 7fe57e345640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 0x7fe5781e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:40.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.004+0000 7fe57db44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 0x7fe578140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:40.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.004+0000 7fe57eb46640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe578155cf0 0x7fe578141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:40.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.004+0000 7fe57db44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 0x7fe578140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38482/0 (socket says 172.21.15.12:38482) 2023-10-21T16:27:40.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.004+0000 7fe57db44640 1 -- 172.21.15.12:0/2048938962 learned_addr learned my addr 172.21.15.12:0/2048938962 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:40.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.008+0000 7fe57e345640 1 -- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe578155cf0 msgr2=0x7fe578141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:40.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.008+0000 7fe57e345640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe578155cf0 0x7fe578141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.008+0000 7fe57e345640 1 -- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 msgr2=0x7fe578140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:40.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.008+0000 7fe57e345640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 0x7fe578140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.008+0000 7fe57e345640 1 -- 172.21.15.12:0/2048938962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57000bd40 con 0x7fe57806e100 2023-10-21T16:27:40.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.011+0000 7fe57e345640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 0x7fe5781e3ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe57400e850 tx=0x7fe57400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:40.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.015+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740095b0 con 0x7fe57806e100 2023-10-21T16:27:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.015+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57400c940 con 0x7fe57806e100 2023-10-21T16:27:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.015+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400ccd0 con 0x7fe57806e100 2023-10-21T16:27:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.015+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5781f22a0 con 0x7fe57806e100 2023-10-21T16:27:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.015+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5781f2860 con 0x7fe57806e100 2023-10-21T16:27:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.016+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe578067560 con 0x7fe57806e100 2023-10-21T16:27:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.041+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe574013470 con 0x7fe57806e100 2023-10-21T16:27:40.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.043+0000 7fe56effd640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 0x7fe55c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.044+0000 7fe57db44640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 0x7fe55c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.045+0000 7fe57db44640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 0x7fe55c06d380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ca420 tx=0x7fe568009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.045+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57400ce30 con 0x7fe57806e100 2023-10-21T16:27:40.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.364+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe574055020 con 0x7fe57806e100 2023-10-21T16:27:40.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.614+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe57814d750 con 0x7fe57806e100 2023-10-21T16:27:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.750+0000 7fe56effd640 1 -- 172.21.15.12:0/2048938962 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6485 (secure 0 0 0) 0x7fe574021020 con 0x7fe57806e100 2023-10-21T16:27:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:40.753 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T16:27:39.342620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T16:27:40.753 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-21T16:27:40.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 msgr2=0x7fe55c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:40.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 0x7fe55c06d380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ca420 tx=0x7fe568009040 comp rx=0 tx=0).stop 2023-10-21T16:27:40.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 msgr2=0x7fe5781e3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:40.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 0x7fe5781e3ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe57400e850 tx=0x7fe57400ed10 comp rx=0 tx=0).stop 2023-10-21T16:27:40.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 shutdown_connections 2023-10-21T16:27:40.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.753+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fe55c06aec0 0x7fe55c06d380 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe578155cf0 0x7fe578141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57814fec0 0x7fe578140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 --2- 172.21.15.12:0/2048938962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe57806e100 0x7fe5781e3ef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 >> 172.21.15.12:0/2048938962 conn(0x7fe57806bac0 msgr2=0x7fe5780c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 shutdown_connections 2023-10-21T16:27:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.754+0000 7fe57f347640 1 -- 172.21.15.12:0/2048938962 wait complete. 2023-10-21T16:27:40.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.994+0000 7fdc07197640 1 Processor -- start 2023-10-21T16:27:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.995+0000 7fdc07197640 1 -- start start 2023-10-21T16:27:40.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.996+0000 7fdc07197640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc000c55f0 0x7fdc00157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.996+0000 7fdc07197640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 0x7fdc00150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:40.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.996+0000 7fdc07197640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000c23f0 con 0x7fdc000c59d0 2023-10-21T16:27:40.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.996+0000 7fdc07197640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc00156fa0 con 0x7fdc00157cc0 2023-10-21T16:27:40.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.996+0000 7fdc07197640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0015aaf0 con 0x7fdc000c55f0 2023-10-21T16:27:40.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.997+0000 7fdc04f33640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc000c55f0 0x7fdc00157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.997+0000 7fdc04f33640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc000c55f0 0x7fdc00157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38486/0 (socket says 172.21.15.12:38486) 2023-10-21T16:27:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.997+0000 7fdc04f33640 1 -- 172.21.15.12:0/3183454113 learned_addr learned my addr 172.21.15.12:0/3183454113 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:40.998+0000 7fdbfffff640 1 --2- 172.21.15.12:0/3183454113 >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 0x7fdc00150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.000+0000 7fdc04f33640 1 -- 172.21.15.12:0/3183454113 >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 msgr2=0x7fdc00150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.000+0000 7fdc04f33640 1 --2- 172.21.15.12:0/3183454113 >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 0x7fdc00150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.000+0000 7fdc04f33640 1 -- 172.21.15.12:0/3183454113 >> v1:172.21.15.12:6789/0 conn(0x7fdc000c59d0 legacy=0x7fdc000c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.000+0000 7fdc04f33640 1 -- 172.21.15.12:0/3183454113 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0015add0 con 0x7fdc000c55f0 2023-10-21T16:27:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.000+0000 7fdbfffff640 1 --2- 172.21.15.12:0/3183454113 >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 0x7fdc00150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-21T16:27:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.002+0000 7fdc04f33640 1 --2- 172.21.15.12:0/3183454113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00157780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc000c50a0 tx=0x7fdbf002bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c289f0c55217bffb server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:41.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.005+0000 7fdbff7fe640 1 -- 172.21.15.12:0/3183454113 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf002cb10 con 0x7fdc000c55f0 2023-10-21T16:27:41.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.005+0000 7fdbff7fe640 1 -- 172.21.15.12:0/3183454113 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf002cc70 con 0x7fdc000c55f0 2023-10-21T16:27:41.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.005+0000 7fdbff7fe640 1 -- 172.21.15.12:0/3183454113 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00343f0 con 0x7fdc000c55f0 2023-10-21T16:27:41.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 -- 172.21.15.12:0/3183454113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 msgr2=0x7fdc00157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 --2- 172.21.15.12:0/3183454113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00157780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc000c50a0 tx=0x7fdbf002bf70 comp rx=0 tx=0).stop 2023-10-21T16:27:41.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 -- 172.21.15.12:0/3183454113 shutdown_connections 2023-10-21T16:27:41.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 --2- 172.21.15.12:0/3183454113 >> v2:172.21.15.12:3300/0 conn(0x7fdc00157cc0 0x7fdc00150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 --2- 172.21.15.12:0/3183454113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00157780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 -- 172.21.15.12:0/3183454113 >> 172.21.15.12:0/3183454113 conn(0x7fdc00069de0 msgr2=0x7fdc0006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:41.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 -- 172.21.15.12:0/3183454113 shutdown_connections 2023-10-21T16:27:41.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.006+0000 7fdc07197640 1 -- 172.21.15.12:0/3183454113 wait complete. 2023-10-21T16:27:41.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.008+0000 7fdc07197640 1 Processor -- start 2023-10-21T16:27:41.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.008+0000 7fdc07197640 1 -- start start 2023-10-21T16:27:41.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc000c59d0 0x7fdc001e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00157cc0 0x7fdc001e6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00146b50 con 0x7fdc00157cc0 2023-10-21T16:27:41.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00158770 con 0x7fdc000c55f0 2023-10-21T16:27:41.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.009+0000 7fdc07197640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc001f1e80 con 0x7fdc000c59d0 2023-10-21T16:27:41.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.010+0000 7fdc04f33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.010+0000 7fdbfffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc000c59d0 0x7fdc001e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.010+0000 7fdc05734640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00157cc0 0x7fdc001e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.010+0000 7fdc04f33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38490/0 (socket says 172.21.15.12:38490) 2023-10-21T16:27:41.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.010+0000 7fdc04f33640 1 -- 172.21.15.12:0/2652696513 learned_addr learned my addr 172.21.15.12:0/2652696513 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:41.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.013+0000 7fdc04f33640 1 -- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc000c59d0 msgr2=0x7fdc001e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.013+0000 7fdc04f33640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc000c59d0 0x7fdc001e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.013+0000 7fdc04f33640 1 -- 172.21.15.12:0/2652696513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00157cc0 msgr2=0x7fdc001e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.013+0000 7fdc04f33640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00157cc0 0x7fdc001e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.013+0000 7fdc04f33640 1 -- 172.21.15.12:0/2652696513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0009b30 con 0x7fdc000c55f0 2023-10-21T16:27:41.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.015+0000 7fdc04f33640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000f80 tx=0x7fdbf0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.019+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf003e450 con 0x7fdc000c55f0 2023-10-21T16:27:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.019+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf003e5b0 con 0x7fdc000c55f0 2023-10-21T16:27:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.019+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf003e960 con 0x7fdc000c55f0 2023-10-21T16:27:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.019+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc001f2140 con 0x7fdc000c55f0 2023-10-21T16:27:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.019+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc001f2700 con 0x7fdc000c55f0 2023-10-21T16:27:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.020+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc000619f0 con 0x7fdc000c55f0 2023-10-21T16:27:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.039+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdbf003eac0 con 0x7fdc000c55f0 2023-10-21T16:27:41.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.041+0000 7fdbfd7fa640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 0x7fdbec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.041+0000 7fdbfffff640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 0x7fdbec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.041+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbf007b900 con 0x7fdc000c55f0 2023-10-21T16:27:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.042+0000 7fdbfffff640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 0x7fdbec06d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc00146ec0 tx=0x7fdbf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.279+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbf0077c40 con 0x7fdc000c55f0 2023-10-21T16:27:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.488+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc0014da40 con 0x7fdc000c55f0 2023-10-21T16:27:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.528+0000 7fdbfd7fa640 1 -- 172.21.15.12:0/2652696513 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fdbf0043090 con 0x7fdc000c55f0 2023-10-21T16:27:41.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 msgr2=0x7fdbec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 0x7fdbec06d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc00146ec0 tx=0x7fdbf4008040 comp rx=0 tx=0).stop 2023-10-21T16:27:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 msgr2=0x7fdc00146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000f80 tx=0x7fdbf0004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 shutdown_connections 2023-10-21T16:27:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdbec06aec0 0x7fdbec06d380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00157cc0 0x7fdc001e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc000c59d0 0x7fdc001e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 --2- 172.21.15.12:0/2652696513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc000c55f0 0x7fdc00146610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 >> 172.21.15.12:0/2652696513 conn(0x7fdc00069de0 msgr2=0x7fdc00154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 shutdown_connections 2023-10-21T16:27:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.532+0000 7fdc07197640 1 -- 172.21.15.12:0/2652696513 wait complete. 2023-10-21T16:27:41.555 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-21T16:27:41.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T16:27:41.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.770+0000 7f9a79c2e640 1 Processor -- start 2023-10-21T16:27:41.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.770+0000 7f9a79c2e640 1 -- start start 2023-10-21T16:27:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a7414fec0 0x7f9a7406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 0x7f9a740708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9a74155cf0 0x7f9a74070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a740c38e0 con 0x7f9a7414fec0 2023-10-21T16:27:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7406d450 con 0x7f9a74155cf0 2023-10-21T16:27:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.771+0000 7f9a79c2e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a741562a0 con 0x7f9a7406e100 2023-10-21T16:27:41.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.772+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 0x7f9a740708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.772+0000 7f9a7942d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9a74155cf0 0x7f9a74070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.772+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 0x7f9a740708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54286/0 (socket says 172.21.15.12:54286) 2023-10-21T16:27:41.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.772+0000 7f9a7942d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9a74155cf0 0x7f9a74070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:38498/0 (socket says 172.21.15.12:38498) 2023-10-21T16:27:41.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.772+0000 7f9a73fff640 1 -- 172.21.15.12:0/1865093781 learned_addr learned my addr 172.21.15.12:0/1865093781 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:41.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.774+0000 7f9a78c2c640 1 --2- 172.21.15.12:0/1865093781 >> v2:172.21.15.12:3300/0 conn(0x7f9a7414fec0 0x7f9a7406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.775+0000 7f9a7942d640 1 -- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 msgr2=0x7f9a740708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.775+0000 7f9a7942d640 1 --2- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 0x7f9a740708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.775+0000 7f9a7942d640 1 -- 172.21.15.12:0/1865093781 >> v2:172.21.15.12:3300/0 conn(0x7f9a7414fec0 msgr2=0x7f9a7406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.775+0000 7f9a7942d640 1 --2- 172.21.15.12:0/1865093781 >> v2:172.21.15.12:3300/0 conn(0x7f9a7414fec0 0x7f9a7406dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.775+0000 7f9a7942d640 1 -- 172.21.15.12:0/1865093781 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74156560 con 0x7f9a74155cf0 2023-10-21T16:27:41.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.778+0000 7f9a7942d640 1 --2- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a74155cf0 0x7f9a74070df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a740cb480 tx=0x7f9a6c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601d848be35d5da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:41.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.781+0000 7f9a737fe640 1 -- 172.21.15.12:0/1865093781 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c02cbd0 con 0x7f9a74155cf0 2023-10-21T16:27:41.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.781+0000 7f9a737fe640 1 -- 172.21.15.12:0/1865093781 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c02cd30 con 0x7f9a74155cf0 2023-10-21T16:27:41.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.781+0000 7f9a737fe640 1 -- 172.21.15.12:0/1865093781 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c02cea0 con 0x7f9a74155cf0 2023-10-21T16:27:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 -- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a74155cf0 msgr2=0x7f9a74070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a74155cf0 0x7f9a74070df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a740cb480 tx=0x7f9a6c02be20 comp rx=0 tx=0).stop 2023-10-21T16:27:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 -- 172.21.15.12:0/1865093781 shutdown_connections 2023-10-21T16:27:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a74155cf0 0x7f9a74070df0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/1865093781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a7406e100 0x7f9a740708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/1865093781 >> v2:172.21.15.12:3300/0 conn(0x7f9a7414fec0 0x7f9a7406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 -- 172.21.15.12:0/1865093781 >> 172.21.15.12:0/1865093781 conn(0x7f9a7406bac0 msgr2=0x7f9a7406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 -- 172.21.15.12:0/1865093781 shutdown_connections 2023-10-21T16:27:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.782+0000 7f9a79c2e640 1 -- 172.21.15.12:0/1865093781 wait complete. 2023-10-21T16:27:41.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.784+0000 7f9a79c2e640 1 Processor -- start 2023-10-21T16:27:41.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.784+0000 7f9a79c2e640 1 -- start start 2023-10-21T16:27:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7406e100 0x7f9a741462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7414fec0 0x7f9a7414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7414e830 con 0x7f9a7406e100 2023-10-21T16:27:41.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a74142df0 con 0x7f9a7414fec0 2023-10-21T16:27:41.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.785+0000 7f9a79c2e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7414c510 con 0x7f9a74155cf0 2023-10-21T16:27:41.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.786+0000 7f9a7942d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.786+0000 7f9a78c2c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7406e100 0x7f9a741462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.786+0000 7f9a7942d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54294/0 (socket says 172.21.15.12:54294) 2023-10-21T16:27:41.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.786+0000 7f9a7942d640 1 -- 172.21.15.12:0/3876738625 learned_addr learned my addr 172.21.15.12:0/3876738625 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:41.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.787+0000 7f9a73fff640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7414fec0 0x7f9a7414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.790+0000 7f9a7942d640 1 -- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7414fec0 msgr2=0x7f9a7414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.790+0000 7f9a7942d640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7414fec0 0x7f9a7414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.790+0000 7f9a7942d640 1 -- 172.21.15.12:0/3876738625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7406e100 msgr2=0x7f9a741462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:41.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.790+0000 7f9a7942d640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7406e100 0x7f9a741462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:41.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.790+0000 7f9a7942d640 1 -- 172.21.15.12:0/3876738625 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c009a70 con 0x7f9a74155cf0 2023-10-21T16:27:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.810+0000 7f9a7942d640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c02c430 tx=0x7f9a6c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.856+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c02cea0 con 0x7f9a74155cf0 2023-10-21T16:27:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.856+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c040650 con 0x7f9a74155cf0 2023-10-21T16:27:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.856+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c040a00 con 0x7f9a74155cf0 2023-10-21T16:27:41.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.856+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a74142830 con 0x7f9a74155cf0 2023-10-21T16:27:41.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.857+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a741f1b30 con 0x7f9a74155cf0 2023-10-21T16:27:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.859+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a74156b00 con 0x7f9a74155cf0 2023-10-21T16:27:41.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.878+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a6c040b60 con 0x7f9a74155cf0 2023-10-21T16:27:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.880+0000 7f9a717fa640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 0x7f9a5806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.880+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a6c0ac7e0 con 0x7f9a74155cf0 2023-10-21T16:27:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.881+0000 7f9a78c2c640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 0x7f9a5806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:41.881+0000 7f9a78c2c640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 0x7f9a5806d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:42.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.119+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a6c077ab0 con 0x7f9a74155cf0 2023-10-21T16:27:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.353+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a74156840 con 0x7f9a5806aec0 2023-10-21T16:27:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.362+0000 7f9a717fa640 1 -- 172.21.15.12:0/3876738625 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264546 (secure 0 0 0) 0x7f9a68010990 con 0x7f9a5806aec0 2023-10-21T16:27:42.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T16:27:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 msgr2=0x7f9a5806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 0x7f9a5806d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68008040 comp rx=0 tx=0).stop 2023-10-21T16:27:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 msgr2=0x7f9a740c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c02c430 tx=0x7f9a6c004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 shutdown_connections 2023-10-21T16:27:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9a5806aec0 0x7f9a5806d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a74155cf0 0x7f9a740c96e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7414fec0 0x7f9a7414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 --2- 172.21.15.12:0/3876738625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7406e100 0x7f9a741462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 >> 172.21.15.12:0/3876738625 conn(0x7f9a7406bac0 msgr2=0x7f9a740c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.370+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 shutdown_connections 2023-10-21T16:27:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.371+0000 7f9a79c2e640 1 -- 172.21.15.12:0/3876738625 wait complete. 2023-10-21T16:27:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-21T16:27:41.258037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219172,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755548,"statfs":{"total":773094113280,"available":772869681152,"internally_reserved":0,"allocated":3088384,"data_stored":1823884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.546760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096955+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T16:27:34.096955+0000","last_peered":"2023-10-21T16:27:34.096955+0000","last_clean":"2023-10-21T16:27:34.096955+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T16:27:34.096955+0000","last_undegraded":"2023-10-21T16:27:34.096955+0000","last_fullsized":"2023-10-21T16:27:34.096955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220196+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T16:27:34.220196+0000","last_peered":"2023-10-21T16:27:34.220196+0000","last_clean":"2023-10-21T16:27:34.220196+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T16:27:34.220196+0000","last_undegraded":"2023-10-21T16:27:34.220196+0000","last_fullsized":"2023-10-21T16:27:34.220196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220057+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T16:27:34.220057+0000","last_peered":"2023-10-21T16:27:34.220057+0000","last_clean":"2023-10-21T16:27:34.220057+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T16:27:34.220057+0000","last_undegraded":"2023-10-21T16:27:34.220057+0000","last_fullsized":"2023-10-21T16:27:34.220057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967774+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T16:27:32.967774+0000","last_peered":"2023-10-21T16:27:32.967774+0000","last_clean":"2023-10-21T16:27:32.967774+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T16:27:32.967774+0000","last_undegraded":"2023-10-21T16:27:32.967774+0000","last_fullsized":"2023-10-21T16:27:32.967774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096319+0000","last_change":"2023-10-21T16:27:31.926876+0000","last_active":"2023-10-21T16:27:34.096319+0000","last_peered":"2023-10-21T16:27:34.096319+0000","last_clean":"2023-10-21T16:27:34.096319+0000","last_became_active":"2023-10-21T16:27:31.924739+0000","last_became_peered":"2023-10-21T16:27:31.924739+0000","last_unstale":"2023-10-21T16:27:34.096319+0000","last_undegraded":"2023-10-21T16:27:34.096319+0000","last_fullsized":"2023-10-21T16:27:34.096319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967014+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T16:27:32.967014+0000","last_peered":"2023-10-21T16:27:32.967014+0000","last_clean":"2023-10-21T16:27:32.967014+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T16:27:32.967014+0000","last_undegraded":"2023-10-21T16:27:32.967014+0000","last_fullsized":"2023-10-21T16:27:32.967014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095632+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T16:27:34.095632+0000","last_peered":"2023-10-21T16:27:34.095632+0000","last_clean":"2023-10-21T16:27:34.095632+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T16:27:34.095632+0000","last_undegraded":"2023-10-21T16:27:34.095632+0000","last_fullsized":"2023-10-21T16:27:34.095632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219959+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T16:27:34.219959+0000","last_peered":"2023-10-21T16:27:34.219959+0000","last_clean":"2023-10-21T16:27:34.219959+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T16:27:34.219959+0000","last_undegraded":"2023-10-21T16:27:34.219959+0000","last_fullsized":"2023-10-21T16:27:34.219959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.444446+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T16:27:33.444446+0000","last_peered":"2023-10-21T16:27:33.444446+0000","last_clean":"2023-10-21T16:27:33.444446+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T16:27:33.444446+0000","last_undegraded":"2023-10-21T16:27:33.444446+0000","last_fullsized":"2023-10-21T16:27:33.444446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096902+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T16:27:34.096902+0000","last_peered":"2023-10-21T16:27:34.096902+0000","last_clean":"2023-10-21T16:27:34.096902+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T16:27:34.096902+0000","last_undegraded":"2023-10-21T16:27:34.096902+0000","last_fullsized":"2023-10-21T16:27:34.096902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096870+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T16:27:34.096870+0000","last_peered":"2023-10-21T16:27:34.096870+0000","last_clean":"2023-10-21T16:27:34.096870+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T16:27:34.096870+0000","last_undegraded":"2023-10-21T16:27:34.096870+0000","last_fullsized":"2023-10-21T16:27:34.096870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095803+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T16:27:34.095803+0000","last_peered":"2023-10-21T16:27:34.095803+0000","last_clean":"2023-10-21T16:27:34.095803+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T16:27:34.095803+0000","last_undegraded":"2023-10-21T16:27:34.095803+0000","last_fullsized":"2023-10-21T16:27:34.095803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251595+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T16:27:34.251595+0000","last_peered":"2023-10-21T16:27:34.251595+0000","last_clean":"2023-10-21T16:27:34.251595+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T16:27:34.251595+0000","last_undegraded":"2023-10-21T16:27:34.251595+0000","last_fullsized":"2023-10-21T16:27:34.251595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251551+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T16:27:34.251551+0000","last_peered":"2023-10-21T16:27:34.251551+0000","last_clean":"2023-10-21T16:27:34.251551+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T16:27:34.251551+0000","last_undegraded":"2023-10-21T16:27:34.251551+0000","last_fullsized":"2023-10-21T16:27:34.251551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219911+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T16:27:34.219911+0000","last_peered":"2023-10-21T16:27:34.219911+0000","last_clean":"2023-10-21T16:27:34.219911+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T16:27:34.219911+0000","last_undegraded":"2023-10-21T16:27:34.219911+0000","last_fullsized":"2023-10-21T16:27:34.219911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963543+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T16:27:32.963543+0000","last_peered":"2023-10-21T16:27:32.963543+0000","last_clean":"2023-10-21T16:27:32.963543+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T16:27:32.963543+0000","last_undegraded":"2023-10-21T16:27:32.963543+0000","last_fullsized":"2023-10-21T16:27:32.963543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964833+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T16:27:32.964833+0000","last_peered":"2023-10-21T16:27:32.964833+0000","last_clean":"2023-10-21T16:27:32.964833+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T16:27:32.964833+0000","last_undegraded":"2023-10-21T16:27:32.964833+0000","last_fullsized":"2023-10-21T16:27:32.964833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089146+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T16:27:34.089146+0000","last_peered":"2023-10-21T16:27:34.089146+0000","last_clean":"2023-10-21T16:27:34.089146+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T16:27:34.089146+0000","last_undegraded":"2023-10-21T16:27:34.089146+0000","last_fullsized":"2023-10-21T16:27:34.089146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964685+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T16:27:32.964685+0000","last_peered":"2023-10-21T16:27:32.964685+0000","last_clean":"2023-10-21T16:27:32.964685+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T16:27:32.964685+0000","last_undegraded":"2023-10-21T16:27:32.964685+0000","last_fullsized":"2023-10-21T16:27:32.964685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095995+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T16:27:34.095995+0000","last_peered":"2023-10-21T16:27:34.095995+0000","last_clean":"2023-10-21T16:27:34.095995+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T16:27:34.095995+0000","last_undegraded":"2023-10-21T16:27:34.095995+0000","last_fullsized":"2023-10-21T16:27:34.095995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051716+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T16:27:34.051716+0000","last_peered":"2023-10-21T16:27:34.051716+0000","last_clean":"2023-10-21T16:27:34.051716+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T16:27:34.051716+0000","last_undegraded":"2023-10-21T16:27:34.051716+0000","last_fullsized":"2023-10-21T16:27:34.051716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443049+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T16:27:33.443049+0000","last_peered":"2023-10-21T16:27:33.443049+0000","last_clean":"2023-10-21T16:27:33.443049+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T16:27:33.443049+0000","last_undegraded":"2023-10-21T16:27:33.443049+0000","last_fullsized":"2023-10-21T16:27:33.443049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220071+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T16:27:34.220071+0000","last_peered":"2023-10-21T16:27:34.220071+0000","last_clean":"2023-10-21T16:27:34.220071+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T16:27:34.220071+0000","last_undegraded":"2023-10-21T16:27:34.220071+0000","last_fullsized":"2023-10-21T16:27:34.220071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963620+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T16:27:32.963620+0000","last_peered":"2023-10-21T16:27:32.963620+0000","last_clean":"2023-10-21T16:27:32.963620+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T16:27:32.963620+0000","last_undegraded":"2023-10-21T16:27:32.963620+0000","last_fullsized":"2023-10-21T16:27:32.963620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220273+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T16:27:34.220273+0000","last_peered":"2023-10-21T16:27:34.220273+0000","last_clean":"2023-10-21T16:27:34.220273+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T16:27:34.220273+0000","last_undegraded":"2023-10-21T16:27:34.220273+0000","last_fullsized":"2023-10-21T16:27:34.220273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968086+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T16:27:32.968086+0000","last_peered":"2023-10-21T16:27:32.968086+0000","last_clean":"2023-10-21T16:27:32.968086+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T16:27:32.968086+0000","last_undegraded":"2023-10-21T16:27:32.968086+0000","last_fullsized":"2023-10-21T16:27:32.968086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251803+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T16:27:34.251803+0000","last_peered":"2023-10-21T16:27:34.251803+0000","last_clean":"2023-10-21T16:27:34.251803+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T16:27:34.251803+0000","last_undegraded":"2023-10-21T16:27:34.251803+0000","last_fullsized":"2023-10-21T16:27:34.251803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251649+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T16:27:34.251649+0000","last_peered":"2023-10-21T16:27:34.251649+0000","last_clean":"2023-10-21T16:27:34.251649+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T16:27:34.251649+0000","last_undegraded":"2023-10-21T16:27:34.251649+0000","last_fullsized":"2023-10-21T16:27:34.251649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220059+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T16:27:34.220059+0000","last_peered":"2023-10-21T16:27:34.220059+0000","last_clean":"2023-10-21T16:27:34.220059+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T16:27:34.220059+0000","last_undegraded":"2023-10-21T16:27:34.220059+0000","last_fullsized":"2023-10-21T16:27:34.220059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963880+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T16:27:32.963880+0000","last_peered":"2023-10-21T16:27:32.963880+0000","last_clean":"2023-10-21T16:27:32.963880+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T16:27:32.963880+0000","last_undegraded":"2023-10-21T16:27:32.963880+0000","last_fullsized":"2023-10-21T16:27:32.963880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.088942+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T16:27:34.088942+0000","last_peered":"2023-10-21T16:27:34.088942+0000","last_clean":"2023-10-21T16:27:34.088942+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T16:27:34.088942+0000","last_undegraded":"2023-10-21T16:27:34.088942+0000","last_fullsized":"2023-10-21T16:27:34.088942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966760+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T16:27:32.966760+0000","last_peered":"2023-10-21T16:27:32.966760+0000","last_clean":"2023-10-21T16:27:32.966760+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T16:27:32.966760+0000","last_undegraded":"2023-10-21T16:27:32.966760+0000","last_fullsized":"2023-10-21T16:27:32.966760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443231+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T16:27:33.443231+0000","last_peered":"2023-10-21T16:27:33.443231+0000","last_clean":"2023-10-21T16:27:33.443231+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T16:27:33.443231+0000","last_undegraded":"2023-10-21T16:27:33.443231+0000","last_fullsized":"2023-10-21T16:27:33.443231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220184+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T16:27:34.220184+0000","last_peered":"2023-10-21T16:27:34.220184+0000","last_clean":"2023-10-21T16:27:34.220184+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T16:27:34.220184+0000","last_undegraded":"2023-10-21T16:27:34.220184+0000","last_fullsized":"2023-10-21T16:27:34.220184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051700+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T16:27:34.051700+0000","last_peered":"2023-10-21T16:27:34.051700+0000","last_clean":"2023-10-21T16:27:34.051700+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T16:27:34.051700+0000","last_undegraded":"2023-10-21T16:27:34.051700+0000","last_fullsized":"2023-10-21T16:27:34.051700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964000+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T16:27:32.964000+0000","last_peered":"2023-10-21T16:27:32.964000+0000","last_clean":"2023-10-21T16:27:32.964000+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T16:27:32.964000+0000","last_undegraded":"2023-10-21T16:27:32.964000+0000","last_fullsized":"2023-10-21T16:27:32.964000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385858+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T16:27:32.385858+0000","last_peered":"2023-10-21T16:27:32.385858+0000","last_clean":"2023-10-21T16:27:32.385858+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T16:27:32.385858+0000","last_undegraded":"2023-10-21T16:27:32.385858+0000","last_fullsized":"2023-10-21T16:27:32.385858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220101+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T16:27:34.220101+0000","last_peered":"2023-10-21T16:27:34.220101+0000","last_clean":"2023-10-21T16:27:34.220101+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T16:27:34.220101+0000","last_undegraded":"2023-10-21T16:27:34.220101+0000","last_fullsized":"2023-10-21T16:27:34.220101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895978+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T16:27:31.895978+0000","last_peered":"2023-10-21T16:27:31.895978+0000","last_clean":"2023-10-21T16:27:31.895978+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T16:27:31.895978+0000","last_undegraded":"2023-10-21T16:27:31.895978+0000","last_fullsized":"2023-10-21T16:27:31.895978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051556+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T16:27:34.051556+0000","last_peered":"2023-10-21T16:27:34.051556+0000","last_clean":"2023-10-21T16:27:34.051556+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T16:27:34.051556+0000","last_undegraded":"2023-10-21T16:27:34.051556+0000","last_fullsized":"2023-10-21T16:27:34.051556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.917463+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T16:27:31.917463+0000","last_peered":"2023-10-21T16:27:31.917463+0000","last_clean":"2023-10-21T16:27:31.917463+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T16:27:31.917463+0000","last_undegraded":"2023-10-21T16:27:31.917463+0000","last_fullsized":"2023-10-21T16:27:31.917463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968166+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T16:27:32.968166+0000","last_peered":"2023-10-21T16:27:32.968166+0000","last_clean":"2023-10-21T16:27:32.968166+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T16:27:32.968166+0000","last_undegraded":"2023-10-21T16:27:32.968166+0000","last_fullsized":"2023-10-21T16:27:32.968166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.927903+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T16:27:31.927903+0000","last_peered":"2023-10-21T16:27:31.927903+0000","last_clean":"2023-10-21T16:27:31.927903+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T16:27:31.927903+0000","last_undegraded":"2023-10-21T16:27:31.927903+0000","last_fullsized":"2023-10-21T16:27:31.927903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220385+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T16:27:34.220385+0000","last_peered":"2023-10-21T16:27:34.220385+0000","last_clean":"2023-10-21T16:27:34.220385+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T16:27:34.220385+0000","last_undegraded":"2023-10-21T16:27:34.220385+0000","last_fullsized":"2023-10-21T16:27:34.220385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.091178+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T16:27:34.091178+0000","last_peered":"2023-10-21T16:27:34.091178+0000","last_clean":"2023-10-21T16:27:34.091178+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T16:27:34.091178+0000","last_undegraded":"2023-10-21T16:27:34.091178+0000","last_fullsized":"2023-10-21T16:27:34.091178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963901+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T16:27:32.963901+0000","last_peered":"2023-10-21T16:27:32.963901+0000","last_clean":"2023-10-21T16:27:32.963901+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T16:27:32.963901+0000","last_undegraded":"2023-10-21T16:27:32.963901+0000","last_fullsized":"2023-10-21T16:27:32.963901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.056343+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T16:27:34.056343+0000","last_peered":"2023-10-21T16:27:34.056343+0000","last_clean":"2023-10-21T16:27:34.056343+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T16:27:34.056343+0000","last_undegraded":"2023-10-21T16:27:34.056343+0000","last_fullsized":"2023-10-21T16:27:34.056343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096915+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T16:27:34.096915+0000","last_peered":"2023-10-21T16:27:34.096915+0000","last_clean":"2023-10-21T16:27:34.096915+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T16:27:34.096915+0000","last_undegraded":"2023-10-21T16:27:34.096915+0000","last_fullsized":"2023-10-21T16:27:34.096915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.092667+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T16:27:34.092667+0000","last_peered":"2023-10-21T16:27:34.092667+0000","last_clean":"2023-10-21T16:27:34.092667+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T16:27:34.092667+0000","last_undegraded":"2023-10-21T16:27:34.092667+0000","last_fullsized":"2023-10-21T16:27:34.092667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251614+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T16:27:34.251614+0000","last_peered":"2023-10-21T16:27:34.251614+0000","last_clean":"2023-10-21T16:27:34.251614+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T16:27:34.251614+0000","last_undegraded":"2023-10-21T16:27:34.251614+0000","last_fullsized":"2023-10-21T16:27:34.251614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903139+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T16:27:31.903139+0000","last_peered":"2023-10-21T16:27:31.903139+0000","last_clean":"2023-10-21T16:27:31.903139+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T16:27:31.903139+0000","last_undegraded":"2023-10-21T16:27:31.903139+0000","last_fullsized":"2023-10-21T16:27:31.903139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964065+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T16:27:32.964065+0000","last_peered":"2023-10-21T16:27:32.964065+0000","last_clean":"2023-10-21T16:27:32.964065+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T16:27:32.964065+0000","last_undegraded":"2023-10-21T16:27:32.964065+0000","last_fullsized":"2023-10-21T16:27:32.964065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924836+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T16:27:31.924836+0000","last_peered":"2023-10-21T16:27:31.924836+0000","last_clean":"2023-10-21T16:27:31.924836+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T16:27:31.924836+0000","last_undegraded":"2023-10-21T16:27:31.924836+0000","last_fullsized":"2023-10-21T16:27:31.924836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.442637+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T16:27:33.442637+0000","last_peered":"2023-10-21T16:27:33.442637+0000","last_clean":"2023-10-21T16:27:33.442637+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T16:27:33.442637+0000","last_undegraded":"2023-10-21T16:27:33.442637+0000","last_fullsized":"2023-10-21T16:27:33.442637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.236938+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T16:27:34.236938+0000","last_peered":"2023-10-21T16:27:34.236938+0000","last_clean":"2023-10-21T16:27:34.236938+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T16:27:34.236938+0000","last_undegraded":"2023-10-21T16:27:34.236938+0000","last_fullsized":"2023-10-21T16:27:34.236938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963557+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T16:27:32.963557+0000","last_peered":"2023-10-21T16:27:32.963557+0000","last_clean":"2023-10-21T16:27:32.963557+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T16:27:32.963557+0000","last_undegraded":"2023-10-21T16:27:32.963557+0000","last_fullsized":"2023-10-21T16:27:32.963557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097335+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T16:27:34.097335+0000","last_peered":"2023-10-21T16:27:34.097335+0000","last_clean":"2023-10-21T16:27:34.097335+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T16:27:34.097335+0000","last_undegraded":"2023-10-21T16:27:34.097335+0000","last_fullsized":"2023-10-21T16:27:34.097335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968239+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T16:27:32.968239+0000","last_peered":"2023-10-21T16:27:32.968239+0000","last_clean":"2023-10-21T16:27:32.968239+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T16:27:32.968239+0000","last_undegraded":"2023-10-21T16:27:32.968239+0000","last_fullsized":"2023-10-21T16:27:32.968239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.226690+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T16:27:34.226690+0000","last_peered":"2023-10-21T16:27:34.226690+0000","last_clean":"2023-10-21T16:27:34.226690+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T16:27:34.226690+0000","last_undegraded":"2023-10-21T16:27:34.226690+0000","last_fullsized":"2023-10-21T16:27:34.226690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097096+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T16:27:34.097096+0000","last_peered":"2023-10-21T16:27:34.097096+0000","last_clean":"2023-10-21T16:27:34.097096+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T16:27:34.097096+0000","last_undegraded":"2023-10-21T16:27:34.097096+0000","last_fullsized":"2023-10-21T16:27:34.097096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220126+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T16:27:34.220126+0000","last_peered":"2023-10-21T16:27:34.220126+0000","last_clean":"2023-10-21T16:27:34.220126+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T16:27:34.220126+0000","last_undegraded":"2023-10-21T16:27:34.220126+0000","last_fullsized":"2023-10-21T16:27:34.220126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095946+0000","last_change":"2023-10-21T16:27:31.930741+0000","last_active":"2023-10-21T16:27:34.095946+0000","last_peered":"2023-10-21T16:27:34.095946+0000","last_clean":"2023-10-21T16:27:34.095946+0000","last_became_active":"2023-10-21T16:27:31.928572+0000","last_became_peered":"2023-10-21T16:27:31.928572+0000","last_unstale":"2023-10-21T16:27:34.095946+0000","last_undegraded":"2023-10-21T16:27:34.095946+0000","last_fullsized":"2023-10-21T16:27:34.095946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385988+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T16:27:32.385988+0000","last_peered":"2023-10-21T16:27:32.385988+0000","last_clean":"2023-10-21T16:27:32.385988+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T16:27:32.385988+0000","last_undegraded":"2023-10-21T16:27:32.385988+0000","last_fullsized":"2023-10-21T16:27:32.385988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964475+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T16:27:32.964475+0000","last_peered":"2023-10-21T16:27:32.964475+0000","last_clean":"2023-10-21T16:27:32.964475+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T16:27:32.964475+0000","last_undegraded":"2023-10-21T16:27:32.964475+0000","last_fullsized":"2023-10-21T16:27:32.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.914486+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T16:27:31.914486+0000","last_peered":"2023-10-21T16:27:31.914486+0000","last_clean":"2023-10-21T16:27:31.914486+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T16:27:31.914486+0000","last_undegraded":"2023-10-21T16:27:31.914486+0000","last_fullsized":"2023-10-21T16:27:31.914486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902068+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T16:27:31.902068+0000","last_peered":"2023-10-21T16:27:31.902068+0000","last_clean":"2023-10-21T16:27:31.902068+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T16:27:31.902068+0000","last_undegraded":"2023-10-21T16:27:31.902068+0000","last_fullsized":"2023-10-21T16:27:31.902068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051553+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T16:27:34.051553+0000","last_peered":"2023-10-21T16:27:34.051553+0000","last_clean":"2023-10-21T16:27:34.051553+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T16:27:34.051553+0000","last_undegraded":"2023-10-21T16:27:34.051553+0000","last_fullsized":"2023-10-21T16:27:34.051553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.896424+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T16:27:31.896424+0000","last_peered":"2023-10-21T16:27:31.896424+0000","last_clean":"2023-10-21T16:27:31.896424+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T16:27:31.896424+0000","last_undegraded":"2023-10-21T16:27:31.896424+0000","last_fullsized":"2023-10-21T16:27:31.896424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251499+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T16:27:34.251499+0000","last_peered":"2023-10-21T16:27:34.251499+0000","last_clean":"2023-10-21T16:27:34.251499+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T16:27:34.251499+0000","last_undegraded":"2023-10-21T16:27:34.251499+0000","last_fullsized":"2023-10-21T16:27:34.251499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895353+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T16:27:31.895353+0000","last_peered":"2023-10-21T16:27:31.895353+0000","last_clean":"2023-10-21T16:27:31.895353+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T16:27:31.895353+0000","last_undegraded":"2023-10-21T16:27:31.895353+0000","last_fullsized":"2023-10-21T16:27:31.895353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220030+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T16:27:34.220030+0000","last_peered":"2023-10-21T16:27:34.220030+0000","last_clean":"2023-10-21T16:27:34.220030+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T16:27:34.220030+0000","last_undegraded":"2023-10-21T16:27:34.220030+0000","last_fullsized":"2023-10-21T16:27:34.220030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903352+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T16:27:31.903352+0000","last_peered":"2023-10-21T16:27:31.903352+0000","last_clean":"2023-10-21T16:27:31.903352+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T16:27:31.903352+0000","last_undegraded":"2023-10-21T16:27:31.903352+0000","last_fullsized":"2023-10-21T16:27:31.903352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095853+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T16:27:34.095853+0000","last_peered":"2023-10-21T16:27:34.095853+0000","last_clean":"2023-10-21T16:27:34.095853+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T16:27:34.095853+0000","last_undegraded":"2023-10-21T16:27:34.095853+0000","last_fullsized":"2023-10-21T16:27:34.095853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.453559+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T16:27:32.453559+0000","last_peered":"2023-10-21T16:27:32.453559+0000","last_clean":"2023-10-21T16:27:32.453559+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T16:27:32.453559+0000","last_undegraded":"2023-10-21T16:27:32.453559+0000","last_fullsized":"2023-10-21T16:27:32.453559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966955+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T16:27:32.966955+0000","last_peered":"2023-10-21T16:27:32.966955+0000","last_clean":"2023-10-21T16:27:32.966955+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T16:27:32.966955+0000","last_undegraded":"2023-10-21T16:27:32.966955+0000","last_fullsized":"2023-10-21T16:27:32.966955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902982+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T16:27:31.902982+0000","last_peered":"2023-10-21T16:27:31.902982+0000","last_clean":"2023-10-21T16:27:31.902982+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T16:27:31.902982+0000","last_undegraded":"2023-10-21T16:27:31.902982+0000","last_fullsized":"2023-10-21T16:27:31.902982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251665+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T16:27:34.251665+0000","last_peered":"2023-10-21T16:27:34.251665+0000","last_clean":"2023-10-21T16:27:34.251665+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T16:27:34.251665+0000","last_undegraded":"2023-10-21T16:27:34.251665+0000","last_fullsized":"2023-10-21T16:27:34.251665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.450491+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T16:27:32.450491+0000","last_peered":"2023-10-21T16:27:32.450491+0000","last_clean":"2023-10-21T16:27:32.450491+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T16:27:32.450491+0000","last_undegraded":"2023-10-21T16:27:32.450491+0000","last_fullsized":"2023-10-21T16:27:32.450491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051698+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T16:27:34.051698+0000","last_peered":"2023-10-21T16:27:34.051698+0000","last_clean":"2023-10-21T16:27:34.051698+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T16:27:34.051698+0000","last_undegraded":"2023-10-21T16:27:34.051698+0000","last_fullsized":"2023-10-21T16:27:34.051698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.233077+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T16:27:34.233077+0000","last_peered":"2023-10-21T16:27:34.233077+0000","last_clean":"2023-10-21T16:27:34.233077+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T16:27:34.233077+0000","last_undegraded":"2023-10-21T16:27:34.233077+0000","last_fullsized":"2023-10-21T16:27:34.233077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051731+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T16:27:34.051731+0000","last_peered":"2023-10-21T16:27:34.051731+0000","last_clean":"2023-10-21T16:27:34.051731+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T16:27:34.051731+0000","last_undegraded":"2023-10-21T16:27:34.051731+0000","last_fullsized":"2023-10-21T16:27:34.051731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924681+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T16:27:31.924681+0000","last_peered":"2023-10-21T16:27:31.924681+0000","last_clean":"2023-10-21T16:27:31.924681+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T16:27:31.924681+0000","last_undegraded":"2023-10-21T16:27:31.924681+0000","last_fullsized":"2023-10-21T16:27:31.924681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963711+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T16:27:32.963711+0000","last_peered":"2023-10-21T16:27:32.963711+0000","last_clean":"2023-10-21T16:27:32.963711+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T16:27:32.963711+0000","last_undegraded":"2023-10-21T16:27:32.963711+0000","last_fullsized":"2023-10-21T16:27:32.963711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.450370+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T16:27:32.450370+0000","last_peered":"2023-10-21T16:27:32.450370+0000","last_clean":"2023-10-21T16:27:32.450370+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T16:27:32.450370+0000","last_undegraded":"2023-10-21T16:27:32.450370+0000","last_fullsized":"2023-10-21T16:27:32.450370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051453+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T16:27:34.051453+0000","last_peered":"2023-10-21T16:27:34.051453+0000","last_clean":"2023-10-21T16:27:34.051453+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T16:27:34.051453+0000","last_undegraded":"2023-10-21T16:27:34.051453+0000","last_fullsized":"2023-10-21T16:27:34.051453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385909+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T16:27:32.385909+0000","last_peered":"2023-10-21T16:27:32.385909+0000","last_clean":"2023-10-21T16:27:32.385909+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T16:27:32.385909+0000","last_undegraded":"2023-10-21T16:27:32.385909+0000","last_fullsized":"2023-10-21T16:27:32.385909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089055+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T16:27:34.089055+0000","last_peered":"2023-10-21T16:27:34.089055+0000","last_clean":"2023-10-21T16:27:34.089055+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T16:27:34.089055+0000","last_undegraded":"2023-10-21T16:27:34.089055+0000","last_fullsized":"2023-10-21T16:27:34.089055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.237359+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T16:27:34.237359+0000","last_peered":"2023-10-21T16:27:34.237359+0000","last_clean":"2023-10-21T16:27:34.237359+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T16:27:34.237359+0000","last_undegraded":"2023-10-21T16:27:34.237359+0000","last_fullsized":"2023-10-21T16:27:34.237359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963889+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T16:27:32.963889+0000","last_peered":"2023-10-21T16:27:32.963889+0000","last_clean":"2023-10-21T16:27:32.963889+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T16:27:32.963889+0000","last_undegraded":"2023-10-21T16:27:32.963889+0000","last_fullsized":"2023-10-21T16:27:32.963889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964440+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T16:27:32.964440+0000","last_peered":"2023-10-21T16:27:32.964440+0000","last_clean":"2023-10-21T16:27:32.964440+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T16:27:32.964440+0000","last_undegraded":"2023-10-21T16:27:32.964440+0000","last_fullsized":"2023-10-21T16:27:32.964440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.221456+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T16:27:34.221456+0000","last_peered":"2023-10-21T16:27:34.221456+0000","last_clean":"2023-10-21T16:27:34.221456+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T16:27:34.221456+0000","last_undegraded":"2023-10-21T16:27:34.221456+0000","last_fullsized":"2023-10-21T16:27:34.221456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443733+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T16:27:33.443733+0000","last_peered":"2023-10-21T16:27:33.443733+0000","last_clean":"2023-10-21T16:27:33.443733+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T16:27:33.443733+0000","last_undegraded":"2023-10-21T16:27:33.443733+0000","last_fullsized":"2023-10-21T16:27:33.443733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.222799+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T16:27:34.222799+0000","last_peered":"2023-10-21T16:27:34.222799+0000","last_clean":"2023-10-21T16:27:34.222799+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T16:27:34.222799+0000","last_undegraded":"2023-10-21T16:27:34.222799+0000","last_fullsized":"2023-10-21T16:27:34.222799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220333+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T16:27:34.220333+0000","last_peered":"2023-10-21T16:27:34.220333+0000","last_clean":"2023-10-21T16:27:34.220333+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T16:27:34.220333+0000","last_undegraded":"2023-10-21T16:27:34.220333+0000","last_fullsized":"2023-10-21T16:27:34.220333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220283+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T16:27:34.220283+0000","last_peered":"2023-10-21T16:27:34.220283+0000","last_clean":"2023-10-21T16:27:34.220283+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T16:27:34.220283+0000","last_undegraded":"2023-10-21T16:27:34.220283+0000","last_fullsized":"2023-10-21T16:27:34.220283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220227+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T16:27:34.220227+0000","last_peered":"2023-10-21T16:27:34.220227+0000","last_clean":"2023-10-21T16:27:34.220227+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T16:27:34.220227+0000","last_undegraded":"2023-10-21T16:27:34.220227+0000","last_fullsized":"2023-10-21T16:27:34.220227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.246388+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T16:27:34.246388+0000","last_peered":"2023-10-21T16:27:34.246388+0000","last_clean":"2023-10-21T16:27:34.246388+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T16:27:34.246388+0000","last_undegraded":"2023-10-21T16:27:34.246388+0000","last_fullsized":"2023-10-21T16:27:34.246388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476747,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":82075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T16:27:42.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T16:27:42.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.663+0000 7f9dd2815640 1 Processor -- start 2023-10-21T16:27:42.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.664+0000 7f9dd2815640 1 -- start start 2023-10-21T16:27:42.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.665+0000 7f9dd2815640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:42.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.665+0000 7f9dd2815640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc15a160 con 0x7f9dcc070030 2023-10-21T16:27:42.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.665+0000 7f9dd2815640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc070890 con 0x7f9dcc070480 2023-10-21T16:27:42.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.665+0000 7f9dd2815640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0c2140 con 0x7f9dcc14fc60 2023-10-21T16:27:42.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.665+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:42.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.666+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54296/0 (socket says 172.21.15.12:54296) 2023-10-21T16:27:42.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.666+0000 7f9dcbfff640 1 -- 172.21.15.12:0/1576481674 learned_addr learned my addr 172.21.15.12:0/1576481674 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:42.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.669+0000 7f9dcb7fe640 1 -- 172.21.15.12:0/1576481674 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282672205 0 0) 0x7f9dcc070890 con 0x7f9dcc070480 2023-10-21T16:27:42.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.669+0000 7f9dcb7fe640 1 -- 172.21.15.12:0/1576481674 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db8003520 con 0x7f9dcc070480 2023-10-21T16:27:42.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.670+0000 7f9dcbfff640 1 -- 172.21.15.12:0/1576481674 >> v1:172.21.15.99:6789/0 conn(0x7f9dcc070480 legacy=0x7f9dcc163b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.671+0000 7f9dcbfff640 1 -- 172.21.15.12:0/1576481674 >> v1:172.21.15.12:6789/0 conn(0x7f9dcc070030 legacy=0x7f9dcc0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.671+0000 7f9dcbfff640 1 -- 172.21.15.12:0/1576481674 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0c5d60 con 0x7f9dcc14fc60 2023-10-21T16:27:42.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.675+0000 7f9dcbfff640 1 --2- 172.21.15.12:0/1576481674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0098a0 tx=0x7f9dbc02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba921b47323445bc server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:42.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.680+0000 7f9dcb7fe640 1 -- 172.21.15.12:0/1576481674 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc02f830 con 0x7f9dcc14fc60 2023-10-21T16:27:42.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.680+0000 7f9dcb7fe640 1 -- 172.21.15.12:0/1576481674 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc02f990 con 0x7f9dcc14fc60 2023-10-21T16:27:42.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.680+0000 7f9dcb7fe640 1 -- 172.21.15.12:0/1576481674 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc02fd20 con 0x7f9dcc14fc60 2023-10-21T16:27:42.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.681+0000 7f9dd2815640 1 -- 172.21.15.12:0/1576481674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 msgr2=0x7f9dcc159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.681+0000 7f9dd2815640 1 --2- 172.21.15.12:0/1576481674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0098a0 tx=0x7f9dbc02ba10 comp rx=0 tx=0).stop 2023-10-21T16:27:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.681+0000 7f9dd2815640 1 -- 172.21.15.12:0/1576481674 shutdown_connections 2023-10-21T16:27:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.681+0000 7f9dd2815640 1 --2- 172.21.15.12:0/1576481674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc159c20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.681+0000 7f9dd2815640 1 -- 172.21.15.12:0/1576481674 >> 172.21.15.12:0/1576481674 conn(0x7f9dcc069de0 msgr2=0x7f9dcc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.682+0000 7f9dd2815640 1 -- 172.21.15.12:0/1576481674 shutdown_connections 2023-10-21T16:27:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.682+0000 7f9dd2815640 1 -- 172.21.15.12:0/1576481674 wait complete. 2023-10-21T16:27:42.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.683+0000 7f9dd2815640 1 Processor -- start 2023-10-21T16:27:42.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.684+0000 7f9dd2815640 1 -- start start 2023-10-21T16:27:42.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.684+0000 7f9dd2815640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 0x7f9dcc0c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:42.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.684+0000 7f9dd2815640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc070480 0x7f9dcc1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:42.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd2815640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd2815640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc153070 con 0x7f9dcc070030 2023-10-21T16:27:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd2815640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc150250 con 0x7f9dcc070480 2023-10-21T16:27:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd2815640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1ef0f0 con 0x7f9dcc14fc60 2023-10-21T16:27:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd0db2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 0x7f9dcc0c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd0db2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54298/0 (socket says 172.21.15.12:54298) 2023-10-21T16:27:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.685+0000 7f9dd0db2640 1 -- 172.21.15.12:0/4140559110 learned_addr learned my addr 172.21.15.12:0/4140559110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.686+0000 7f9dc3fff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc070480 0x7f9dcc1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.690+0000 7f9dcbfff640 1 -- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 msgr2=0x7f9dcc157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.690+0000 7f9dcbfff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.690+0000 7f9dcbfff640 1 -- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc070480 msgr2=0x7f9dcc1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.690+0000 7f9dcbfff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc070480 0x7f9dcc1513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.690+0000 7f9dcbfff640 1 -- 172.21.15.12:0/4140559110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0094d0 con 0x7f9dcc070030 2023-10-21T16:27:42.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.693+0000 7f9dcbfff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 0x7f9dcc0c4160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc033000 tx=0x7f9dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:42.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.697+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc046070 con 0x7f9dcc070030 2023-10-21T16:27:42.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.697+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0379c0 con 0x7f9dcc070030 2023-10-21T16:27:42.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.697+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc03b040 con 0x7f9dcc070030 2023-10-21T16:27:42.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.697+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc1504a0 con 0x7f9dcc070030 2023-10-21T16:27:42.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.697+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc150a60 con 0x7f9dcc070030 2023-10-21T16:27:42.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.698+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0c5740 con 0x7f9dcc070030 2023-10-21T16:27:42.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.729+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9dbc04b410 con 0x7f9dcc070030 2023-10-21T16:27:42.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.731+0000 7f9dc97fa640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 0x7f9dac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.732+0000 7f9dc3fff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 0x7f9dac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:42.733+0000 7f9dc3fff640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 0x7f9dac06d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06a8a0 tx=0x7f9db4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:43.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.053+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dbc07b480 con 0x7f9dcc070030 2023-10-21T16:27:43.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.055+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9dbc0777c0 con 0x7f9dcc070030 2023-10-21T16:27:43.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.263+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dcc0c5ac0 con 0x7f9dac06aec0 2023-10-21T16:27:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.271+0000 7f9dc97fa640 1 -- 172.21.15.12:0/4140559110 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264497 (secure 0 0 0) 0x7f9db4001460 con 0x7f9dac06aec0 2023-10-21T16:27:43.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:43.278 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T16:27:43.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 msgr2=0x7f9dac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:43.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 0x7f9dac06d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06a8a0 tx=0x7f9db4009040 comp rx=0 tx=0).stop 2023-10-21T16:27:43.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 msgr2=0x7f9dcc0c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:43.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 0x7f9dcc0c4160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc033000 tx=0x7f9dbc0046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 shutdown_connections 2023-10-21T16:27:43.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9dac06aec0 0x7f9dac06d380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dcc14fc60 0x7f9dcc157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc070480 0x7f9dcc1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 --2- 172.21.15.12:0/4140559110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dcc070030 0x7f9dcc0c4160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.277+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 >> 172.21.15.12:0/4140559110 conn(0x7f9dcc069de0 msgr2=0x7f9dcc0c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:43.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.278+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 shutdown_connections 2023-10-21T16:27:43.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.278+0000 7f9dd2815640 1 -- 172.21.15.12:0/4140559110 wait complete. 2023-10-21T16:27:43.300 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-21T16:27:43.258461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219172,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755548,"statfs":{"total":773094113280,"available":772869681152,"internally_reserved":0,"allocated":3088384,"data_stored":1823884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.291006"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096955+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T16:27:34.096955+0000","last_peered":"2023-10-21T16:27:34.096955+0000","last_clean":"2023-10-21T16:27:34.096955+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T16:27:34.096955+0000","last_undegraded":"2023-10-21T16:27:34.096955+0000","last_fullsized":"2023-10-21T16:27:34.096955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220196+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T16:27:34.220196+0000","last_peered":"2023-10-21T16:27:34.220196+0000","last_clean":"2023-10-21T16:27:34.220196+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T16:27:34.220196+0000","last_undegraded":"2023-10-21T16:27:34.220196+0000","last_fullsized":"2023-10-21T16:27:34.220196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220057+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T16:27:34.220057+0000","last_peered":"2023-10-21T16:27:34.220057+0000","last_clean":"2023-10-21T16:27:34.220057+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T16:27:34.220057+0000","last_undegraded":"2023-10-21T16:27:34.220057+0000","last_fullsized":"2023-10-21T16:27:34.220057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967774+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T16:27:32.967774+0000","last_peered":"2023-10-21T16:27:32.967774+0000","last_clean":"2023-10-21T16:27:32.967774+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T16:27:32.967774+0000","last_undegraded":"2023-10-21T16:27:32.967774+0000","last_fullsized":"2023-10-21T16:27:32.967774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096319+0000","last_change":"2023-10-21T16:27:31.926876+0000","last_active":"2023-10-21T16:27:34.096319+0000","last_peered":"2023-10-21T16:27:34.096319+0000","last_clean":"2023-10-21T16:27:34.096319+0000","last_became_active":"2023-10-21T16:27:31.924739+0000","last_became_peered":"2023-10-21T16:27:31.924739+0000","last_unstale":"2023-10-21T16:27:34.096319+0000","last_undegraded":"2023-10-21T16:27:34.096319+0000","last_fullsized":"2023-10-21T16:27:34.096319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967014+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T16:27:32.967014+0000","last_peered":"2023-10-21T16:27:32.967014+0000","last_clean":"2023-10-21T16:27:32.967014+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T16:27:32.967014+0000","last_undegraded":"2023-10-21T16:27:32.967014+0000","last_fullsized":"2023-10-21T16:27:32.967014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095632+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T16:27:34.095632+0000","last_peered":"2023-10-21T16:27:34.095632+0000","last_clean":"2023-10-21T16:27:34.095632+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T16:27:34.095632+0000","last_undegraded":"2023-10-21T16:27:34.095632+0000","last_fullsized":"2023-10-21T16:27:34.095632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219959+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T16:27:34.219959+0000","last_peered":"2023-10-21T16:27:34.219959+0000","last_clean":"2023-10-21T16:27:34.219959+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T16:27:34.219959+0000","last_undegraded":"2023-10-21T16:27:34.219959+0000","last_fullsized":"2023-10-21T16:27:34.219959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.444446+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T16:27:33.444446+0000","last_peered":"2023-10-21T16:27:33.444446+0000","last_clean":"2023-10-21T16:27:33.444446+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T16:27:33.444446+0000","last_undegraded":"2023-10-21T16:27:33.444446+0000","last_fullsized":"2023-10-21T16:27:33.444446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096902+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T16:27:34.096902+0000","last_peered":"2023-10-21T16:27:34.096902+0000","last_clean":"2023-10-21T16:27:34.096902+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T16:27:34.096902+0000","last_undegraded":"2023-10-21T16:27:34.096902+0000","last_fullsized":"2023-10-21T16:27:34.096902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096870+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T16:27:34.096870+0000","last_peered":"2023-10-21T16:27:34.096870+0000","last_clean":"2023-10-21T16:27:34.096870+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T16:27:34.096870+0000","last_undegraded":"2023-10-21T16:27:34.096870+0000","last_fullsized":"2023-10-21T16:27:34.096870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095803+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T16:27:34.095803+0000","last_peered":"2023-10-21T16:27:34.095803+0000","last_clean":"2023-10-21T16:27:34.095803+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T16:27:34.095803+0000","last_undegraded":"2023-10-21T16:27:34.095803+0000","last_fullsized":"2023-10-21T16:27:34.095803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251595+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T16:27:34.251595+0000","last_peered":"2023-10-21T16:27:34.251595+0000","last_clean":"2023-10-21T16:27:34.251595+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T16:27:34.251595+0000","last_undegraded":"2023-10-21T16:27:34.251595+0000","last_fullsized":"2023-10-21T16:27:34.251595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251551+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T16:27:34.251551+0000","last_peered":"2023-10-21T16:27:34.251551+0000","last_clean":"2023-10-21T16:27:34.251551+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T16:27:34.251551+0000","last_undegraded":"2023-10-21T16:27:34.251551+0000","last_fullsized":"2023-10-21T16:27:34.251551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219911+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T16:27:34.219911+0000","last_peered":"2023-10-21T16:27:34.219911+0000","last_clean":"2023-10-21T16:27:34.219911+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T16:27:34.219911+0000","last_undegraded":"2023-10-21T16:27:34.219911+0000","last_fullsized":"2023-10-21T16:27:34.219911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963543+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T16:27:32.963543+0000","last_peered":"2023-10-21T16:27:32.963543+0000","last_clean":"2023-10-21T16:27:32.963543+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T16:27:32.963543+0000","last_undegraded":"2023-10-21T16:27:32.963543+0000","last_fullsized":"2023-10-21T16:27:32.963543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964833+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T16:27:32.964833+0000","last_peered":"2023-10-21T16:27:32.964833+0000","last_clean":"2023-10-21T16:27:32.964833+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T16:27:32.964833+0000","last_undegraded":"2023-10-21T16:27:32.964833+0000","last_fullsized":"2023-10-21T16:27:32.964833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089146+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T16:27:34.089146+0000","last_peered":"2023-10-21T16:27:34.089146+0000","last_clean":"2023-10-21T16:27:34.089146+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T16:27:34.089146+0000","last_undegraded":"2023-10-21T16:27:34.089146+0000","last_fullsized":"2023-10-21T16:27:34.089146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964685+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T16:27:32.964685+0000","last_peered":"2023-10-21T16:27:32.964685+0000","last_clean":"2023-10-21T16:27:32.964685+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T16:27:32.964685+0000","last_undegraded":"2023-10-21T16:27:32.964685+0000","last_fullsized":"2023-10-21T16:27:32.964685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095995+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T16:27:34.095995+0000","last_peered":"2023-10-21T16:27:34.095995+0000","last_clean":"2023-10-21T16:27:34.095995+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T16:27:34.095995+0000","last_undegraded":"2023-10-21T16:27:34.095995+0000","last_fullsized":"2023-10-21T16:27:34.095995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051716+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T16:27:34.051716+0000","last_peered":"2023-10-21T16:27:34.051716+0000","last_clean":"2023-10-21T16:27:34.051716+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T16:27:34.051716+0000","last_undegraded":"2023-10-21T16:27:34.051716+0000","last_fullsized":"2023-10-21T16:27:34.051716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443049+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T16:27:33.443049+0000","last_peered":"2023-10-21T16:27:33.443049+0000","last_clean":"2023-10-21T16:27:33.443049+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T16:27:33.443049+0000","last_undegraded":"2023-10-21T16:27:33.443049+0000","last_fullsized":"2023-10-21T16:27:33.443049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220071+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T16:27:34.220071+0000","last_peered":"2023-10-21T16:27:34.220071+0000","last_clean":"2023-10-21T16:27:34.220071+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T16:27:34.220071+0000","last_undegraded":"2023-10-21T16:27:34.220071+0000","last_fullsized":"2023-10-21T16:27:34.220071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963620+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T16:27:32.963620+0000","last_peered":"2023-10-21T16:27:32.963620+0000","last_clean":"2023-10-21T16:27:32.963620+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T16:27:32.963620+0000","last_undegraded":"2023-10-21T16:27:32.963620+0000","last_fullsized":"2023-10-21T16:27:32.963620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220273+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T16:27:34.220273+0000","last_peered":"2023-10-21T16:27:34.220273+0000","last_clean":"2023-10-21T16:27:34.220273+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T16:27:34.220273+0000","last_undegraded":"2023-10-21T16:27:34.220273+0000","last_fullsized":"2023-10-21T16:27:34.220273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968086+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T16:27:32.968086+0000","last_peered":"2023-10-21T16:27:32.968086+0000","last_clean":"2023-10-21T16:27:32.968086+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T16:27:32.968086+0000","last_undegraded":"2023-10-21T16:27:32.968086+0000","last_fullsized":"2023-10-21T16:27:32.968086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251803+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T16:27:34.251803+0000","last_peered":"2023-10-21T16:27:34.251803+0000","last_clean":"2023-10-21T16:27:34.251803+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T16:27:34.251803+0000","last_undegraded":"2023-10-21T16:27:34.251803+0000","last_fullsized":"2023-10-21T16:27:34.251803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251649+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T16:27:34.251649+0000","last_peered":"2023-10-21T16:27:34.251649+0000","last_clean":"2023-10-21T16:27:34.251649+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T16:27:34.251649+0000","last_undegraded":"2023-10-21T16:27:34.251649+0000","last_fullsized":"2023-10-21T16:27:34.251649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220059+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T16:27:34.220059+0000","last_peered":"2023-10-21T16:27:34.220059+0000","last_clean":"2023-10-21T16:27:34.220059+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T16:27:34.220059+0000","last_undegraded":"2023-10-21T16:27:34.220059+0000","last_fullsized":"2023-10-21T16:27:34.220059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963880+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T16:27:32.963880+0000","last_peered":"2023-10-21T16:27:32.963880+0000","last_clean":"2023-10-21T16:27:32.963880+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T16:27:32.963880+0000","last_undegraded":"2023-10-21T16:27:32.963880+0000","last_fullsized":"2023-10-21T16:27:32.963880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.088942+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T16:27:34.088942+0000","last_peered":"2023-10-21T16:27:34.088942+0000","last_clean":"2023-10-21T16:27:34.088942+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T16:27:34.088942+0000","last_undegraded":"2023-10-21T16:27:34.088942+0000","last_fullsized":"2023-10-21T16:27:34.088942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966760+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T16:27:32.966760+0000","last_peered":"2023-10-21T16:27:32.966760+0000","last_clean":"2023-10-21T16:27:32.966760+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T16:27:32.966760+0000","last_undegraded":"2023-10-21T16:27:32.966760+0000","last_fullsized":"2023-10-21T16:27:32.966760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443231+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T16:27:33.443231+0000","last_peered":"2023-10-21T16:27:33.443231+0000","last_clean":"2023-10-21T16:27:33.443231+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T16:27:33.443231+0000","last_undegraded":"2023-10-21T16:27:33.443231+0000","last_fullsized":"2023-10-21T16:27:33.443231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220184+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T16:27:34.220184+0000","last_peered":"2023-10-21T16:27:34.220184+0000","last_clean":"2023-10-21T16:27:34.220184+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T16:27:34.220184+0000","last_undegraded":"2023-10-21T16:27:34.220184+0000","last_fullsized":"2023-10-21T16:27:34.220184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051700+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T16:27:34.051700+0000","last_peered":"2023-10-21T16:27:34.051700+0000","last_clean":"2023-10-21T16:27:34.051700+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T16:27:34.051700+0000","last_undegraded":"2023-10-21T16:27:34.051700+0000","last_fullsized":"2023-10-21T16:27:34.051700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964000+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T16:27:32.964000+0000","last_peered":"2023-10-21T16:27:32.964000+0000","last_clean":"2023-10-21T16:27:32.964000+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T16:27:32.964000+0000","last_undegraded":"2023-10-21T16:27:32.964000+0000","last_fullsized":"2023-10-21T16:27:32.964000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385858+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T16:27:32.385858+0000","last_peered":"2023-10-21T16:27:32.385858+0000","last_clean":"2023-10-21T16:27:32.385858+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T16:27:32.385858+0000","last_undegraded":"2023-10-21T16:27:32.385858+0000","last_fullsized":"2023-10-21T16:27:32.385858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220101+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T16:27:34.220101+0000","last_peered":"2023-10-21T16:27:34.220101+0000","last_clean":"2023-10-21T16:27:34.220101+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T16:27:34.220101+0000","last_undegraded":"2023-10-21T16:27:34.220101+0000","last_fullsized":"2023-10-21T16:27:34.220101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895978+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T16:27:31.895978+0000","last_peered":"2023-10-21T16:27:31.895978+0000","last_clean":"2023-10-21T16:27:31.895978+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T16:27:31.895978+0000","last_undegraded":"2023-10-21T16:27:31.895978+0000","last_fullsized":"2023-10-21T16:27:31.895978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051556+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T16:27:34.051556+0000","last_peered":"2023-10-21T16:27:34.051556+0000","last_clean":"2023-10-21T16:27:34.051556+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T16:27:34.051556+0000","last_undegraded":"2023-10-21T16:27:34.051556+0000","last_fullsized":"2023-10-21T16:27:34.051556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.917463+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T16:27:31.917463+0000","last_peered":"2023-10-21T16:27:31.917463+0000","last_clean":"2023-10-21T16:27:31.917463+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T16:27:31.917463+0000","last_undegraded":"2023-10-21T16:27:31.917463+0000","last_fullsized":"2023-10-21T16:27:31.917463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968166+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T16:27:32.968166+0000","last_peered":"2023-10-21T16:27:32.968166+0000","last_clean":"2023-10-21T16:27:32.968166+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T16:27:32.968166+0000","last_undegraded":"2023-10-21T16:27:32.968166+0000","last_fullsized":"2023-10-21T16:27:32.968166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.927903+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T16:27:31.927903+0000","last_peered":"2023-10-21T16:27:31.927903+0000","last_clean":"2023-10-21T16:27:31.927903+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T16:27:31.927903+0000","last_undegraded":"2023-10-21T16:27:31.927903+0000","last_fullsized":"2023-10-21T16:27:31.927903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220385+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T16:27:34.220385+0000","last_peered":"2023-10-21T16:27:34.220385+0000","last_clean":"2023-10-21T16:27:34.220385+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T16:27:34.220385+0000","last_undegraded":"2023-10-21T16:27:34.220385+0000","last_fullsized":"2023-10-21T16:27:34.220385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.091178+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T16:27:34.091178+0000","last_peered":"2023-10-21T16:27:34.091178+0000","last_clean":"2023-10-21T16:27:34.091178+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T16:27:34.091178+0000","last_undegraded":"2023-10-21T16:27:34.091178+0000","last_fullsized":"2023-10-21T16:27:34.091178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963901+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T16:27:32.963901+0000","last_peered":"2023-10-21T16:27:32.963901+0000","last_clean":"2023-10-21T16:27:32.963901+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T16:27:32.963901+0000","last_undegraded":"2023-10-21T16:27:32.963901+0000","last_fullsized":"2023-10-21T16:27:32.963901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.056343+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T16:27:34.056343+0000","last_peered":"2023-10-21T16:27:34.056343+0000","last_clean":"2023-10-21T16:27:34.056343+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T16:27:34.056343+0000","last_undegraded":"2023-10-21T16:27:34.056343+0000","last_fullsized":"2023-10-21T16:27:34.056343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096915+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T16:27:34.096915+0000","last_peered":"2023-10-21T16:27:34.096915+0000","last_clean":"2023-10-21T16:27:34.096915+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T16:27:34.096915+0000","last_undegraded":"2023-10-21T16:27:34.096915+0000","last_fullsized":"2023-10-21T16:27:34.096915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.092667+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T16:27:34.092667+0000","last_peered":"2023-10-21T16:27:34.092667+0000","last_clean":"2023-10-21T16:27:34.092667+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T16:27:34.092667+0000","last_undegraded":"2023-10-21T16:27:34.092667+0000","last_fullsized":"2023-10-21T16:27:34.092667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251614+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T16:27:34.251614+0000","last_peered":"2023-10-21T16:27:34.251614+0000","last_clean":"2023-10-21T16:27:34.251614+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T16:27:34.251614+0000","last_undegraded":"2023-10-21T16:27:34.251614+0000","last_fullsized":"2023-10-21T16:27:34.251614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903139+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T16:27:31.903139+0000","last_peered":"2023-10-21T16:27:31.903139+0000","last_clean":"2023-10-21T16:27:31.903139+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T16:27:31.903139+0000","last_undegraded":"2023-10-21T16:27:31.903139+0000","last_fullsized":"2023-10-21T16:27:31.903139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964065+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T16:27:32.964065+0000","last_peered":"2023-10-21T16:27:32.964065+0000","last_clean":"2023-10-21T16:27:32.964065+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T16:27:32.964065+0000","last_undegraded":"2023-10-21T16:27:32.964065+0000","last_fullsized":"2023-10-21T16:27:32.964065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924836+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T16:27:31.924836+0000","last_peered":"2023-10-21T16:27:31.924836+0000","last_clean":"2023-10-21T16:27:31.924836+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T16:27:31.924836+0000","last_undegraded":"2023-10-21T16:27:31.924836+0000","last_fullsized":"2023-10-21T16:27:31.924836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.442637+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T16:27:33.442637+0000","last_peered":"2023-10-21T16:27:33.442637+0000","last_clean":"2023-10-21T16:27:33.442637+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T16:27:33.442637+0000","last_undegraded":"2023-10-21T16:27:33.442637+0000","last_fullsized":"2023-10-21T16:27:33.442637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.236938+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T16:27:34.236938+0000","last_peered":"2023-10-21T16:27:34.236938+0000","last_clean":"2023-10-21T16:27:34.236938+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T16:27:34.236938+0000","last_undegraded":"2023-10-21T16:27:34.236938+0000","last_fullsized":"2023-10-21T16:27:34.236938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963557+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T16:27:32.963557+0000","last_peered":"2023-10-21T16:27:32.963557+0000","last_clean":"2023-10-21T16:27:32.963557+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T16:27:32.963557+0000","last_undegraded":"2023-10-21T16:27:32.963557+0000","last_fullsized":"2023-10-21T16:27:32.963557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097335+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T16:27:34.097335+0000","last_peered":"2023-10-21T16:27:34.097335+0000","last_clean":"2023-10-21T16:27:34.097335+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T16:27:34.097335+0000","last_undegraded":"2023-10-21T16:27:34.097335+0000","last_fullsized":"2023-10-21T16:27:34.097335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968239+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T16:27:32.968239+0000","last_peered":"2023-10-21T16:27:32.968239+0000","last_clean":"2023-10-21T16:27:32.968239+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T16:27:32.968239+0000","last_undegraded":"2023-10-21T16:27:32.968239+0000","last_fullsized":"2023-10-21T16:27:32.968239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.226690+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T16:27:34.226690+0000","last_peered":"2023-10-21T16:27:34.226690+0000","last_clean":"2023-10-21T16:27:34.226690+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T16:27:34.226690+0000","last_undegraded":"2023-10-21T16:27:34.226690+0000","last_fullsized":"2023-10-21T16:27:34.226690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097096+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T16:27:34.097096+0000","last_peered":"2023-10-21T16:27:34.097096+0000","last_clean":"2023-10-21T16:27:34.097096+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T16:27:34.097096+0000","last_undegraded":"2023-10-21T16:27:34.097096+0000","last_fullsized":"2023-10-21T16:27:34.097096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220126+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T16:27:34.220126+0000","last_peered":"2023-10-21T16:27:34.220126+0000","last_clean":"2023-10-21T16:27:34.220126+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T16:27:34.220126+0000","last_undegraded":"2023-10-21T16:27:34.220126+0000","last_fullsized":"2023-10-21T16:27:34.220126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095946+0000","last_change":"2023-10-21T16:27:31.930741+0000","last_active":"2023-10-21T16:27:34.095946+0000","last_peered":"2023-10-21T16:27:34.095946+0000","last_clean":"2023-10-21T16:27:34.095946+0000","last_became_active":"2023-10-21T16:27:31.928572+0000","last_became_peered":"2023-10-21T16:27:31.928572+0000","last_unstale":"2023-10-21T16:27:34.095946+0000","last_undegraded":"2023-10-21T16:27:34.095946+0000","last_fullsized":"2023-10-21T16:27:34.095946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385988+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T16:27:32.385988+0000","last_peered":"2023-10-21T16:27:32.385988+0000","last_clean":"2023-10-21T16:27:32.385988+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T16:27:32.385988+0000","last_undegraded":"2023-10-21T16:27:32.385988+0000","last_fullsized":"2023-10-21T16:27:32.385988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964475+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T16:27:32.964475+0000","last_peered":"2023-10-21T16:27:32.964475+0000","last_clean":"2023-10-21T16:27:32.964475+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T16:27:32.964475+0000","last_undegraded":"2023-10-21T16:27:32.964475+0000","last_fullsized":"2023-10-21T16:27:32.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.914486+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T16:27:31.914486+0000","last_peered":"2023-10-21T16:27:31.914486+0000","last_clean":"2023-10-21T16:27:31.914486+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T16:27:31.914486+0000","last_undegraded":"2023-10-21T16:27:31.914486+0000","last_fullsized":"2023-10-21T16:27:31.914486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902068+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T16:27:31.902068+0000","last_peered":"2023-10-21T16:27:31.902068+0000","last_clean":"2023-10-21T16:27:31.902068+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T16:27:31.902068+0000","last_undegraded":"2023-10-21T16:27:31.902068+0000","last_fullsized":"2023-10-21T16:27:31.902068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051553+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T16:27:34.051553+0000","last_peered":"2023-10-21T16:27:34.051553+0000","last_clean":"2023-10-21T16:27:34.051553+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T16:27:34.051553+0000","last_undegraded":"2023-10-21T16:27:34.051553+0000","last_fullsized":"2023-10-21T16:27:34.051553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.896424+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T16:27:31.896424+0000","last_peered":"2023-10-21T16:27:31.896424+0000","last_clean":"2023-10-21T16:27:31.896424+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T16:27:31.896424+0000","last_undegraded":"2023-10-21T16:27:31.896424+0000","last_fullsized":"2023-10-21T16:27:31.896424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251499+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T16:27:34.251499+0000","last_peered":"2023-10-21T16:27:34.251499+0000","last_clean":"2023-10-21T16:27:34.251499+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T16:27:34.251499+0000","last_undegraded":"2023-10-21T16:27:34.251499+0000","last_fullsized":"2023-10-21T16:27:34.251499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895353+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T16:27:31.895353+0000","last_peered":"2023-10-21T16:27:31.895353+0000","last_clean":"2023-10-21T16:27:31.895353+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T16:27:31.895353+0000","last_undegraded":"2023-10-21T16:27:31.895353+0000","last_fullsized":"2023-10-21T16:27:31.895353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220030+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T16:27:34.220030+0000","last_peered":"2023-10-21T16:27:34.220030+0000","last_clean":"2023-10-21T16:27:34.220030+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T16:27:34.220030+0000","last_undegraded":"2023-10-21T16:27:34.220030+0000","last_fullsized":"2023-10-21T16:27:34.220030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903352+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T16:27:31.903352+0000","last_peered":"2023-10-21T16:27:31.903352+0000","last_clean":"2023-10-21T16:27:31.903352+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T16:27:31.903352+0000","last_undegraded":"2023-10-21T16:27:31.903352+0000","last_fullsized":"2023-10-21T16:27:31.903352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095853+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T16:27:34.095853+0000","last_peered":"2023-10-21T16:27:34.095853+0000","last_clean":"2023-10-21T16:27:34.095853+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T16:27:34.095853+0000","last_undegraded":"2023-10-21T16:27:34.095853+0000","last_fullsized":"2023-10-21T16:27:34.095853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.453559+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T16:27:32.453559+0000","last_peered":"2023-10-21T16:27:32.453559+0000","last_clean":"2023-10-21T16:27:32.453559+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T16:27:32.453559+0000","last_undegraded":"2023-10-21T16:27:32.453559+0000","last_fullsized":"2023-10-21T16:27:32.453559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966955+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T16:27:32.966955+0000","last_peered":"2023-10-21T16:27:32.966955+0000","last_clean":"2023-10-21T16:27:32.966955+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T16:27:32.966955+0000","last_undegraded":"2023-10-21T16:27:32.966955+0000","last_fullsized":"2023-10-21T16:27:32.966955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902982+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T16:27:31.902982+0000","last_peered":"2023-10-21T16:27:31.902982+0000","last_clean":"2023-10-21T16:27:31.902982+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T16:27:31.902982+0000","last_undegraded":"2023-10-21T16:27:31.902982+0000","last_fullsized":"2023-10-21T16:27:31.902982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251665+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T16:27:34.251665+0000","last_peered":"2023-10-21T16:27:34.251665+0000","last_clean":"2023-10-21T16:27:34.251665+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T16:27:34.251665+0000","last_undegraded":"2023-10-21T16:27:34.251665+0000","last_fullsized":"2023-10-21T16:27:34.251665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051893+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T16:27:34.051893+0000","last_peered":"2023-10-21T16:27:34.051893+0000","last_clean":"2023-10-21T16:27:34.051893+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T16:27:34.051893+0000","last_undegraded":"2023-10-21T16:27:34.051893+0000","last_fullsized":"2023-10-21T16:27:34.051893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051698+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T16:27:34.051698+0000","last_peered":"2023-10-21T16:27:34.051698+0000","last_clean":"2023-10-21T16:27:34.051698+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T16:27:34.051698+0000","last_undegraded":"2023-10-21T16:27:34.051698+0000","last_fullsized":"2023-10-21T16:27:34.051698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.233077+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T16:27:34.233077+0000","last_peered":"2023-10-21T16:27:34.233077+0000","last_clean":"2023-10-21T16:27:34.233077+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T16:27:34.233077+0000","last_undegraded":"2023-10-21T16:27:34.233077+0000","last_fullsized":"2023-10-21T16:27:34.233077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051731+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T16:27:34.051731+0000","last_peered":"2023-10-21T16:27:34.051731+0000","last_clean":"2023-10-21T16:27:34.051731+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T16:27:34.051731+0000","last_undegraded":"2023-10-21T16:27:34.051731+0000","last_fullsized":"2023-10-21T16:27:34.051731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924681+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T16:27:31.924681+0000","last_peered":"2023-10-21T16:27:31.924681+0000","last_clean":"2023-10-21T16:27:31.924681+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T16:27:31.924681+0000","last_undegraded":"2023-10-21T16:27:31.924681+0000","last_fullsized":"2023-10-21T16:27:31.924681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963711+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T16:27:32.963711+0000","last_peered":"2023-10-21T16:27:32.963711+0000","last_clean":"2023-10-21T16:27:32.963711+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T16:27:32.963711+0000","last_undegraded":"2023-10-21T16:27:32.963711+0000","last_fullsized":"2023-10-21T16:27:32.963711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.450370+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T16:27:32.450370+0000","last_peered":"2023-10-21T16:27:32.450370+0000","last_clean":"2023-10-21T16:27:32.450370+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T16:27:32.450370+0000","last_undegraded":"2023-10-21T16:27:32.450370+0000","last_fullsized":"2023-10-21T16:27:32.450370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051453+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T16:27:34.051453+0000","last_peered":"2023-10-21T16:27:34.051453+0000","last_clean":"2023-10-21T16:27:34.051453+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T16:27:34.051453+0000","last_undegraded":"2023-10-21T16:27:34.051453+0000","last_fullsized":"2023-10-21T16:27:34.051453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385909+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T16:27:32.385909+0000","last_peered":"2023-10-21T16:27:32.385909+0000","last_clean":"2023-10-21T16:27:32.385909+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T16:27:32.385909+0000","last_undegraded":"2023-10-21T16:27:32.385909+0000","last_fullsized":"2023-10-21T16:27:32.385909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089055+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T16:27:34.089055+0000","last_peered":"2023-10-21T16:27:34.089055+0000","last_clean":"2023-10-21T16:27:34.089055+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T16:27:34.089055+0000","last_undegraded":"2023-10-21T16:27:34.089055+0000","last_fullsized":"2023-10-21T16:27:34.089055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.237359+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T16:27:34.237359+0000","last_peered":"2023-10-21T16:27:34.237359+0000","last_clean":"2023-10-21T16:27:34.237359+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T16:27:34.237359+0000","last_undegraded":"2023-10-21T16:27:34.237359+0000","last_fullsized":"2023-10-21T16:27:34.237359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963889+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T16:27:32.963889+0000","last_peered":"2023-10-21T16:27:32.963889+0000","last_clean":"2023-10-21T16:27:32.963889+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T16:27:32.963889+0000","last_undegraded":"2023-10-21T16:27:32.963889+0000","last_fullsized":"2023-10-21T16:27:32.963889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964440+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T16:27:32.964440+0000","last_peered":"2023-10-21T16:27:32.964440+0000","last_clean":"2023-10-21T16:27:32.964440+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T16:27:32.964440+0000","last_undegraded":"2023-10-21T16:27:32.964440+0000","last_fullsized":"2023-10-21T16:27:32.964440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.221456+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T16:27:34.221456+0000","last_peered":"2023-10-21T16:27:34.221456+0000","last_clean":"2023-10-21T16:27:34.221456+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T16:27:34.221456+0000","last_undegraded":"2023-10-21T16:27:34.221456+0000","last_fullsized":"2023-10-21T16:27:34.221456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443733+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T16:27:33.443733+0000","last_peered":"2023-10-21T16:27:33.443733+0000","last_clean":"2023-10-21T16:27:33.443733+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T16:27:33.443733+0000","last_undegraded":"2023-10-21T16:27:33.443733+0000","last_fullsized":"2023-10-21T16:27:33.443733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.222799+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T16:27:34.222799+0000","last_peered":"2023-10-21T16:27:34.222799+0000","last_clean":"2023-10-21T16:27:34.222799+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T16:27:34.222799+0000","last_undegraded":"2023-10-21T16:27:34.222799+0000","last_fullsized":"2023-10-21T16:27:34.222799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220333+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T16:27:34.220333+0000","last_peered":"2023-10-21T16:27:34.220333+0000","last_clean":"2023-10-21T16:27:34.220333+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T16:27:34.220333+0000","last_undegraded":"2023-10-21T16:27:34.220333+0000","last_fullsized":"2023-10-21T16:27:34.220333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220283+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T16:27:34.220283+0000","last_peered":"2023-10-21T16:27:34.220283+0000","last_clean":"2023-10-21T16:27:34.220283+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T16:27:34.220283+0000","last_undegraded":"2023-10-21T16:27:34.220283+0000","last_fullsized":"2023-10-21T16:27:34.220283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220227+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T16:27:34.220227+0000","last_peered":"2023-10-21T16:27:34.220227+0000","last_clean":"2023-10-21T16:27:34.220227+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T16:27:34.220227+0000","last_undegraded":"2023-10-21T16:27:34.220227+0000","last_fullsized":"2023-10-21T16:27:34.220227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.246388+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T16:27:34.246388+0000","last_peered":"2023-10-21T16:27:34.246388+0000","last_clean":"2023-10-21T16:27:34.246388+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T16:27:34.246388+0000","last_undegraded":"2023-10-21T16:27:34.246388+0000","last_fullsized":"2023-10-21T16:27:34.246388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476747,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":82075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T16:27:43.305 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-21T16:27:43.306 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-21T16:27:43.306 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-21T16:27:43.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-21T16:27:43.307 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-21T16:27:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.562+0000 7f06c951d640 1 Processor -- start 2023-10-21T16:27:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.562+0000 7f06c951d640 1 -- start start 2023-10-21T16:27:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.564+0000 7f06c951d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.564+0000 7f06c951d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06c4157cc0 0x7f06c4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.564+0000 7f06c951d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40c23f0 con 0x7f06c40c59d0 2023-10-21T16:27:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.564+0000 7f06c951d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c4156fa0 con 0x7f06c4157cc0 2023-10-21T16:27:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.564+0000 7f06c951d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c415aaf0 con 0x7f06c40c55f0 2023-10-21T16:27:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.565+0000 7f06c2ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.565+0000 7f06bbfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06c4157cc0 0x7f06c4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.565+0000 7f06c2ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53824/0 (socket says 172.21.15.12:53824) 2023-10-21T16:27:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.565+0000 7f06c2ffd640 1 -- 172.21.15.12:0/4249118383 learned_addr learned my addr 172.21.15.12:0/4249118383 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.567+0000 7f06c2ffd640 1 -- 172.21.15.12:0/4249118383 >> v2:172.21.15.99:3300/0 conn(0x7f06c4157cc0 msgr2=0x7f06c4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.567+0000 7f06c2ffd640 1 --2- 172.21.15.12:0/4249118383 >> v2:172.21.15.99:3300/0 conn(0x7f06c4157cc0 0x7f06c4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.567+0000 7f06c2ffd640 1 -- 172.21.15.12:0/4249118383 >> v1:172.21.15.12:6789/0 conn(0x7f06c40c59d0 legacy=0x7f06c40c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.567+0000 7f06c2ffd640 1 -- 172.21.15.12:0/4249118383 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c415add0 con 0x7f06c40c55f0 2023-10-21T16:27:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.569+0000 7f06c2ffd640 1 --2- 172.21.15.12:0/4249118383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009870 tx=0x7f06b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fe6117e73bfcd server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:43.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.572+0000 7f06c27fc640 1 -- 172.21.15.12:0/4249118383 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4030840 con 0x7f06c40c55f0 2023-10-21T16:27:43.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.572+0000 7f06c27fc640 1 -- 172.21.15.12:0/4249118383 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40309a0 con 0x7f06c40c55f0 2023-10-21T16:27:43.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.572+0000 7f06c27fc640 1 -- 172.21.15.12:0/4249118383 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4030d30 con 0x7f06c40c55f0 2023-10-21T16:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.573+0000 7f06c951d640 1 -- 172.21.15.12:0/4249118383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 msgr2=0x7f06c4157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.573+0000 7f06c951d640 1 --2- 172.21.15.12:0/4249118383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009870 tx=0x7f06b402b980 comp rx=0 tx=0).stop 2023-10-21T16:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 -- 172.21.15.12:0/4249118383 shutdown_connections 2023-10-21T16:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 --2- 172.21.15.12:0/4249118383 >> v2:172.21.15.99:3300/0 conn(0x7f06c4157cc0 0x7f06c4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 --2- 172.21.15.12:0/4249118383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c55f0 0x7f06c4157780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 -- 172.21.15.12:0/4249118383 >> 172.21.15.12:0/4249118383 conn(0x7f06c4069de0 msgr2=0x7f06c406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 -- 172.21.15.12:0/4249118383 shutdown_connections 2023-10-21T16:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.574+0000 7f06c951d640 1 -- 172.21.15.12:0/4249118383 wait complete. 2023-10-21T16:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.576+0000 7f06c951d640 1 Processor -- start 2023-10-21T16:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.576+0000 7f06c951d640 1 -- start start 2023-10-21T16:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.577+0000 7f06c951d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06c40c55f0 0x7f06c4159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.577+0000 7f06c951d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c951d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06c4157cc0 0x7f06c41448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c951d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4143f40 con 0x7f06c4157cc0 2023-10-21T16:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c951d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c41eff00 con 0x7f06c40c55f0 2023-10-21T16:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c951d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40c7750 con 0x7f06c40c59d0 2023-10-21T16:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06bbfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06c4157cc0 0x7f06c41448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.578+0000 7f06c2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06c40c55f0 0x7f06c4159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.579+0000 7f06bbfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53838/0 (socket says 172.21.15.12:53838) 2023-10-21T16:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.579+0000 7f06bbfff640 1 -- 172.21.15.12:0/3215800436 learned_addr learned my addr 172.21.15.12:0/3215800436 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.582+0000 7f06bbfff640 1 -- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06c40c55f0 msgr2=0x7f06c4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.582+0000 7f06bbfff640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06c40c55f0 0x7f06c4159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.582+0000 7f06bbfff640 1 -- 172.21.15.12:0/3215800436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06c4157cc0 msgr2=0x7f06c41448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:43.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.582+0000 7f06bbfff640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06c4157cc0 0x7f06c41448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:43.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.582+0000 7f06bbfff640 1 -- 172.21.15.12:0/3215800436 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40094d0 con 0x7f06c40c59d0 2023-10-21T16:27:43.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.584+0000 7f06bbfff640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00e870 tx=0x7f06ac00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:43.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.587+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0094f0 con 0x7f06c40c59d0 2023-10-21T16:27:43.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.588+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac00c940 con 0x7f06c40c59d0 2023-10-21T16:27:43.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.588+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00ccf0 con 0x7f06c40c59d0 2023-10-21T16:27:43.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.588+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c41f01c0 con 0x7f06c40c59d0 2023-10-21T16:27:43.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.588+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c41f0780 con 0x7f06c40c59d0 2023-10-21T16:27:43.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.589+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40619f0 con 0x7f06c40c59d0 2023-10-21T16:27:43.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.608+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06ac013470 con 0x7f06c40c59d0 2023-10-21T16:27:43.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.609+0000 7f06bb7fe640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 0x7f06a406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:43.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.610+0000 7f06c2ffd640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 0x7f06a406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.611+0000 7f06c2ffd640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 0x7f06a406d3b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06b4036000 tx=0x7f06b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.830+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06ac058bd0 con 0x7f06c40c59d0 2023-10-21T16:27:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:43.841+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06ac054f10 con 0x7f06c40c59d0 2023-10-21T16:27:44.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.104+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f06c414b0d0 con 0x7f06c40c59d0 2023-10-21T16:27:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.245+0000 7f06bb7fe640 1 -- 172.21.15.12:0/3215800436 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171027 (secure 0 0 0) 0x7f06ac021020 con 0x7f06c40c59d0 2023-10-21T16:27:44.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 msgr2=0x7f06a406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 0x7f06a406d3b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06b4036000 tx=0x7f06b4008030 comp rx=0 tx=0).stop 2023-10-21T16:27:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 msgr2=0x7f06c4144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00e870 tx=0x7f06ac00ed30 comp rx=0 tx=0).stop 2023-10-21T16:27:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 shutdown_connections 2023-10-21T16:27:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f06a406aef0 0x7f06a406d3b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06c4157cc0 0x7f06c41448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06c40c59d0 0x7f06c4144360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 --2- 172.21.15.12:0/3215800436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06c40c55f0 0x7f06c4159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 >> 172.21.15.12:0/3215800436 conn(0x7f06c4069de0 msgr2=0x7f06c4155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.251+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 shutdown_connections 2023-10-21T16:27:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.252+0000 7f06c951d640 1 -- 172.21.15.12:0/3215800436 wait complete. 2023-10-21T16:27:44.278 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":381435415},{"type":"v1","addr":"172.21.15.99:6801","nonce":381435415}]},"active_addr":"172.21.15.99:6801/381435415","active_change":"2023-10-21T16:26:54.788853+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3408978583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1903010425}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":4119127663}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1813545896}]}]} 2023-10-21T16:27:44.282 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-21T16:27:44.282 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-21T16:27:44.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.503+0000 7f21c4d41640 1 Processor -- start 2023-10-21T16:27:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.503+0000 7f21c4d41640 1 -- start start 2023-10-21T16:27:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21c00c55f0 0x7f21c0157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21c0157cc0 0x7f21c0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00c23f0 con 0x7f21c0157cc0 2023-10-21T16:27:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c0156fa0 con 0x7f21c00c55f0 2023-10-21T16:27:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.505+0000 7f21c4d41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015aaf0 con 0x7f21c00c59d0 2023-10-21T16:27:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.506+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.506+0000 7f21be59c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21c00c55f0 0x7f21c0157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.506+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53850/0 (socket says 172.21.15.12:53850) 2023-10-21T16:27:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.506+0000 7f21bed9d640 1 -- 172.21.15.12:0/373326479 learned_addr learned my addr 172.21.15.12:0/373326479 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.508+0000 7f21bed9d640 1 -- 172.21.15.12:0/373326479 >> v2:172.21.15.99:3300/0 conn(0x7f21c00c55f0 msgr2=0x7f21c0157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.508+0000 7f21bed9d640 1 --2- 172.21.15.12:0/373326479 >> v2:172.21.15.99:3300/0 conn(0x7f21c00c55f0 0x7f21c0157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.508+0000 7f21bed9d640 1 -- 172.21.15.12:0/373326479 >> v2:172.21.15.12:3300/0 conn(0x7f21c0157cc0 msgr2=0x7f21c0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.508+0000 7f21bed9d640 1 --2- 172.21.15.12:0/373326479 >> v2:172.21.15.12:3300/0 conn(0x7f21c0157cc0 0x7f21c0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.508+0000 7f21bed9d640 1 -- 172.21.15.12:0/373326479 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c015add0 con 0x7f21c00c59d0 2023-10-21T16:27:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.511+0000 7f21bed9d640 1 --2- 172.21.15.12:0/373326479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21c00c50a0 tx=0x7f21b802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e4aedd5b95e780 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.516+0000 7f21bdd9b640 1 -- 172.21.15.12:0/373326479 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b802cb00 con 0x7f21c00c59d0 2023-10-21T16:27:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.516+0000 7f21bdd9b640 1 -- 172.21.15.12:0/373326479 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b802cc60 con 0x7f21c00c59d0 2023-10-21T16:27:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.516+0000 7f21bdd9b640 1 -- 172.21.15.12:0/373326479 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80343f0 con 0x7f21c00c59d0 2023-10-21T16:27:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 -- 172.21.15.12:0/373326479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 msgr2=0x7f21c0151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 --2- 172.21.15.12:0/373326479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21c00c50a0 tx=0x7f21b802bf60 comp rx=0 tx=0).stop 2023-10-21T16:27:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 -- 172.21.15.12:0/373326479 shutdown_connections 2023-10-21T16:27:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 --2- 172.21.15.12:0/373326479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c00c59d0 0x7f21c0151320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 --2- 172.21.15.12:0/373326479 >> v2:172.21.15.12:3300/0 conn(0x7f21c0157cc0 0x7f21c0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 --2- 172.21.15.12:0/373326479 >> v2:172.21.15.99:3300/0 conn(0x7f21c00c55f0 0x7f21c0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 -- 172.21.15.12:0/373326479 >> 172.21.15.12:0/373326479 conn(0x7f21c0069de0 msgr2=0x7f21c006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 -- 172.21.15.12:0/373326479 shutdown_connections 2023-10-21T16:27:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.517+0000 7f21c4d41640 1 -- 172.21.15.12:0/373326479 wait complete. 2023-10-21T16:27:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.519+0000 7f21c4d41640 1 Processor -- start 2023-10-21T16:27:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.519+0000 7f21c4d41640 1 -- start start 2023-10-21T16:27:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00c55f0 0x7f21c014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c00c59d0 0x7f21c01436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0070a80 con 0x7f21c00c59d0 2023-10-21T16:27:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00701c0 con 0x7f21c00c55f0 2023-10-21T16:27:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.520+0000 7f21c4d41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00ca000 con 0x7f21c0157cc0 2023-10-21T16:27:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.521+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.521+0000 7f21be59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00c55f0 0x7f21c014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.521+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53856/0 (socket says 172.21.15.12:53856) 2023-10-21T16:27:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.521+0000 7f21bed9d640 1 -- 172.21.15.12:0/4064497398 learned_addr learned my addr 172.21.15.12:0/4064497398 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:44.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.525+0000 7f21bed9d640 1 -- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00c55f0 msgr2=0x7f21c014d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:44.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.525+0000 7f21bed9d640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00c55f0 0x7f21c014d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.525+0000 7f21bed9d640 1 -- 172.21.15.12:0/4064497398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c00c59d0 msgr2=0x7f21c01436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.525+0000 7f21bed9d640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c00c59d0 0x7f21c01436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.525+0000 7f21bed9d640 1 -- 172.21.15.12:0/4064497398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009b30 con 0x7f21c0157cc0 2023-10-21T16:27:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.527+0000 7f21bed9d640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21b8036040 tx=0x7f21b8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.530+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8009510 con 0x7f21c0157cc0 2023-10-21T16:27:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.531+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b803e450 con 0x7f21c0157cc0 2023-10-21T16:27:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.531+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b803e7e0 con 0x7f21c0157cc0 2023-10-21T16:27:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.531+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0070430 con 0x7f21c0157cc0 2023-10-21T16:27:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.531+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00ca2e0 con 0x7f21c0157cc0 2023-10-21T16:27:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.532+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c00619f0 con 0x7f21c0157cc0 2023-10-21T16:27:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.554+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21b803e940 con 0x7f21c0157cc0 2023-10-21T16:27:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.555+0000 7f21b6ffd640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 0x7f21a006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.555+0000 7f21be59c640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 0x7f21a006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.556+0000 7f21be59c640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 0x7f21a006d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009aa0 tx=0x7f21b0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.779+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21b807bef0 con 0x7f21c0157cc0 2023-10-21T16:27:44.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:44.792+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21b8077b30 con 0x7f21c0157cc0 2023-10-21T16:27:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.002+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c0070bc0 con 0x7f21c0157cc0 2023-10-21T16:27:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.038+0000 7f21b6ffd640 1 -- 172.21.15.12:0/4064497398 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f21b8043020 con 0x7f21c0157cc0 2023-10-21T16:27:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:45.041 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 msgr2=0x7f21a006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 0x7f21a006d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009aa0 tx=0x7f21b0009190 comp rx=0 tx=0).stop 2023-10-21T16:27:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 msgr2=0x7f21c0071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21b8036040 tx=0x7f21b8004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 shutdown_connections 2023-10-21T16:27:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f21a006aec0 0x7f21a006d380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21c0157cc0 0x7f21c0071050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c00c59d0 0x7f21c01436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 --2- 172.21.15.12:0/4064497398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00c55f0 0x7f21c014d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 >> 172.21.15.12:0/4064497398 conn(0x7f21c0069de0 msgr2=0x7f21c0155680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 shutdown_connections 2023-10-21T16:27:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.041+0000 7f21c4d41640 1 -- 172.21.15.12:0/4064497398 wait complete. 2023-10-21T16:27:45.062 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-21T16:27:45.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.287+0000 7fd455a90640 1 Processor -- start 2023-10-21T16:27:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.287+0000 7fd455a90640 1 -- start start 2023-10-21T16:27:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.289+0000 7fd455a90640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd450156680 0x7fd45006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.289+0000 7fd455a90640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4500c7150 0x7fd45015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.289+0000 7fd455a90640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500c7700 con 0x7fd4500c9bf0 2023-10-21T16:27:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.289+0000 7fd455a90640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500c9020 con 0x7fd4500c7150 2023-10-21T16:27:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.289+0000 7fd455a90640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45006b9a0 con 0x7fd450156680 2023-10-21T16:27:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.290+0000 7fd44f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd450156680 0x7fd45006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.290+0000 7fd44f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd450156680 0x7fd45006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60522/0 (socket says 172.21.15.12:60522) 2023-10-21T16:27:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.290+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2861449592 learned_addr learned my addr 172.21.15.12:0/2861449592 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.292+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2861449592 >> v2:172.21.15.12:3300/0 conn(0x7fd4500c7150 msgr2=0x7fd45015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.292+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/2861449592 >> v2:172.21.15.12:3300/0 conn(0x7fd4500c7150 0x7fd45015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.292+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2861449592 >> v1:172.21.15.12:6789/0 conn(0x7fd4500c9bf0 legacy=0x7fd4500c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.292+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2861449592 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45006bc80 con 0x7fd450156680 2023-10-21T16:27:45.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.294+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/2861449592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd450156680 0x7fd45006aef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ca2a0 tx=0x7fd44002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aedc5aa04e151473 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2861449592 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440030860 con 0x7fd450156680 2023-10-21T16:27:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2861449592 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4400309c0 con 0x7fd450156680 2023-10-21T16:27:45.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2861449592 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440030d50 con 0x7fd450156680 2023-10-21T16:27:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 -- 172.21.15.12:0/2861449592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd450156680 msgr2=0x7fd45006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 --2- 172.21.15.12:0/2861449592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd450156680 0x7fd45006aef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ca2a0 tx=0x7fd44002b9a0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 -- 172.21.15.12:0/2861449592 shutdown_connections 2023-10-21T16:27:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 --2- 172.21.15.12:0/2861449592 >> v2:172.21.15.12:3300/0 conn(0x7fd4500c7150 0x7fd45015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 --2- 172.21.15.12:0/2861449592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd450156680 0x7fd45006aef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.298+0000 7fd455a90640 1 -- 172.21.15.12:0/2861449592 >> 172.21.15.12:0/2861449592 conn(0x7fd450065ab0 msgr2=0x7fd450065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.299+0000 7fd455a90640 1 -- 172.21.15.12:0/2861449592 shutdown_connections 2023-10-21T16:27:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.299+0000 7fd455a90640 1 -- 172.21.15.12:0/2861449592 wait complete. 2023-10-21T16:27:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.300+0000 7fd455a90640 1 Processor -- start 2023-10-21T16:27:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.300+0000 7fd455a90640 1 -- start start 2023-10-21T16:27:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500c9bf0 0x7fd4500b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd450156680 0x7fd4500b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500ca860 con 0x7fd4500c9bf0 2023-10-21T16:27:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f2c60 con 0x7fd4500c7150 2023-10-21T16:27:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.301+0000 7fd455a90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45015add0 con 0x7fd450156680 2023-10-21T16:27:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.302+0000 7fd44f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.302+0000 7fd44f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60528/0 (socket says 172.21.15.12:60528) 2023-10-21T16:27:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.302+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2951446636 learned_addr learned my addr 172.21.15.12:0/2951446636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.302+0000 7fd44ffff640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd450156680 0x7fd4500b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.305+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd450156680 msgr2=0x7fd4500b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.306+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd450156680 0x7fd4500b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.306+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2951446636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500c9bf0 msgr2=0x7fd4500b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.306+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500c9bf0 0x7fd4500b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.306+0000 7fd44f7fe640 1 -- 172.21.15.12:0/2951446636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400094d0 con 0x7fd4500c7150 2023-10-21T16:27:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.308+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd440000c00 tx=0x7fd440004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.310+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440039d40 con 0x7fd4500c7150 2023-10-21T16:27:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.310+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45015b0b0 con 0x7fd4500c7150 2023-10-21T16:27:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.310+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd450159e20 con 0x7fd4500c7150 2023-10-21T16:27:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.311+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45006cc30 con 0x7fd4500c7150 2023-10-21T16:27:45.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.329+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44004d460 con 0x7fd4500c7150 2023-10-21T16:27:45.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.329+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440039ea0 con 0x7fd4500c7150 2023-10-21T16:27:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.332+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd44004d810 con 0x7fd4500c7150 2023-10-21T16:27:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.333+0000 7fd437fff640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.334+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44003e070 con 0x7fd4500c7150 2023-10-21T16:27:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.334+0000 7fd44effd640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.335+0000 7fd44effd640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 0x7fd43c06d360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ad5b0 tx=0x7fd444007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.574+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd440078380 con 0x7fd4500c7150 2023-10-21T16:27:45.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.784+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4500619f0 con 0x7fd4500c7150 2023-10-21T16:27:45.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.927+0000 7fd437fff640 1 -- 172.21.15.12:0/2951446636 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fd44007b9a0 con 0x7fd4500c7150 2023-10-21T16:27:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:45.930 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 msgr2=0x7fd43c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 0x7fd43c06d360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ad5b0 tx=0x7fd444007990 comp rx=0 tx=0).stop 2023-10-21T16:27:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 msgr2=0x7fd4501f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd440000c00 tx=0x7fd440004730 comp rx=0 tx=0).stop 2023-10-21T16:27:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 shutdown_connections 2023-10-21T16:27:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd450156680 0x7fd4500b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500c9bf0 0x7fd4500b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 --2- 172.21.15.12:0/2951446636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4500c7150 0x7fd4501f21f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:45.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 >> 172.21.15.12:0/2951446636 conn(0x7fd450065ab0 msgr2=0x7fd4500ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:45.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.931+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 shutdown_connections 2023-10-21T16:27:45.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:45.932+0000 7fd455a90640 1 -- 172.21.15.12:0/2951446636 wait complete. 2023-10-21T16:27:45.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-21T16:27:45.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-21T16:27:45.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-21T16:27:45.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-21T16:27:45.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-21T16:27:45.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-21T16:27:45.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-21T16:27:45.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-21T16:27:46.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.281+0000 7f942c361640 1 Processor -- start 2023-10-21T16:27:46.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.282+0000 7f942c361640 1 -- start start 2023-10-21T16:27:46.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.283+0000 7fb803fff640 1 Processor -- start 2023-10-21T16:27:46.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.283+0000 7fb803fff640 1 -- start start 2023-10-21T16:27:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.284+0000 7f942c361640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f942414fc60 0x7f9424159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.284+0000 7f942c361640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.284+0000 7f942c361640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94240708b0 con 0x7f9424070030 2023-10-21T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.284+0000 7f942c361640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94240c2140 con 0x7f942414fc60 2023-10-21T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.284+0000 7f942c361640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942415d6d0 con 0x7f9424070460 2023-10-21T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.285+0000 7f942a8fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.285+0000 7fb803fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 0x7fb8041613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.285+0000 7fb803fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7fb803fff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb804161920 con 0x7fb804157670 2023-10-21T16:27:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7f942a8fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53870/0 (socket says 172.21.15.12:53870) 2023-10-21T16:27:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7f942a8fe640 1 -- 172.21.15.12:0/103312423 learned_addr learned my addr 172.21.15.12:0/103312423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7f942a0fd640 1 --2- 172.21.15.12:0/103312423 >> v2:172.21.15.99:3300/0 conn(0x7f942414fc60 0x7f9424159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7fb803fff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040c9b60 con 0x7fb8040c9740 2023-10-21T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.286+0000 7fb803fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80415de20 con 0x7fb8040ce720 2023-10-21T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.287+0000 7fb8027fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 0x7fb8041613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.287+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.287+0000 7fb8027fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 0x7fb8041613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60558/0 (socket says 172.21.15.12:60558) 2023-10-21T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.287+0000 7fb8027fc640 1 -- 172.21.15.12:0/401947494 learned_addr learned my addr 172.21.15.12:0/401947494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.288+0000 7f942a8fe640 1 -- 172.21.15.12:0/103312423 >> v2:172.21.15.99:3300/0 conn(0x7f942414fc60 msgr2=0x7f9424159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.288+0000 7f942a8fe640 1 --2- 172.21.15.12:0/103312423 >> v2:172.21.15.99:3300/0 conn(0x7f942414fc60 0x7f9424159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.288+0000 7f942a8fe640 1 -- 172.21.15.12:0/103312423 >> v1:172.21.15.99:6789/0 conn(0x7f9424070030 legacy=0x7f94240c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.288+0000 7f942a8fe640 1 -- 172.21.15.12:0/103312423 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942415a160 con 0x7f9424070460 2023-10-21T16:27:46.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.291+0000 7f2962e90640 1 Processor -- start 2023-10-21T16:27:46.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.291+0000 7f2962e90640 1 -- start start 2023-10-21T16:27:46.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.292+0000 7fb8037fe640 1 -- 172.21.15.12:0/401947494 >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 msgr2=0x7fb8041613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.292+0000 7fb8037fe640 1 --2- 172.21.15.12:0/401947494 >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 0x7fb8041613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.292+0000 7fb8037fe640 1 -- 172.21.15.12:0/401947494 >> v1:172.21.15.99:6789/0 conn(0x7fb804157670 legacy=0x7fb8040c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.292+0000 7fb8037fe640 1 -- 172.21.15.12:0/401947494 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040c3e50 con 0x7fb8040ce720 2023-10-21T16:27:46.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.292+0000 7f0ffa52e640 1 Processor -- start 2023-10-21T16:27:46.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.293+0000 7f942a8fe640 1 --2- 172.21.15.12:0/103312423 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f941c009e50 tx=0x7f941c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb0fb819be00eea server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.293+0000 7f0ffa52e640 1 -- start start 2023-10-21T16:27:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.293+0000 7f2962e90640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f295c0c97e0 0x7f295c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.293+0000 7f2962e90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c0cbe40 0x7f295c159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.293+0000 7f2962e90640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0cc250 con 0x7f295c153490 2023-10-21T16:27:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.294+0000 7f2962e90640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c153870 con 0x7f295c0c97e0 2023-10-21T16:27:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.294+0000 7f2962e90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0cb0a0 con 0x7f295c0cbe40 2023-10-21T16:27:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.294+0000 7f0ffa52e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fec0d90b0 0x7f0fec049fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f295bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f295c0c97e0 0x7f295c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.294+0000 7f0ffa52e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec049a60 0x7f0fec04fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f0ffa52e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec04f710 con 0x7f0fec0df930 2023-10-21T16:27:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f0ffa52e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec00ee30 con 0x7f0fec0d90b0 2023-10-21T16:27:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f0ffa52e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec00f110 con 0x7f0fec049a60 2023-10-21T16:27:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f295bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f295c0c97e0 0x7f295c15a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47482/0 (socket says 172.21.15.12:47482) 2023-10-21T16:27:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f295bfff640 1 -- 172.21.15.12:0/1767600876 learned_addr learned my addr 172.21.15.12:0/1767600876 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.295+0000 7f243af16640 1 Processor -- start 2023-10-21T16:27:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.296+0000 7f243af16640 1 -- start start 2023-10-21T16:27:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f0ff9d2d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0fec0df930 0x7f0fec0071c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44268/0 (socket says 172.21.15.12:44268) 2023-10-21T16:27:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/1519196083 learned_addr learned my addr 172.21.15.12:0/1519196083 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f243af16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f243415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f243af16640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340cc270 con 0x7f24340c97e0 2023-10-21T16:27:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f243af16640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2434153870 con 0x7f24340cbe40 2023-10-21T16:27:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f243af16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340cb0a0 con 0x7f2434153490 2023-10-21T16:27:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.297+0000 7f296142d640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c0cbe40 0x7f295c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.298+0000 7fb8037fe640 1 --2- 172.21.15.12:0/401947494 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040ceb90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097a0 tx=0x7fb7f402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c3ed7ac728954a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.299+0000 7f295bfff640 1 -- 172.21.15.12:0/1767600876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c0cbe40 msgr2=0x7f295c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.299+0000 7f295bfff640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c0cbe40 0x7f295c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.299+0000 7f295bfff640 1 -- 172.21.15.12:0/1767600876 >> v1:172.21.15.99:6789/0 conn(0x7f295c153490 legacy=0x7f295c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.299+0000 7f295bfff640 1 -- 172.21.15.12:0/1767600876 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c159cf0 con 0x7f295c0c97e0 2023-10-21T16:27:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f2438cb2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f243415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f94290fb640 1 -- 172.21.15.12:0/103312423 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c02cb00 con 0x7f9424070460 2023-10-21T16:27:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f94290fb640 1 -- 172.21.15.12:0/103312423 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c02cc60 con 0x7f9424070460 2023-10-21T16:27:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f94290fb640 1 -- 172.21.15.12:0/103312423 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0343f0 con 0x7f9424070460 2023-10-21T16:27:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f0ff952c640 1 --2- 172.21.15.12:0/1519196083 >> v2:172.21.15.99:3300/0 conn(0x7f0fec0d90b0 0x7f0fec049fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f3e6a568640 1 Processor -- start 2023-10-21T16:27:46.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f24394b3640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f24340cbe40 0x7f2434159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:55980/0 (socket says 172.21.15.12:55980) 2023-10-21T16:27:46.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.301+0000 7f24394b3640 1 -- 172.21.15.12:0/1086420639 learned_addr learned my addr 172.21.15.12:0/1086420639 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f0ff8d2b640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec049a60 0x7f0fec04fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f3e6a568640 1 -- start start 2023-10-21T16:27:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 -- 172.21.15.12:0/103312423 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 msgr2=0x7f9424163b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 --2- 172.21.15.12:0/103312423 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f941c009e50 tx=0x7f941c02bf60 comp rx=0 tx=0).stop 2023-10-21T16:27:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 -- 172.21.15.12:0/103312423 shutdown_connections 2023-10-21T16:27:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 --2- 172.21.15.12:0/103312423 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070460 0x7f9424163b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 --2- 172.21.15.12:0/103312423 >> v2:172.21.15.99:3300/0 conn(0x7f942414fc60 0x7f9424159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 -- 172.21.15.12:0/103312423 >> 172.21.15.12:0/103312423 conn(0x7f9424069de0 msgr2=0x7f942406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 -- 172.21.15.12:0/103312423 shutdown_connections 2023-10-21T16:27:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.302+0000 7f942c361640 1 -- 172.21.15.12:0/103312423 wait complete. 2023-10-21T16:27:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f3e6a568640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e640c55f0 0x7f3e64157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f3e6a568640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f3e6a568640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640c23f0 con 0x7f3e64157cc0 2023-10-21T16:27:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f3e6a568640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e64156fa0 con 0x7f3e640c55f0 2023-10-21T16:27:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f3e6a568640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6415aaf0 con 0x7f3e640c59d0 2023-10-21T16:27:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.304+0000 7f6ea340e640 1 Processor -- start 2023-10-21T16:27:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f942c361640 1 Processor -- start 2023-10-21T16:27:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f295bfff640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c15a600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2948009870 tx=0x7f294802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a70df8887192d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f0ff952c640 1 -- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec049a60 msgr2=0x7f0fec04fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f0ff952c640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec049a60 0x7f0fec04fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f0ff952c640 1 -- 172.21.15.12:0/1519196083 >> v1:172.21.15.12:6789/0 conn(0x7f0fec0df930 legacy=0x7f0fec0071c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f0ff952c640 1 -- 172.21.15.12:0/1519196083 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec00f3f0 con 0x7f0fec0d90b0 2023-10-21T16:27:46.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f6ea340e640 1 -- start start 2023-10-21T16:27:46.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.305+0000 7f942c361640 1 -- start start 2023-10-21T16:27:46.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.306+0000 7f942c361640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070030 0x7f94241f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.306+0000 7f6ea340e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e9c0c3f80 0x7f6e9c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f6ea340e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c0c80f0 con 0x7f6e9c067790 2023-10-21T16:27:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f6ea340e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c155840 con 0x7f6e9c155390 2023-10-21T16:27:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f6ea340e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c1563c0 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f942c361640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9424070460 0x7f94240c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.306+0000 7f2438cb2640 1 -- 172.21.15.12:0/1086420639 >> v1:172.21.15.99:6789/0 conn(0x7f24340cbe40 legacy=0x7f2434159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.306+0000 7f2438cb2640 1 -- 172.21.15.12:0/1086420639 >> v1:172.21.15.12:6789/0 conn(0x7f24340c97e0 legacy=0x7f24340ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.306+0000 7f2438cb2640 1 -- 172.21.15.12:0/1086420639 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434159cf0 con 0x7f2434153490 2023-10-21T16:27:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f942c361640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f942414fc60 0x7f9424142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f942c361640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241eed10 con 0x7f9424070460 2023-10-21T16:27:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f942c361640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241f2790 con 0x7f942414fc60 2023-10-21T16:27:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.307+0000 7f942c361640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240c2db0 con 0x7f9424070030 2023-10-21T16:27:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.309+0000 7f0ff952c640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 0x7f0fec049fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3186a06a366f02 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.311+0000 7f0d12501640 1 Processor -- start 2023-10-21T16:27:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.311+0000 7f0d12501640 1 -- start start 2023-10-21T16:27:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.311+0000 7f2438cb2640 1 --2- 172.21.15.12:0/1086420639 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f243415a600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f242c0097d0 tx=0x7f242c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c54c9e5b3d37d9c server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f0d12501640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d0c0c97e0 0x7f0d0c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f0d12501640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 0x7f0d0c159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f295b7fe640 1 -- 172.21.15.12:0/1767600876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948031640 con 0x7f295c0c97e0 2023-10-21T16:27:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f0d12501640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0cc250 con 0x7f0d0c153490 2023-10-21T16:27:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f0d12501640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c153870 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.312+0000 7f0d12501640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0cb0a0 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f295b7fe640 1 -- 172.21.15.12:0/1767600876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29480317a0 con 0x7f295c0c97e0 2023-10-21T16:27:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f295b7fe640 1 -- 172.21.15.12:0/1767600876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948031b30 con 0x7f295c0c97e0 2023-10-21T16:27:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 -- 172.21.15.12:0/1767600876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 msgr2=0x7f295c15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c15a600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2948009870 tx=0x7f294802b8f0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 -- 172.21.15.12:0/1767600876 shutdown_connections 2023-10-21T16:27:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c0cbe40 0x7f295c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 --2- 172.21.15.12:0/1767600876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c15a600 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.313+0000 7f2962e90640 1 -- 172.21.15.12:0/1767600876 >> 172.21.15.12:0/1767600876 conn(0x7f295c0716f0 msgr2=0x7f295c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.314+0000 7f2962e90640 1 -- 172.21.15.12:0/1767600876 shutdown_connections 2023-10-21T16:27:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.314+0000 7f2962e90640 1 -- 172.21.15.12:0/1767600876 wait complete. 2023-10-21T16:27:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.314+0000 7f3e68b05640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.314+0000 7f6ea19ab640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e9c0c3f80 0x7f6e9c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.315+0000 7f942a8fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f942414fc60 0x7f9424142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.315+0000 7f6ea19ab640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e9c0c3f80 0x7f6e9c160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60566/0 (socket says 172.21.15.12:60566) 2023-10-21T16:27:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.315+0000 7f6ea19ab640 1 -- 172.21.15.12:0/1334333603 learned_addr learned my addr 172.21.15.12:0/1334333603 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.315+0000 7f3e68b05640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53914/0 (socket says 172.21.15.12:53914) 2023-10-21T16:27:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.315+0000 7f3e68b05640 1 -- 172.21.15.12:0/2398010181 learned_addr learned my addr 172.21.15.12:0/2398010181 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb801ffb640 1 -- 172.21.15.12:0/401947494 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4030800 con 0x7fb8040ce720 2023-10-21T16:27:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb801ffb640 1 -- 172.21.15.12:0/401947494 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4030960 con 0x7fb8040ce720 2023-10-21T16:27:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb801ffb640 1 -- 172.21.15.12:0/401947494 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4030cf0 con 0x7fb8040ce720 2023-10-21T16:27:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7f2962e90640 1 Processor -- start 2023-10-21T16:27:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7f942a8fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f942414fc60 0x7f9424142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60574/0 (socket says 172.21.15.12:60574) 2023-10-21T16:27:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7f942a8fe640 1 -- 172.21.15.12:0/4285226379 learned_addr learned my addr 172.21.15.12:0/4285226379 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7f942a0fd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070030 0x7f94241f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7f2962e90640 1 -- start start 2023-10-21T16:27:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 -- 172.21.15.12:0/401947494 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 msgr2=0x7fb8040ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 --2- 172.21.15.12:0/401947494 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040ceb90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097a0 tx=0x7fb7f402b940 comp rx=0 tx=0).stop 2023-10-21T16:27:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 -- 172.21.15.12:0/401947494 shutdown_connections 2023-10-21T16:27:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 --2- 172.21.15.12:0/401947494 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040ceb90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 --2- 172.21.15.12:0/401947494 >> v2:172.21.15.99:3300/0 conn(0x7fb8040c9740 0x7fb8041613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.316+0000 7fb803fff640 1 -- 172.21.15.12:0/401947494 >> 172.21.15.12:0/401947494 conn(0x7fb804071510 msgr2=0x7fb8040718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7fb803fff640 1 -- 172.21.15.12:0/401947494 shutdown_connections 2023-10-21T16:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7fb803fff640 1 -- 172.21.15.12:0/401947494 wait complete. 2023-10-21T16:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f295c0cbe40 0x7f295c1ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 0x7f295c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c148440 con 0x7f295c0c97e0 2023-10-21T16:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0c51b0 con 0x7f295c0cbe40 2023-10-21T16:27:46.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.317+0000 7f2962e90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0c72b0 con 0x7f295c153490 2023-10-21T16:27:46.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f24337fe640 1 -- 172.21.15.12:0/1086420639 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c031800 con 0x7f2434153490 2023-10-21T16:27:46.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f24337fe640 1 -- 172.21.15.12:0/1086420639 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c031960 con 0x7f2434153490 2023-10-21T16:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f24337fe640 1 -- 172.21.15.12:0/1086420639 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c031cf0 con 0x7f2434153490 2023-10-21T16:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f94298fc640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9424070460 0x7f94240c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f6ea19ab640 1 -- 172.21.15.12:0/1334333603 >> v1:172.21.15.99:6789/0 conn(0x7f6e9c155390 legacy=0x7f6e9c159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f6ea19ab640 1 -- 172.21.15.12:0/1334333603 >> v1:172.21.15.12:6789/0 conn(0x7f6e9c067790 legacy=0x7f6e9c0c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f6ea19ab640 1 -- 172.21.15.12:0/1334333603 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c155b20 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.318+0000 7f0d10a9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 0x7f0d0c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 -- 172.21.15.12:0/1086420639 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 msgr2=0x7f243415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 --2- 172.21.15.12:0/1086420639 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f243415a600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f242c0097d0 tx=0x7f242c02b8a0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7fb803fff640 1 Processor -- start 2023-10-21T16:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f0febfff640 1 -- 172.21.15.12:0/1519196083 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0030800 con 0x7f0fec0d90b0 2023-10-21T16:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 -- 172.21.15.12:0/1086420639 shutdown_connections 2023-10-21T16:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f0febfff640 1 -- 172.21.15.12:0/1519196083 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0030960 con 0x7f0fec0d90b0 2023-10-21T16:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f0febfff640 1 -- 172.21.15.12:0/1519196083 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0030cf0 con 0x7f0fec0d90b0 2023-10-21T16:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 --2- 172.21.15.12:0/1086420639 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f243415a600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 -- 172.21.15.12:0/1086420639 >> 172.21.15.12:0/1086420639 conn(0x7f24340716f0 msgr2=0x7f243406aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7fb803fff640 1 -- start start 2023-10-21T16:27:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f0d0b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d0c0c97e0 0x7f0d0c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 -- 172.21.15.12:0/1086420639 shutdown_connections 2023-10-21T16:27:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f243af16640 1 -- 172.21.15.12:0/1086420639 wait complete. 2023-10-21T16:27:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 -- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 msgr2=0x7f0fec049fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 0x7f0fec049fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002b940 comp rx=0 tx=0).stop 2023-10-21T16:27:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.319+0000 7f3e63fff640 1 --2- 172.21.15.12:0/2398010181 >> v2:172.21.15.12:3300/0 conn(0x7f3e640c55f0 0x7f3e64157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 -- 172.21.15.12:0/1519196083 shutdown_connections 2023-10-21T16:27:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8040c9740 0x7fb804160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0d10a9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 0x7f0d0c159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47518/0 (socket says 172.21.15.12:47518) 2023-10-21T16:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0d10a9e640 1 -- 172.21.15.12:0/2422345727 learned_addr learned my addr 172.21.15.12:0/2422345727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb804157670 0x7fb80414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040c7de0 con 0x7fb8040c9740 2023-10-21T16:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040c60d0 con 0x7fb804157670 2023-10-21T16:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7fb803fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb804160b20 con 0x7fb8040ce720 2023-10-21T16:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec049a60 0x7f0fec04fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/1519196083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 0x7f0fec049fb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f0ffa52e640 1 -- 172.21.15.12:0/1519196083 >> 172.21.15.12:0/1519196083 conn(0x7f0fec00e170 msgr2=0x7f0fec00e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f3e68b05640 1 -- 172.21.15.12:0/2398010181 >> v2:172.21.15.12:3300/0 conn(0x7f3e640c55f0 msgr2=0x7f3e64157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f3e68b05640 1 --2- 172.21.15.12:0/2398010181 >> v2:172.21.15.12:3300/0 conn(0x7f3e640c55f0 0x7f3e64157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f3e68b05640 1 -- 172.21.15.12:0/2398010181 >> v1:172.21.15.99:6789/0 conn(0x7f3e64157cc0 legacy=0x7f3e64150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.320+0000 7f3e68b05640 1 -- 172.21.15.12:0/2398010181 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6415add0 con 0x7f3e640c59d0 2023-10-21T16:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.321+0000 7f0ffa52e640 1 -- 172.21.15.12:0/1519196083 shutdown_connections 2023-10-21T16:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.321+0000 7f0ffa52e640 1 -- 172.21.15.12:0/1519196083 wait complete. 2023-10-21T16:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.321+0000 7f243af16640 1 Processor -- start 2023-10-21T16:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.322+0000 7f243af16640 1 -- start start 2023-10-21T16:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340c97e0 0x7f24341ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f942a0fd640 1 -- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f942414fc60 msgr2=0x7f9424142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f942a0fd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f942414fc60 0x7f9424142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f942a0fd640 1 -- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9424070460 msgr2=0x7f94240c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f942a0fd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9424070460 0x7f94240c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f942a0fd640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c009b30 con 0x7f9424070030 2023-10-21T16:27:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24340cbe40 0x7f2434156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f2434157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2434153c80 con 0x7f24340c97e0 2023-10-21T16:27:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24341f43d0 con 0x7f24340cbe40 2023-10-21T16:27:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.323+0000 7f243af16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24341f34e0 con 0x7f2434153490 2023-10-21T16:27:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0ffa52e640 1 Processor -- start 2023-10-21T16:27:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2422345727 >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 msgr2=0x7f0d0c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0d0b7fe640 1 --2- 172.21.15.12:0/2422345727 >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 0x7f0d0c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2422345727 >> v1:172.21.15.12:6789/0 conn(0x7f0d0c153490 legacy=0x7f0d0c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0ffa52e640 1 -- start start 2023-10-21T16:27:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.324+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2422345727 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c159cf0 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fec049a60 0x7f0fec0de210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 0x7f0fec0e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 0x7f0fec0d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0d7dc0 con 0x7f0fec049a60 2023-10-21T16:27:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec17c8d0 con 0x7f0fec0d90b0 2023-10-21T16:27:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.326+0000 7f0ffa52e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec17ce00 con 0x7f0fec0df930 2023-10-21T16:27:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.329+0000 7f6ea19ab640 1 --2- 172.21.15.12:0/1334333603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c0c3f80 0x7f6e9c160d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009e50 tx=0x7f6e9402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9473a18995187210 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.329+0000 7f3e68b05640 1 --2- 172.21.15.12:0/2398010181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009e50 tx=0x7f3e5c02bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d58f1625f3d8a81 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.329+0000 7f296142d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 0x7f295c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.332+0000 7f296142d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 0x7f295c146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53932/0 (socket says 172.21.15.12:53932) 2023-10-21T16:27:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.332+0000 7f296142d640 1 -- 172.21.15.12:0/3327615650 learned_addr learned my addr 172.21.15.12:0/3327615650 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.333+0000 7fb8027fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.333+0000 7f0ff9d2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 0x7f0fec0d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.333+0000 7f2960c2c640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.333+0000 7f0d0b7fe640 1 --2- 172.21.15.12:0/2422345727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0c97e0 0x7f0d0c15a600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c06aa70 tx=0x7f0d0002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29fd435fbcb00679 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.334+0000 7fb8027fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53940/0 (socket says 172.21.15.12:53940) 2023-10-21T16:27:46.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.334+0000 7fb8027fc640 1 -- 172.21.15.12:0/1927559837 learned_addr learned my addr 172.21.15.12:0/1927559837 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.335+0000 7f0ff952c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fec049a60 0x7f0fec0de210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.336+0000 7f296142d640 1 -- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f295c0cbe40 msgr2=0x7f295c1ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.336+0000 7f296142d640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f295c0cbe40 0x7f295c1ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.336+0000 7f296142d640 1 -- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 msgr2=0x7f295c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.336+0000 7f296142d640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f295c0c97e0 0x7f295c0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.336+0000 7f296142d640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480094d0 con 0x7f295c153490 2023-10-21T16:27:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.337+0000 7f0ff9d2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 0x7f0fec0d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53944/0 (socket says 172.21.15.12:53944) 2023-10-21T16:27:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.337+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/3185599121 learned_addr learned my addr 172.21.15.12:0/3185599121 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.337+0000 7fb802ffd640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8040c9740 0x7fb804160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.338+0000 7f6e93fff640 1 -- 172.21.15.12:0/1334333603 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9402cb20 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.338+0000 7f6e93fff640 1 -- 172.21.15.12:0/1334333603 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9402cc80 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.338+0000 7f6e93fff640 1 -- 172.21.15.12:0/1334333603 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940343f0 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 -- 172.21.15.12:0/1334333603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c0c3f80 msgr2=0x7f6e9c160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 --2- 172.21.15.12:0/1334333603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c0c3f80 0x7f6e9c160d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009e50 tx=0x7f6e9402bf80 comp rx=0 tx=0).stop 2023-10-21T16:27:46.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 -- 172.21.15.12:0/1334333603 shutdown_connections 2023-10-21T16:27:46.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 --2- 172.21.15.12:0/1334333603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c0c3f80 0x7f6e9c160d20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 -- 172.21.15.12:0/1334333603 >> 172.21.15.12:0/1334333603 conn(0x7f6e9c069fc0 msgr2=0x7f6e9c06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7fb8037fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb804157670 0x7fb80414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 -- 172.21.15.12:0/1334333603 shutdown_connections 2023-10-21T16:27:46.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.339+0000 7f6ea340e640 1 -- 172.21.15.12:0/1334333603 wait complete. 2023-10-21T16:27:46.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.340+0000 7f3e637fe640 1 -- 172.21.15.12:0/2398010181 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c02cb20 con 0x7f3e640c59d0 2023-10-21T16:27:46.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e637fe640 1 -- 172.21.15.12:0/2398010181 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c02cc80 con 0x7f3e640c59d0 2023-10-21T16:27:46.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e637fe640 1 -- 172.21.15.12:0/2398010181 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c034610 con 0x7f3e640c59d0 2023-10-21T16:27:46.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 -- 172.21.15.12:0/2398010181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 msgr2=0x7f3e640c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2398010181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009e50 tx=0x7f3e5c02bf80 comp rx=0 tx=0).stop 2023-10-21T16:27:46.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 -- 172.21.15.12:0/2398010181 shutdown_connections 2023-10-21T16:27:46.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f6ea340e640 1 Processor -- start 2023-10-21T16:27:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2398010181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c59d0 0x7f3e640c7020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2398010181 >> v2:172.21.15.12:3300/0 conn(0x7f3e640c55f0 0x7f3e64157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.341+0000 7f3e6a568640 1 -- 172.21.15.12:0/2398010181 >> 172.21.15.12:0/2398010181 conn(0x7f3e64069de0 msgr2=0x7f3e6406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.342+0000 7f3e6a568640 1 -- 172.21.15.12:0/2398010181 shutdown_connections 2023-10-21T16:27:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.342+0000 7f3e6a568640 1 -- 172.21.15.12:0/2398010181 wait complete. 2023-10-21T16:27:46.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.342+0000 7f6ea340e640 1 -- start start 2023-10-21T16:27:46.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 0x7f6e9c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e9c0c3f80 0x7f6e9c0beb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c155390 0x7f6e9c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0be750 con 0x7f6e9c067790 2023-10-21T16:27:46.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0be400 con 0x7f6e9c155390 2023-10-21T16:27:46.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f6ea340e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c06e0d0 con 0x7f6e9c0c3f80 2023-10-21T16:27:46.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 msgr2=0x7f0fec0e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f0ff9d2d640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fec0d90b0 0x7f0fec0e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/3185599121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fec049a60 msgr2=0x7f0fec0de210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f0ff9d2d640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fec049a60 0x7f0fec0de210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009400 con 0x7f0fec0df930 2023-10-21T16:27:46.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.343+0000 7f3e6a568640 1 Processor -- start 2023-10-21T16:27:46.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.344+0000 7f3e6a568640 1 -- start start 2023-10-21T16:27:46.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.344+0000 7f3e6a568640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c55f0 0x7f3e6414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.344+0000 7f3e6a568640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 0x7f3e641e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7f3e6a568640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e64157cc0 0x7f3e641eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7f3e6a568640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6414d590 con 0x7f3e640c59d0 2023-10-21T16:27:46.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7f3e6a568640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641ee870 con 0x7f3e64157cc0 2023-10-21T16:27:46.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7f3e6a568640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641f1c40 con 0x7f3e640c55f0 2023-10-21T16:27:46.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7fb8037fe640 1 -- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 msgr2=0x7fb8040b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7fb8037fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8040ce720 0x7fb8040b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7fb8037fe640 1 -- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8040c9740 msgr2=0x7fb804160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7fb8037fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8040c9740 0x7fb804160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.345+0000 7fb8037fe640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009400 con 0x7fb804157670 2023-10-21T16:27:46.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.348+0000 7f2433fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24340cbe40 0x7f2434156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.350+0000 7f2433fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24340cbe40 0x7f2434156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60600/0 (socket says 172.21.15.12:60600) 2023-10-21T16:27:46.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.350+0000 7f2433fff640 1 -- 172.21.15.12:0/3563255923 learned_addr learned my addr 172.21.15.12:0/3563255923 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.350+0000 7f296142d640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 0x7f295c146f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2954007e40 tx=0x7f295400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.350+0000 7fb8037fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb804157670 0x7fb80414ac60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4033000 tx=0x7fb7f4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.351+0000 7f0ff9d2d640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 0x7f0fec0d70e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4069260 tx=0x7f0ff4067220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.352+0000 7f2438cb2640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340c97e0 0x7f24341ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.354+0000 7f942a0fd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070030 0x7f94241f2250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f942000d620 tx=0x7f942000dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.354+0000 7f24394b3640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f2434157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f2438cb2640 1 -- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 msgr2=0x7f2434157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f2438cb2640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2434153490 0x7f2434157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f2438cb2640 1 -- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24340cbe40 msgr2=0x7f2434156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f2438cb2640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24340cbe40 0x7f2434156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f2438cb2640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009400 con 0x7f24340c97e0 2023-10-21T16:27:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.357+0000 7f6ea11aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 0x7f6e9c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.358+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 0x7f3e641e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.359+0000 7f0d0affd640 1 -- 172.21.15.12:0/2422345727 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0002e070 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.359+0000 7f0d0affd640 1 -- 172.21.15.12:0/2422345727 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d000315a0 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.359+0000 7f0d0affd640 1 -- 172.21.15.12:0/2422345727 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00031930 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4072260 con 0x7f0fec0df930 2023-10-21T16:27:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f403e040 con 0x7fb804157670 2023-10-21T16:27:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4039c30 con 0x7fb804157670 2023-10-21T16:27:46.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40443f0 con 0x7fb804157670 2023-10-21T16:27:46.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec17cb20 con 0x7f0fec0df930 2023-10-21T16:27:46.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 -- 172.21.15.12:0/2422345727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0c97e0 msgr2=0x7f0d0c15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 --2- 172.21.15.12:0/2422345727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0c97e0 0x7f0d0c15a600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c06aa70 tx=0x7f0d0002b840 comp rx=0 tx=0).stop 2023-10-21T16:27:46.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8040c7290 con 0x7fb804157670 2023-10-21T16:27:46.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec0dda10 con 0x7f0fec0df930 2023-10-21T16:27:46.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 -- 172.21.15.12:0/2422345727 shutdown_connections 2023-10-21T16:27:46.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 --2- 172.21.15.12:0/2422345727 >> v2:172.21.15.12:3300/0 conn(0x7f0d0c0cbe40 0x7f0d0c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 --2- 172.21.15.12:0/2422345727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0c97e0 0x7f0d0c15a600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.360+0000 7f0d12501640 1 -- 172.21.15.12:0/2422345727 >> 172.21.15.12:0/2422345727 conn(0x7f0d0c0716f0 msgr2=0x7f0d0c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041600f0 con 0x7fb804157670 2023-10-21T16:27:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f0d12501640 1 -- 172.21.15.12:0/2422345727 shutdown_connections 2023-10-21T16:27:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f0d12501640 1 -- 172.21.15.12:0/2422345727 wait complete. 2023-10-21T16:27:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f6ea09a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e9c0c3f80 0x7f6e9c0beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f2438cb2640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340c97e0 0x7f24341ea200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f242c033000 tx=0x7f242c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fec04f3a0 con 0x7f0fec0df930 2023-10-21T16:27:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f6ea11aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 0x7f6e9c158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47566/0 (socket says 172.21.15.12:47566) 2023-10-21T16:27:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.361+0000 7f6ea11aa640 1 -- 172.21.15.12:0/2694811170 learned_addr learned my addr 172.21.15.12:0/2694811170 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.362+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8040ca060 con 0x7fb804157670 2023-10-21T16:27:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.362+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 0x7f3e641e3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47572/0 (socket says 172.21.15.12:47572) 2023-10-21T16:27:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.362+0000 7f3e5bfff640 1 -- 172.21.15.12:0/2378112907 learned_addr learned my addr 172.21.15.12:0/2378112907 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.363+0000 7f0d12501640 1 Processor -- start 2023-10-21T16:27:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.363+0000 7f0d12501640 1 -- start start 2023-10-21T16:27:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d0c0c97e0 0x7f0d0c0c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 0x7f0d0c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c153490 0x7f0d0c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c155260 con 0x7f0d0c153490 2023-10-21T16:27:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1557b0 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.364+0000 7f0d12501640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c154380 con 0x7f0d0c0c97e0 2023-10-21T16:27:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.366+0000 7f6ea11aa640 1 -- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e9c0c3f80 msgr2=0x7f6e9c0beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.366+0000 7f6ea11aa640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e9c0c3f80 0x7f6e9c0beb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.366+0000 7f6ea11aa640 1 -- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c155390 msgr2=0x7f6e9c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.366+0000 7f6ea11aa640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e9c155390 0x7f6e9c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.366+0000 7f6ea11aa640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94009b30 con 0x7f6e9c067790 2023-10-21T16:27:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.370+0000 7f3e68b05640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e64157cc0 0x7f3e641eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.370+0000 7f6ea11aa640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 0x7f6e9c158300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c410 tx=0x7f6e9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.372+0000 7f3e5bfff640 1 -- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c55f0 msgr2=0x7f3e6414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.372+0000 7f3e5bfff640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3e640c55f0 0x7f3e6414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.372+0000 7f3e5bfff640 1 -- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e64157cc0 msgr2=0x7f3e641eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.372+0000 7f3e5bfff640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e64157cc0 0x7f3e641eed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.372+0000 7f3e5bfff640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c009b30 con 0x7f3e640c59d0 2023-10-21T16:27:46.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.377+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c03adf0 con 0x7f24340c97e0 2023-10-21T16:27:46.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.377+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c0443f0 con 0x7f24340c97e0 2023-10-21T16:27:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.377+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c0447a0 con 0x7f24340c97e0 2023-10-21T16:27:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.377+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24341f37c0 con 0x7f24340c97e0 2023-10-21T16:27:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.377+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24341f3d80 con 0x7f24340c97e0 2023-10-21T16:27:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.378+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24340cb360 con 0x7f24340c97e0 2023-10-21T16:27:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.378+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954014620 con 0x7f295c153490 2023-10-21T16:27:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.378+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400ee90 con 0x7f295c153490 2023-10-21T16:27:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.378+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540149e0 con 0x7f295c153490 2023-10-21T16:27:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.379+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c0c7590 con 0x7f295c153490 2023-10-21T16:27:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.379+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c0c8500 con 0x7f295c153490 2023-10-21T16:27:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.379+0000 7f3e5bfff640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 0x7f3e641e3db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00b3e0 tx=0x7f3e4c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.379+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f295c0cb360 con 0x7f295c153490 2023-10-21T16:27:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.384+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb7f404d3b0 con 0x7fb804157670 2023-10-21T16:27:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.385+0000 7fb7eb7fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb7f006aec0 0x7fb7f006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.385+0000 7fb802ffd640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb7f006aec0 0x7fb7f006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.386+0000 7fb802ffd640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb7f006aec0 0x7fb7f006d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0012e0 tx=0x7fb7fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.387+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7f407b0d0 con 0x7fb804157670 2023-10-21T16:27:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.387+0000 7fb7eb7fe640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fb7f0073060 0x7fb7f0075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.387+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7f0075b30 con 0x7fb7f0073060 2023-10-21T16:27:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.388+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7f4077410 con 0x7fb804157670 2023-10-21T16:27:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.388+0000 7fb8027fc640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fb7f0073060 0x7fb7f0075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.388+0000 7fb8027fc640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fb7f0073060 0x7fb7f0075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.390+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== osd.1 v2:172.21.15.12:6812/2520400743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb7f0075b30 con 0x7fb7f0073060 2023-10-21T16:27:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.392+0000 7f0d0b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 0x7f0d0c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.393+0000 7f0d0b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 0x7f0d0c0c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60628/0 (socket says 172.21.15.12:60628) 2023-10-21T16:27:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.393+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2161198241 learned_addr learned my addr 172.21.15.12:0/2161198241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.394+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff40723c0 con 0x7f0fec0df930 2023-10-21T16:27:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.394+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff406f890 con 0x7f0fec0df930 2023-10-21T16:27:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.396+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ff406fa70 con 0x7f0fec0df930 2023-10-21T16:27:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.396+0000 7f0d10a9e640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c153490 0x7f0d0c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d0c0c97e0 msgr2=0x7f0d0c0c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f0d0b7fe640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d0c0c97e0 0x7f0d0c0c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980035f0 con 0x7f6e9c067790 2023-10-21T16:27:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98003770 con 0x7f6e9c067790 2023-10-21T16:27:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98003b20 con 0x7f6e9c067790 2023-10-21T16:27:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c14b790 con 0x7f6e9c067790 2023-10-21T16:27:46.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2161198241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c153490 msgr2=0x7f0d0c0c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f0d0b7fe640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c153490 0x7f0d0c0c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f0d0b7fe640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00009400 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.397+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c14bd30 con 0x7f6e9c067790 2023-10-21T16:27:46.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0fe9ffb640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0fd806aea0 0x7f0fd806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ff40d2710 con 0x7f0fec0df930 2023-10-21T16:27:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0ff952c640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0fd806aea0 0x7f0fd806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0fe9ffb640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f0fd8073040 0x7f0fd8075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd8075b10 con 0x7f0fd8073040 2023-10-21T16:27:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f0ff8d2b640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f0fd8073040 0x7f0fd8075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.398+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e9c1560e0 con 0x7f6e9c067790 2023-10-21T16:27:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.399+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff40cea50 con 0x7f0fec0df930 2023-10-21T16:27:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.399+0000 7f0ff952c640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0fd806aea0 0x7f0fd806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0036000 tx=0x7f0ff0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.399+0000 7f0ff8d2b640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f0fd8073040 0x7f0fd8075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.400+0000 7f0d0b7fe640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 0x7f0d0c0c8450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009890 tx=0x7f0d000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.400+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== osd.4 v2:172.21.15.99:6810/585893738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0fd8075b10 con 0x7f0fd8073040 2023-10-21T16:27:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.403+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00032840 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.403+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d000329a0 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.403+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00032d50 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.403+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c154640 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.405+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c155440 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.406+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d0c0cb360 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.416+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f242c04d450 con 0x7f24340c97e0 2023-10-21T16:27:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.416+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c011830 con 0x7f3e640c59d0 2023-10-21T16:27:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.416+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0119b0 con 0x7f3e640c59d0 2023-10-21T16:27:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.416+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c011d60 con 0x7f3e640c59d0 2023-10-21T16:27:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.417+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6406a340 con 0x7f3e640c59d0 2023-10-21T16:27:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.417+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e641ee500 con 0x7f3e640c59d0 2023-10-21T16:27:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.418+0000 7f24317fa640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f242006aef0 0x7f242006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.418+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e6415b390 con 0x7f3e640c59d0 2023-10-21T16:27:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.418+0000 7f2433fff640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f242006aef0 0x7f242006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.419+0000 7f2433fff640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f242006aef0 0x7f242006d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24340cf640 tx=0x7f2428009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.420+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 --> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8040c9d80 con 0x7fb7f0073060 2023-10-21T16:27:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.420+0000 7fb7eb7fe640 1 -- 172.21.15.12:0/1927559837 <== osd.1 v2:172.21.15.12:6812/2520400743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7f8009980 con 0x7fb7f0073060 2023-10-21T16:27:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.420+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fb7f0073060 msgr2=0x7fb7f0075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fb7f0073060 0x7fb7f0075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb7f006aec0 msgr2=0x7fb7f006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb7f006aec0 0x7fb7f006d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0012e0 tx=0x7fb7fc009040 comp rx=0 tx=0).stop 2023-10-21T16:27:46.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb804157670 msgr2=0x7fb80414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 --2- 172.21.15.12:0/1927559837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb804157670 0x7fb80414ac60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4033000 tx=0x7fb7f4004730 comp rx=0 tx=0).stop 2023-10-21T16:27:46.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb8037fe640 1 -- 172.21.15.12:0/1927559837 reap_dead start 2023-10-21T16:27:46.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 shutdown_connections 2023-10-21T16:27:46.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 >> 172.21.15.12:0/1927559837 conn(0x7fb804071510 msgr2=0x7fb8040cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 shutdown_connections 2023-10-21T16:27:46.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.421+0000 7fb803fff640 1 -- 172.21.15.12:0/1927559837 wait complete. 2023-10-21T16:27:46.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.423+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f242c02e070 con 0x7f24340c97e0 2023-10-21T16:27:46.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.424+0000 7f24317fa640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7f2420073090 0x7f24200754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.424+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2420075b60 con 0x7f2420073090 2023-10-21T16:27:46.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.424+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f242c077030 con 0x7f24340c97e0 2023-10-21T16:27:46.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.424+0000 7f24394b3640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7f2420073090 0x7f24200754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.425+0000 7f24394b3640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7f2420073090 0x7f24200754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.425+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== osd.3 v2:172.21.15.12:6822/514838318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2420075b60 con 0x7f2420073090 2023-10-21T16:27:46.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.430+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 --> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fec04f0c0 con 0x7f0fd8073040 2023-10-21T16:27:46.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.430+0000 7f0fe9ffb640 1 -- 172.21.15.12:0/3185599121 <== osd.4 v2:172.21.15.99:6810/585893738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fe40096c0 con 0x7f0fd8073040 2023-10-21T16:27:46.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.431+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f0fd8073040 msgr2=0x7f0fd8075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.431+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f0fd8073040 0x7f0fd8075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.431+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2954014b40 con 0x7f295c153490 2023-10-21T16:27:46.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.432+0000 7f29597fa640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f294006aec0 0x7f294006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0fd806aea0 msgr2=0x7f0fd806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0fd806aea0 0x7f0fd806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0036000 tx=0x7f0ff0008030 comp rx=0 tx=0).stop 2023-10-21T16:27:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 msgr2=0x7f0fec0d70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 --2- 172.21.15.12:0/3185599121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fec0df930 0x7f0fec0d70e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4069260 tx=0x7f0ff4067220 comp rx=0 tx=0).stop 2023-10-21T16:27:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ff9d2d640 1 -- 172.21.15.12:0/3185599121 reap_dead start 2023-10-21T16:27:46.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 shutdown_connections 2023-10-21T16:27:46.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 >> 172.21.15.12:0/3185599121 conn(0x7f0fec00e170 msgr2=0x7f0fec006190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f2960c2c640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f294006aec0 0x7f294006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 shutdown_connections 2023-10-21T16:27:46.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.433+0000 7f0ffa52e640 1 -- 172.21.15.12:0/3185599121 wait complete. 2023-10-21T16:27:46.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.434+0000 7f2960c2c640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f294006aec0 0x7f294006d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2950006fd0 tx=0x7f2950009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.435+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d0004d3f0 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.436+0000 7f0d08ff9640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cf806aef0 0x7f0cf806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f0d0bfff640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cf806aef0 0x7f0cf806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f295405a1a0 con 0x7f295c153490 2023-10-21T16:27:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f29597fa640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f2940073060 0x7f2940075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2940075b30 con 0x7f2940073060 2023-10-21T16:27:46.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2954055de0 con 0x7f295c153490 2023-10-21T16:27:46.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.437+0000 7f0d0bfff640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cf806aef0 0x7f0cf806d3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009650 tx=0x7f0cfc006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.439+0000 7f295bfff640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f2940073060 0x7f2940075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.439+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d0007a8c0 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.439+0000 7f295bfff640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f2940073060 0x7f2940075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.440+0000 7f0d08ff9640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7f0cf8073090 0x7f0cf80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.440+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cf8075b60 con 0x7f0cf8073090 2023-10-21T16:27:46.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.440+0000 7f0d10a9e640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7f0cf8073090 0x7f0cf80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.440+0000 7f0d10a9e640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7f0cf8073090 0x7f0cf80754b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942000b620 con 0x7f9424070030 2023-10-21T16:27:46.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942000b780 con 0x7f9424070030 2023-10-21T16:27:46.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942000bb10 con 0x7f9424070030 2023-10-21T16:27:46.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== osd.2 v2:172.21.15.12:6808/369793798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2940075b30 con 0x7f2940073060 2023-10-21T16:27:46.445 INFO:teuthology.orchestra.run.smithi012.stdout:68719476749 2023-10-21T16:27:46.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-21T16:27:46.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94240c4780 con 0x7f9424070030 2023-10-21T16:27:46.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.441+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241ee3e0 con 0x7f9424070030 2023-10-21T16:27:46.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.442+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== osd.7 v2:172.21.15.99:6802/2053185906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0cf8075b60 con 0x7f0cf8073090 2023-10-21T16:27:46.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.443+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94240c5ac0 con 0x7f9424070030 2023-10-21T16:27:46.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.443+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d00076500 con 0x7f0d0c0cbe40 2023-10-21T16:27:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.450+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 --> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2434159fd0 con 0x7f2420073090 2023-10-21T16:27:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.451+0000 7f24317fa640 1 -- 172.21.15.12:0/3563255923 <== osd.3 v2:172.21.15.12:6822/514838318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2424001d50 con 0x7f2420073090 2023-10-21T16:27:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7f2420073090 msgr2=0x7f24200754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7f2420073090 0x7f24200754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f242006aef0 msgr2=0x7f242006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f242006aef0 0x7f242006d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24340cf640 tx=0x7f2428009040 comp rx=0 tx=0).stop 2023-10-21T16:27:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340c97e0 msgr2=0x7f24341ea200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 --2- 172.21.15.12:0/3563255923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340c97e0 0x7f24341ea200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f242c033000 tx=0x7f242c0046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f24394b3640 1 -- 172.21.15.12:0/3563255923 reap_dead start 2023-10-21T16:27:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 shutdown_connections 2023-10-21T16:27:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 >> 172.21.15.12:0/3563255923 conn(0x7f24340716f0 msgr2=0x7f24340ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:46.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-21T16:27:46.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.452+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 shutdown_connections 2023-10-21T16:27:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.453+0000 7f243af16640 1 -- 172.21.15.12:0/3563255923 wait complete. 2023-10-21T16:27:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.458+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e98003c80 con 0x7f6e9c067790 2023-10-21T16:27:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.460+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 --> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f295c159fd0 con 0x7f2940073060 2023-10-21T16:27:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.461+0000 7f29597fa640 1 -- 172.21.15.12:0/3327615650 <== osd.2 v2:172.21.15.12:6808/369793798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2948031910 con 0x7f2940073060 2023-10-21T16:27:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f2940073060 msgr2=0x7f2940075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f2940073060 0x7f2940075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f294006aec0 msgr2=0x7f294006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f294006aec0 0x7f294006d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2950006fd0 tx=0x7f2950009060 comp rx=0 tx=0).stop 2023-10-21T16:27:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 msgr2=0x7f295c146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 --2- 172.21.15.12:0/3327615650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f295c153490 0x7f295c146f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2954007e40 tx=0x7f295400e4b0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f296142d640 1 -- 172.21.15.12:0/3327615650 reap_dead start 2023-10-21T16:27:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 shutdown_connections 2023-10-21T16:27:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 >> 172.21.15.12:0/3327615650 conn(0x7f295c0716f0 msgr2=0x7f295c150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 shutdown_connections 2023-10-21T16:27:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f2962e90640 1 -- 172.21.15.12:0/3327615650 wait complete. 2023-10-21T16:27:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.460+0000 7f6e91ffb640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6e8006aec0 0x7f6e8006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.460+0000 7f6ea09a9640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6e8006aec0 0x7f6e8006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.462+0000 7f6ea09a9640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6e8006aec0 0x7f6e8006d380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c145700 tx=0x7f6e8c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e980010c0 con 0x7f6e9c067790 2023-10-21T16:27:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f6e91ffb640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f6e80073060 0x7f6e80075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e80075b30 con 0x7f6e80073060 2023-10-21T16:27:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e980543c0 con 0x7f6e9c067790 2023-10-21T16:27:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.463+0000 7f6ea19ab640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f6e80073060 0x7f6e80075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.464+0000 7f6ea19ab640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f6e80073060 0x7f6e80075480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.465+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== osd.6 v2:172.21.15.99:6826/2547717838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6e80075b30 con 0x7f6e80073060 2023-10-21T16:27:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.468+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f942000bc70 con 0x7f9424070030 2023-10-21T16:27:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.470+0000 7f941affd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f940806ae70 0x7f940806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.470+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f942008a3e0 con 0x7f9424070030 2023-10-21T16:27:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.471+0000 7f941affd640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f9408073010 0x7f9408075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.471+0000 7f94298fc640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f940806ae70 0x7f940806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.471+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9408075ae0 con 0x7f9408073010 2023-10-21T16:27:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.472+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942008a830 con 0x7f9424070030 2023-10-21T16:27:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.472+0000 7f942a8fe640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f9408073010 0x7f9408075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.473+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 --> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d0c159fd0 con 0x7f0cf8073090 2023-10-21T16:27:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.473+0000 7f94298fc640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f940806ae70 0x7f940806d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f94240c3900 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.473+0000 7f942a8fe640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f9408073010 0x7f9408075430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.475+0000 7f0d08ff9640 1 -- 172.21.15.12:0/2161198241 <== osd.7 v2:172.21.15.99:6802/2053185906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d040091b0 con 0x7f0cf8073090 2023-10-21T16:27:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.475+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== osd.0 v2:172.21.15.12:6800/669872713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9408075ae0 con 0x7f9408073010 2023-10-21T16:27:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7f0cf8073090 msgr2=0x7f0cf80754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7f0cf8073090 0x7f0cf80754b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cf806aef0 msgr2=0x7f0cf806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cf806aef0 0x7f0cf806d3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009650 tx=0x7f0cfc006ba0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 msgr2=0x7f0d0c0c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.476+0000 7f0d12501640 1 --2- 172.21.15.12:0/2161198241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d0c0cbe40 0x7f0d0c0c8450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009890 tx=0x7f0d000046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:68719476748 2023-10-21T16:27:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.479+0000 7f0d10a9e640 1 -- 172.21.15.12:0/2161198241 reap_dead start 2023-10-21T16:27:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.479+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 shutdown_connections 2023-10-21T16:27:46.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-21T16:27:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.479+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 >> 172.21.15.12:0/2161198241 conn(0x7f0d0c0716f0 msgr2=0x7f0d0c151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.480+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 shutdown_connections 2023-10-21T16:27:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.481+0000 7f0d12501640 1 -- 172.21.15.12:0/2161198241 wait complete. 2023-10-21T16:27:46.490 INFO:teuthology.orchestra.run.smithi012.stdout:68719476749 2023-10-21T16:27:46.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-21T16:27:46.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.497+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 --> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e9c155e00 con 0x7f6e80073060 2023-10-21T16:27:46.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.497+0000 7f6e91ffb640 1 -- 172.21.15.12:0/2694811170 <== osd.6 v2:172.21.15.99:6826/2547717838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e9402ca80 con 0x7f6e80073060 2023-10-21T16:27:46.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f6e80073060 msgr2=0x7f6e80075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f6e80073060 0x7f6e80075480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6e8006aec0 msgr2=0x7f6e8006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6e8006aec0 0x7f6e8006d380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c145700 tx=0x7f6e8c009060 comp rx=0 tx=0).stop 2023-10-21T16:27:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 msgr2=0x7f6e9c158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 --2- 172.21.15.12:0/2694811170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c067790 0x7f6e9c158300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c410 tx=0x7f6e9800c8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea19ab640 1 -- 172.21.15.12:0/2694811170 reap_dead start 2023-10-21T16:27:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 shutdown_connections 2023-10-21T16:27:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.498+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 >> 172.21.15.12:0/2694811170 conn(0x7f6e9c069fc0 msgr2=0x7f6e9c0c3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.499+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 shutdown_connections 2023-10-21T16:27:46.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.502+0000 7f6ea340e640 1 -- 172.21.15.12:0/2694811170 wait complete. 2023-10-21T16:27:46.507 INFO:teuthology.orchestra.run.smithi012.stdout:60129542156 2023-10-21T16:27:46.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-21T16:27:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.509+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 --> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94240c5d60 con 0x7f9408073010 2023-10-21T16:27:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.510+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e4c01a400 con 0x7f3e640c59d0 2023-10-21T16:27:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.512+0000 7f941affd640 1 -- 172.21.15.12:0/4285226379 <== osd.0 v2:172.21.15.12:6800/669872713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9408075ae0 con 0x7f9408073010 2023-10-21T16:27:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f9408073010 msgr2=0x7f9408075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f9408073010 0x7f9408075430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f940806ae70 msgr2=0x7f940806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f940806ae70 0x7f940806d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f94240c3900 tx=0x7f9414009040 comp rx=0 tx=0).stop 2023-10-21T16:27:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070030 msgr2=0x7f94241f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 --2- 172.21.15.12:0/4285226379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9424070030 0x7f94241f2250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f942000d620 tx=0x7f942000dae0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942a8fe640 1 -- 172.21.15.12:0/4285226379 reap_dead start 2023-10-21T16:27:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 shutdown_connections 2023-10-21T16:27:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.513+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 >> 172.21.15.12:0/4285226379 conn(0x7f9424069de0 msgr2=0x7f942406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 shutdown_connections 2023-10-21T16:27:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.518+0000 7f942c361640 1 -- 172.21.15.12:0/4285226379 wait complete. 2023-10-21T16:27:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.516+0000 7f3e617fa640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3e4406aec0 0x7f3e4406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e4c089db0 con 0x7f3e640c59d0 2023-10-21T16:27:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e617fa640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7f3e440730e0 0x7f3e44075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e44075bb0 con 0x7f3e440730e0 2023-10-21T16:27:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e4c08a250 con 0x7f3e640c59d0 2023-10-21T16:27:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e63fff640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3e4406aec0 0x7f3e4406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.517+0000 7f3e68b05640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7f3e440730e0 0x7f3e44075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.519+0000 7f3e68b05640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7f3e440730e0 0x7f3e44075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.519+0000 7f3e63fff640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3e4406aec0 0x7f3e4406d380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e540098f0 tx=0x7f3e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.520+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== osd.5 v2:172.21.15.99:6818/3348201712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3e44075bb0 con 0x7f3e440730e0 2023-10-21T16:27:46.530 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:46.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-21T16:27:46.544 INFO:teuthology.orchestra.run.smithi012.stdout:68719476750 2023-10-21T16:27:46.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-21T16:27:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.549+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 --> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e6415b0b0 con 0x7f3e440730e0 2023-10-21T16:27:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.550+0000 7f3e617fa640 1 -- 172.21.15.12:0/2378112907 <== osd.5 v2:172.21.15.99:6818/3348201712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e5c02c9a0 con 0x7f3e440730e0 2023-10-21T16:27:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7f3e440730e0 msgr2=0x7f3e44075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7f3e440730e0 0x7f3e44075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3e4406aec0 msgr2=0x7f3e4406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3e4406aec0 0x7f3e4406d380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e540098f0 tx=0x7f3e54008040 comp rx=0 tx=0).stop 2023-10-21T16:27:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 msgr2=0x7f3e641e3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 --2- 172.21.15.12:0/2378112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e640c59d0 0x7f3e641e3db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00b3e0 tx=0x7f3e4c00b8a0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e68b05640 1 -- 172.21.15.12:0/2378112907 reap_dead start 2023-10-21T16:27:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 shutdown_connections 2023-10-21T16:27:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.551+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 >> 172.21.15.12:0/2378112907 conn(0x7f3e64069de0 msgr2=0x7f3e640c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.552+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 shutdown_connections 2023-10-21T16:27:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.552+0000 7f3e6a568640 1 -- 172.21.15.12:0/2378112907 wait complete. 2023-10-21T16:27:46.582 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:46.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-21T16:27:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.744+0000 7f552b393640 1 Processor -- start 2023-10-21T16:27:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.744+0000 7f552b393640 1 -- start start 2023-10-21T16:27:46.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.746+0000 7f552b393640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f552406fb50 0x7f5524070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.746+0000 7f552b393640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552406e3b0 con 0x7f5524071070 2023-10-21T16:27:46.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.746+0000 7f552b393640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240cb050 con 0x7f55240c2850 2023-10-21T16:27:46.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.746+0000 7f552b393640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55240c4a10 con 0x7f552406fb50 2023-10-21T16:27:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.748+0000 7f552a391640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f55240c2850 0x7f5524169d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:56004/0 (socket says 172.21.15.12:56004) 2023-10-21T16:27:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.748+0000 7f552a391640 1 -- 172.21.15.12:0/976234228 learned_addr learned my addr 172.21.15.12:0/976234228 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.752+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985096551 0 0) 0x7f55240cb050 con 0x7f55240c2850 2023-10-21T16:27:46.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.752+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5510003520 con 0x7f55240c2850 2023-10-21T16:27:46.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.753+0000 7f5529b90640 1 --2- 172.21.15.12:0/976234228 >> v2:172.21.15.12:3300/0 conn(0x7f552406fb50 0x7f5524070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803509277 0 0) 0x7f5510003520 con 0x7f55240c2850 2023-10-21T16:27:46.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 >> v2:172.21.15.12:3300/0 conn(0x7f552406fb50 msgr2=0x7f5524070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 --2- 172.21.15.12:0/976234228 >> v2:172.21.15.12:3300/0 conn(0x7f552406fb50 0x7f5524070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 >> v1:172.21.15.12:6789/0 conn(0x7f5524071070 legacy=0x7f5524170670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524166d20 con 0x7f55240c2850 2023-10-21T16:27:46.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f5514001670 con 0x7f55240c2850 2023-10-21T16:27:46.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 >> v1:172.21.15.99:6789/0 conn(0x7f55240c2850 legacy=0x7f5524169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f5510003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55100047c0 0x7f5510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55100052a0 0x7f551000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551000c170 con 0x7f55100047c0 2023-10-21T16:27:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551000c2e0 con 0x7f55100052a0 2023-10-21T16:27:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.758+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551000c4a0 con 0x7f55100039c0 2023-10-21T16:27:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.759+0000 7f3879009640 1 Processor -- start 2023-10-21T16:27:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.759+0000 7f3879009640 1 -- start start 2023-10-21T16:27:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.760+0000 7f552a391640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f5510003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.762+0000 7f3879009640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f38740cab10 0x7f38740c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.762+0000 7f3879009640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38740705e0 0x7f38740c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.762+0000 7f3879009640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38741595b0 con 0x7f38740ca730 2023-10-21T16:27:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.762+0000 7f3879009640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740c6f60 con 0x7f38740705e0 2023-10-21T16:27:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.762+0000 7f3879009640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3874159850 con 0x7f38740cab10 2023-10-21T16:27:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552ab92640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55100052a0 0x7f551000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.764+0000 7f387259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f38740cab10 0x7f38740c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552a391640 1 -- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55100052a0 msgr2=0x7f551000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552a391640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55100052a0 0x7f551000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552a391640 1 -- 172.21.15.12:0/976234228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55100047c0 msgr2=0x7f5510004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552a391640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55100047c0 0x7f5510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.763+0000 7f552a391640 1 -- 172.21.15.12:0/976234228 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510003520 con 0x7f55100039c0 2023-10-21T16:27:46.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.764+0000 7f552ab92640 1 -- 172.21.15.12:0/976234228 reap_dead start 2023-10-21T16:27:46.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.766+0000 7f387259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f38740cab10 0x7f38740c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60650/0 (socket says 172.21.15.12:60650) 2023-10-21T16:27:46.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.766+0000 7f387259c640 1 -- 172.21.15.12:0/328882274 learned_addr learned my addr 172.21.15.12:0/328882274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.766+0000 7f552a391640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f5510003de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f551400c0e0 tx=0x7f55100057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb22c87964f566 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.769+0000 7f387259c640 1 -- 172.21.15.12:0/328882274 >> v2:172.21.15.12:3300/0 conn(0x7f38740705e0 msgr2=0x7f38740c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.769+0000 7f387259c640 1 --2- 172.21.15.12:0/328882274 >> v2:172.21.15.12:3300/0 conn(0x7f38740705e0 0x7f38740c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.769+0000 7f387259c640 1 -- 172.21.15.12:0/328882274 >> v1:172.21.15.12:6789/0 conn(0x7f38740ca730 legacy=0x7f387406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.769+0000 7f387259c640 1 -- 172.21.15.12:0/328882274 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874159b10 con 0x7f38740cab10 2023-10-21T16:27:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.772+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514005ad0 con 0x7f55100039c0 2023-10-21T16:27:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.772+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5514005c30 con 0x7f55100039c0 2023-10-21T16:27:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.772+0000 7f552938f640 1 -- 172.21.15.12:0/976234228 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551402c7d0 con 0x7f55100039c0 2023-10-21T16:27:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.774+0000 7f552b393640 1 -- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 msgr2=0x7f5510003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.772+0000 7f387259c640 1 --2- 172.21.15.12:0/328882274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c73b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f387406e280 tx=0x7f386402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f275de2e66c7cfc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.774+0000 7f552b393640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f5510003de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f551400c0e0 tx=0x7f55100057f0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.774+0000 7f552b393640 1 -- 172.21.15.12:0/976234228 shutdown_connections 2023-10-21T16:27:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.774+0000 7f552b393640 1 --2- 172.21.15.12:0/976234228 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f5510003de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.774+0000 7f552b393640 1 -- 172.21.15.12:0/976234228 >> 172.21.15.12:0/976234228 conn(0x7f552406bac0 msgr2=0x7f552406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.775+0000 7f552b393640 1 -- 172.21.15.12:0/976234228 shutdown_connections 2023-10-21T16:27:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.775+0000 7f552b393640 1 -- 172.21.15.12:0/976234228 wait complete. 2023-10-21T16:27:46.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.776+0000 7f3871d9b640 1 -- 172.21.15.12:0/328882274 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864031890 con 0x7f38740cab10 2023-10-21T16:27:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.778+0000 7f552b393640 1 Processor -- start 2023-10-21T16:27:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.779+0000 7f552b393640 1 -- start start 2023-10-21T16:27:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.779+0000 7f3871d9b640 1 -- 172.21.15.12:0/328882274 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640319f0 con 0x7f38740cab10 2023-10-21T16:27:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.780+0000 7f3879009640 1 -- 172.21.15.12:0/328882274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 msgr2=0x7f38740c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.780+0000 7f3879009640 1 --2- 172.21.15.12:0/328882274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c73b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f387406e280 tx=0x7f386402b930 comp rx=0 tx=0).stop 2023-10-21T16:27:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.781+0000 7f552b393640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.781+0000 7f552b393640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5524070aa0 0x7f5524084480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.781+0000 7f552b393640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55240c76a0 0x7f55240849c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552b393640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524206b30 con 0x7f5524070aa0 2023-10-21T16:27:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552b393640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524207990 con 0x7f55240c76a0 2023-10-21T16:27:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552b393640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5524206d80 con 0x7f55100039c0 2023-10-21T16:27:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552a391640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552ab92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55240c76a0 0x7f55240849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552a391640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:53998/0 (socket says 172.21.15.12:53998) 2023-10-21T16:27:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.782+0000 7f552a391640 1 -- 172.21.15.12:0/1781780727 learned_addr learned my addr 172.21.15.12:0/1781780727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 -- 172.21.15.12:0/328882274 shutdown_connections 2023-10-21T16:27:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 --2- 172.21.15.12:0/328882274 >> v2:172.21.15.12:3300/0 conn(0x7f38740705e0 0x7f38740c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 --2- 172.21.15.12:0/328882274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c73b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 -- 172.21.15.12:0/328882274 >> 172.21.15.12:0/328882274 conn(0x7f387406baa0 msgr2=0x7f387406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 -- 172.21.15.12:0/328882274 shutdown_connections 2023-10-21T16:27:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.783+0000 7f3879009640 1 -- 172.21.15.12:0/328882274 wait complete. 2023-10-21T16:27:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.786+0000 7f552a391640 1 -- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55240c76a0 msgr2=0x7f55240849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.786+0000 7f552a391640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55240c76a0 0x7f55240849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.786+0000 7f552a391640 1 -- 172.21.15.12:0/1781780727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5524070aa0 msgr2=0x7f5524084480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.786+0000 7f552a391640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5524070aa0 0x7f5524084480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.787+0000 7f552a391640 1 -- 172.21.15.12:0/1781780727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524207060 con 0x7f55100039c0 2023-10-21T16:27:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.786+0000 7f3879009640 1 Processor -- start 2023-10-21T16:27:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.787+0000 7f3879009640 1 -- start start 2023-10-21T16:27:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.789+0000 7f3879009640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38740705e0 0x7f38741f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.789+0000 7f552a391640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f55240c12f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.790+0000 7f3879009640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f38740ca730 0x7f3874155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.790+0000 7f3879009640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f3879009640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741eea50 con 0x7f38740705e0 2023-10-21T16:27:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f3879009640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741f2f10 con 0x7f38740cab10 2023-10-21T16:27:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f3879009640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38741555c0 con 0x7f38740ca730 2023-10-21T16:27:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551402cbe0 con 0x7f55100039c0 2023-10-21T16:27:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f3872d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38740705e0 0x7f38741f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5524207340 con 0x7f55100039c0 2023-10-21T16:27:46.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f387359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f387359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60676/0 (socket says 172.21.15.12:60676) 2023-10-21T16:27:46.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55240c6960 con 0x7f55100039c0 2023-10-21T16:27:46.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.791+0000 7f387359e640 1 -- 172.21.15.12:0/212159693 learned_addr learned my addr 172.21.15.12:0/212159693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.792+0000 7fae93ae7640 1 Processor -- start 2023-10-21T16:27:46.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.792+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551403a070 con 0x7f55100039c0 2023-10-21T16:27:46.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.793+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514007070 con 0x7f55100039c0 2023-10-21T16:27:46.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.792+0000 7fae93ae7640 1 -- start start 2023-10-21T16:27:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.794+0000 7f387259c640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f38740ca730 0x7f3874155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.794+0000 7fae93ae7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae8c153490 0x7fae8c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.794+0000 7fae93ae7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0c97e0 0x7fae8c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7fae93ae7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c153870 con 0x7fae8c0ca560 2023-10-21T16:27:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7fae93ae7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c0cb0a0 con 0x7fae8c153490 2023-10-21T16:27:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7fae93ae7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c159cf0 con 0x7fae8c0c97e0 2023-10-21T16:27:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7f387359e640 1 -- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f38740ca730 msgr2=0x7f3874155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7f387359e640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f38740ca730 0x7f3874155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7f387359e640 1 -- 172.21.15.12:0/212159693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38740705e0 msgr2=0x7f38741f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7f387359e640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38740705e0 0x7f38741f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.795+0000 7f387359e640 1 -- 172.21.15.12:0/212159693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38640094d0 con 0x7f38740cab10 2023-10-21T16:27:46.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.794+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c005250 con 0x7f55100039c0 2023-10-21T16:27:46.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.797+0000 7f69eb59e640 1 Processor -- start 2023-10-21T16:27:46.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.797+0000 7fae92084640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fae8c0ca560 0x7fae8c159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:56006/0 (socket says 172.21.15.12:56006) 2023-10-21T16:27:46.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.797+0000 7fae92084640 1 -- 172.21.15.12:0/2744499585 learned_addr learned my addr 172.21.15.12:0/2744499585 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.797+0000 7f387359e640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f386800b440 tx=0x7f386800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.797+0000 7f69eb59e640 1 -- start start 2023-10-21T16:27:46.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.799+0000 7f69eb59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69e40d9250 0x7f69e4007050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.799+0000 7f69eb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e400ebd0 0x7f69e4007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.799+0000 7f69eb59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e404fd00 con 0x7f69e4049650 2023-10-21T16:27:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.799+0000 7f69eb59e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e404eee0 con 0x7f69e40d9250 2023-10-21T16:27:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.799+0000 7f69eb59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40d9630 con 0x7f69e400ebd0 2023-10-21T16:27:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.803+0000 7f69ead9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f69e4049650 0x7f69e4049ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:56010/0 (socket says 172.21.15.12:56010) 2023-10-21T16:27:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.803+0000 7f69ead9d640 1 -- 172.21.15.12:0/109871147 learned_addr learned my addr 172.21.15.12:0/109871147 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.803+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868011830 con 0x7f38740cab10 2023-10-21T16:27:46.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.804+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387414ea10 con 0x7f38740cab10 2023-10-21T16:27:46.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.804+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38741eec40 con 0x7f38740cab10 2023-10-21T16:27:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.804+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868011990 con 0x7f38740cab10 2023-10-21T16:27:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.804+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868011830 con 0x7f38740cab10 2023-10-21T16:27:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.805+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854005250 con 0x7f38740cab10 2023-10-21T16:27:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.809+0000 7f88de747640 1 Processor -- start 2023-10-21T16:27:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.810+0000 7f88de747640 1 -- start start 2023-10-21T16:27:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88d80c55f0 0x7f88d8157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d8157cc0 0x7f88d8150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 0x7f88d8151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80c23f0 con 0x7f88d80c55f0 2023-10-21T16:27:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d8156fa0 con 0x7f88d80c59d0 2023-10-21T16:27:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.812+0000 7f88de747640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d815aaf0 con 0x7f88d8157cc0 2023-10-21T16:27:46.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.837+0000 7f88dcce4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 0x7f88d8151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.837+0000 7f88dcce4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 0x7f88d8151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60692/0 (socket says 172.21.15.12:60692) 2023-10-21T16:27:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.837+0000 7f88dcce4640 1 -- 172.21.15.12:0/1166817195 learned_addr learned my addr 172.21.15.12:0/1166817195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.837+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3868011b00 con 0x7f38740cab10 2023-10-21T16:27:46.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.838+0000 7f385b7fe640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 0x7f386006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.839+0000 7f3872d9d640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 0x7f386006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.840+0000 7f3872d9d640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 0x7f386006d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f386c001db0 tx=0x7f386c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.847+0000 7f8b5aa2b640 1 Processor -- start 2023-10-21T16:27:46.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.847+0000 7f8b5aa2b640 1 -- start start 2023-10-21T16:27:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.848+0000 7f8b5aa2b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b54153490 0x7f8b5415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.848+0000 7f8b5aa2b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b540c97e0 0x7f8b540cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.849+0000 7f8b5aa2b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b54153870 con 0x7f8b540ca560 2023-10-21T16:27:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.849+0000 7f8b5aa2b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540cb0a0 con 0x7f8b54153490 2023-10-21T16:27:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.849+0000 7f8b5aa2b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b54159cf0 con 0x7f8b540c97e0 2023-10-21T16:27:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.850+0000 7f50fcfa9640 1 Processor -- start 2023-10-21T16:27:46.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.850+0000 7f50fcfa9640 1 -- start start 2023-10-21T16:27:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.851+0000 7f50fcfa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50f815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.851+0000 7f50fcfa9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f50f80c97e0 0x7f50f80cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.851+0000 7f50fcfa9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f8153870 con 0x7f50f80ca560 2023-10-21T16:27:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.851+0000 7f50fcfa9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f80cb0a0 con 0x7f50f80c97e0 2023-10-21T16:27:46.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.851+0000 7f50fcfa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8159cf0 con 0x7f50f8153490 2023-10-21T16:27:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.857+0000 7fae91883640 1 --2- 172.21.15.12:0/2744499585 >> v2:172.21.15.12:3300/0 conn(0x7fae8c153490 0x7fae8c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.859+0000 7f88d7fff640 1 --2- 172.21.15.12:0/1166817195 >> v2:172.21.15.12:3300/0 conn(0x7f88d80c55f0 0x7f88d8157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.861+0000 7fae91883640 1 -- 172.21.15.12:0/2744499585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0c97e0 msgr2=0x7fae8c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.861+0000 7fae91883640 1 --2- 172.21.15.12:0/2744499585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0c97e0 0x7fae8c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.861+0000 7fae91883640 1 -- 172.21.15.12:0/2744499585 >> v1:172.21.15.99:6789/0 conn(0x7fae8c0ca560 legacy=0x7fae8c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.861+0000 7fae91883640 1 -- 172.21.15.12:0/2744499585 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c159fd0 con 0x7fae8c153490 2023-10-21T16:27:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.866+0000 7f88d7fff640 1 -- 172.21.15.12:0/1166817195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d8157cc0 msgr2=0x7f88d8150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.866+0000 7f88d7fff640 1 --2- 172.21.15.12:0/1166817195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d8157cc0 0x7f88d8150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.866+0000 7f88d7fff640 1 -- 172.21.15.12:0/1166817195 >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 msgr2=0x7f88d8151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.866+0000 7f88d7fff640 1 --2- 172.21.15.12:0/1166817195 >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 0x7f88d8151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.866+0000 7f88d7fff640 1 -- 172.21.15.12:0/1166817195 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d815add0 con 0x7f88d80c55f0 2023-10-21T16:27:46.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.868+0000 7fae91883640 1 --2- 172.21.15.12:0/2744499585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c15a600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097a0 tx=0x7fae7c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8888aedb693c3de server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.869+0000 7f69ea59c640 1 --2- 172.21.15.12:0/109871147 >> v2:172.21.15.12:3300/0 conn(0x7f69e40d9250 0x7f69e4007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.874+0000 7f88d7fff640 1 --2- 172.21.15.12:0/1166817195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d80c55f0 0x7f88d8157780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88d80c1b00 tx=0x7f88c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613580cf7a62d4ca server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.874+0000 7f8b53fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b54153490 0x7f8b5415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.877+0000 7f8b53fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b54153490 0x7f8b5415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47660/0 (socket says 172.21.15.12:47660) 2023-10-21T16:27:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.877+0000 7f8b53fff640 1 -- 172.21.15.12:0/1302390702 learned_addr learned my addr 172.21.15.12:0/1302390702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.878+0000 7f50f6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f50f80ca560 0x7f50f8159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44316/0 (socket says 172.21.15.12:44316) 2023-10-21T16:27:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.878+0000 7f50f6d9d640 1 -- 172.21.15.12:0/2597470335 learned_addr learned my addr 172.21.15.12:0/2597470335 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.880+0000 7f88d6ffd640 1 -- 172.21.15.12:0/1166817195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8031830 con 0x7f88d80c55f0 2023-10-21T16:27:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.880+0000 7f88d6ffd640 1 -- 172.21.15.12:0/1166817195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c8031990 con 0x7f88d80c55f0 2023-10-21T16:27:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.880+0000 7f88d6ffd640 1 -- 172.21.15.12:0/1166817195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8031d20 con 0x7f88d80c55f0 2023-10-21T16:27:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 -- 172.21.15.12:0/1166817195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d80c55f0 msgr2=0x7f88d8157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 --2- 172.21.15.12:0/1166817195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d80c55f0 0x7f88d8157780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88d80c1b00 tx=0x7f88c802b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 -- 172.21.15.12:0/1166817195 shutdown_connections 2023-10-21T16:27:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 --2- 172.21.15.12:0/1166817195 >> v2:172.21.15.99:3300/0 conn(0x7f88d80c59d0 0x7f88d8151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 --2- 172.21.15.12:0/1166817195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d8157cc0 0x7f88d8150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 --2- 172.21.15.12:0/1166817195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d80c55f0 0x7f88d8157780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 -- 172.21.15.12:0/1166817195 >> 172.21.15.12:0/1166817195 conn(0x7f88d8069de0 msgr2=0x7f88d806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 -- 172.21.15.12:0/1166817195 shutdown_connections 2023-10-21T16:27:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.881+0000 7f88de747640 1 -- 172.21.15.12:0/1166817195 wait complete. 2023-10-21T16:27:46.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.883+0000 7f88de747640 1 Processor -- start 2023-10-21T16:27:46.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.883+0000 7f88de747640 1 -- start start 2023-10-21T16:27:46.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.884+0000 7f88de747640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d80c55f0 0x7f88d80c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.884+0000 7f88de747640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d80c59d0 0x7f88d8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.884+0000 7f88de747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.884+0000 7f88de747640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8145310 con 0x7f88d8157cc0 2023-10-21T16:27:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.884+0000 7f88de747640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8144a50 con 0x7f88d80c55f0 2023-10-21T16:27:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.885+0000 7f88de747640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d815a430 con 0x7f88d80c59d0 2023-10-21T16:27:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.886+0000 7f69ea59c640 1 -- 172.21.15.12:0/109871147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e400ebd0 msgr2=0x7f69e4007590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.886+0000 7f69ea59c640 1 --2- 172.21.15.12:0/109871147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e400ebd0 0x7f69e4007590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.886+0000 7f69ea59c640 1 -- 172.21.15.12:0/109871147 >> v1:172.21.15.99:6789/0 conn(0x7f69e4049650 legacy=0x7f69e4049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.886+0000 7f69ea59c640 1 -- 172.21.15.12:0/109871147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e404f0f0 con 0x7f69e40d9250 2023-10-21T16:27:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.887+0000 7efcf974e640 1 Processor -- start 2023-10-21T16:27:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.887+0000 7efcf974e640 1 -- start start 2023-10-21T16:27:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.889+0000 7efcf974e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcf4070780 0x7efcf40c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.889+0000 7efcf974e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4157b00 con 0x7efcf40c7550 2023-10-21T16:27:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.889+0000 7efcf974e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf415d7a0 con 0x7efcf4157720 2023-10-21T16:27:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.889+0000 7efcf974e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40c7960 con 0x7efcf4070780 2023-10-21T16:27:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.890+0000 7f8b53fff640 1 -- 172.21.15.12:0/1302390702 >> v2:172.21.15.99:3300/0 conn(0x7f8b540c97e0 msgr2=0x7f8b540cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.890+0000 7f8b53fff640 1 --2- 172.21.15.12:0/1302390702 >> v2:172.21.15.99:3300/0 conn(0x7f8b540c97e0 0x7f8b540cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.890+0000 7f8b53fff640 1 -- 172.21.15.12:0/1302390702 >> v1:172.21.15.99:6789/0 conn(0x7f8b540ca560 legacy=0x7f8b54159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.890+0000 7f8b53fff640 1 -- 172.21.15.12:0/1302390702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54159fd0 con 0x7f8b54153490 2023-10-21T16:27:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.893+0000 7f69ea59c640 1 --2- 172.21.15.12:0/109871147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e40d9250 0x7f69e4007050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0097a0 tx=0x7f69dc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8711808effdaac6d server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.894+0000 7f8b53fff640 1 --2- 172.21.15.12:0/1302390702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b54153490 0x7f8b5415a600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b5406aa70 tx=0x7f8b4402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c65ef163ee11ce server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.896+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494580010 0 0) 0x7f50f8153870 con 0x7f50f80ca560 2023-10-21T16:27:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.896+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e4003520 con 0x7f50f80ca560 2023-10-21T16:27:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.899+0000 7fae90881640 1 -- 172.21.15.12:0/2744499585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c031780 con 0x7fae8c153490 2023-10-21T16:27:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae90881640 1 -- 172.21.15.12:0/2744499585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c0318e0 con 0x7fae8c153490 2023-10-21T16:27:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae90881640 1 -- 172.21.15.12:0/2744499585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c031c70 con 0x7fae8c153490 2023-10-21T16:27:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 -- 172.21.15.12:0/2744499585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 msgr2=0x7fae8c15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 --2- 172.21.15.12:0/2744499585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c15a600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097a0 tx=0x7fae7c02b820 comp rx=0 tx=0).stop 2023-10-21T16:27:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 -- 172.21.15.12:0/2744499585 shutdown_connections 2023-10-21T16:27:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 --2- 172.21.15.12:0/2744499585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0c97e0 0x7fae8c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 --2- 172.21.15.12:0/2744499585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c15a600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.900+0000 7fae93ae7640 1 -- 172.21.15.12:0/2744499585 >> 172.21.15.12:0/2744499585 conn(0x7fae8c0716f0 msgr2=0x7fae8c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.901+0000 7fae93ae7640 1 -- 172.21.15.12:0/2744499585 shutdown_connections 2023-10-21T16:27:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.901+0000 7fae93ae7640 1 -- 172.21.15.12:0/2744499585 wait complete. 2023-10-21T16:27:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.901+0000 7f88dcce4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.903+0000 7fae93ae7640 1 Processor -- start 2023-10-21T16:27:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.903+0000 7fae93ae7640 1 -- start start 2023-10-21T16:27:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7f88dcce4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47674/0 (socket says 172.21.15.12:47674) 2023-10-21T16:27:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7f88dcce4640 1 -- 172.21.15.12:0/652542871 learned_addr learned my addr 172.21.15.12:0/652542871 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0c97e0 0x7fae8c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0ca560 0x7fae8c1ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1e2540 con 0x7fae8c153490 2023-10-21T16:27:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1eebd0 con 0x7fae8c0c97e0 2023-10-21T16:27:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7fae93ae7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c8990 con 0x7fae8c0ca560 2023-10-21T16:27:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.904+0000 7f8b52ffd640 1 -- 172.21.15.12:0/1302390702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440317e0 con 0x7f8b54153490 2023-10-21T16:27:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b52ffd640 1 -- 172.21.15.12:0/1302390702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44031940 con 0x7f8b54153490 2023-10-21T16:27:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b52ffd640 1 -- 172.21.15.12:0/1302390702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44031cd0 con 0x7f8b54153490 2023-10-21T16:27:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f69e959a640 1 -- 172.21.15.12:0/109871147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc030610 con 0x7f69e40d9250 2023-10-21T16:27:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f69e959a640 1 -- 172.21.15.12:0/109871147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc030770 con 0x7f69e40d9250 2023-10-21T16:27:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f69e959a640 1 -- 172.21.15.12:0/109871147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc030b00 con 0x7f69e40d9250 2023-10-21T16:27:46.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/1302390702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b54153490 msgr2=0x7f8b5415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/1302390702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b54153490 0x7f8b5415a600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b5406aa70 tx=0x7f8b4402b880 comp rx=0 tx=0).stop 2023-10-21T16:27:46.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/1302390702 shutdown_connections 2023-10-21T16:27:46.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/1302390702 >> v2:172.21.15.99:3300/0 conn(0x7f8b540c97e0 0x7f8b540cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/1302390702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b54153490 0x7f8b5415a600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.905+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/1302390702 >> 172.21.15.12:0/1302390702 conn(0x7f8b540716f0 msgr2=0x7f8b5406aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/1302390702 shutdown_connections 2023-10-21T16:27:46.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/1302390702 wait complete. 2023-10-21T16:27:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 -- 172.21.15.12:0/109871147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e40d9250 msgr2=0x7f69e4007050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 --2- 172.21.15.12:0/109871147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e40d9250 0x7f69e4007050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0097a0 tx=0x7f69dc02b960 comp rx=0 tx=0).stop 2023-10-21T16:27:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7efcf37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efcf40c7550 0x7efcf4160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44328/0 (socket says 172.21.15.12:44328) 2023-10-21T16:27:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7efcf37fe640 1 -- 172.21.15.12:0/744616355 learned_addr learned my addr 172.21.15.12:0/744616355 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 -- 172.21.15.12:0/109871147 shutdown_connections 2023-10-21T16:27:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 --2- 172.21.15.12:0/109871147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e400ebd0 0x7f69e4007590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 --2- 172.21.15.12:0/109871147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e40d9250 0x7f69e4007050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 -- 172.21.15.12:0/109871147 >> 172.21.15.12:0/109871147 conn(0x7f69e400e040 msgr2=0x7f69e400e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 -- 172.21.15.12:0/109871147 shutdown_connections 2023-10-21T16:27:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.906+0000 7f69eb59e640 1 -- 172.21.15.12:0/109871147 wait complete. 2023-10-21T16:27:46.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.908+0000 7f8b5aa2b640 1 Processor -- start 2023-10-21T16:27:46.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.908+0000 7f8b5aa2b640 1 -- start start 2023-10-21T16:27:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.909+0000 7f69eb59e640 1 Processor -- start 2023-10-21T16:27:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.909+0000 7f69eb59e640 1 -- start start 2023-10-21T16:27:46.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b540c97e0 0x7f8b54155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b54153490 0x7f8b540c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54154fd0 con 0x7f8b540ca560 2023-10-21T16:27:46.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540c7220 con 0x7f8b54153490 2023-10-21T16:27:46.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f8b5aa2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540c7500 con 0x7f8b540c97e0 2023-10-21T16:27:46.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e4049650 0x7f69e40dae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e40d9250 0x7f69e40da430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41748f0 con 0x7f69e400ebd0 2023-10-21T16:27:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40e1030 con 0x7f69e4049650 2023-10-21T16:27:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.910+0000 7f69eb59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40e1b70 con 0x7f69e40d9250 2023-10-21T16:27:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7efcf27fc640 1 --2- 172.21.15.12:0/744616355 >> v2:172.21.15.12:3300/0 conn(0x7efcf4070780 0x7efcf40c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567790993 0 0) 0x7f50e4003520 con 0x7f50f80ca560 2023-10-21T16:27:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 msgr2=0x7f50f815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50f815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 >> v2:172.21.15.99:3300/0 conn(0x7f50f80c97e0 msgr2=0x7f50f80cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 --2- 172.21.15.12:0/2597470335 >> v2:172.21.15.99:3300/0 conn(0x7f50f80c97e0 0x7f50f80cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8159fd0 con 0x7f50f80ca560 2023-10-21T16:27:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f50f00019f0 con 0x7f50f80ca560 2023-10-21T16:27:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 >> v1:172.21.15.12:6789/0 conn(0x7f50f80ca560 legacy=0x7f50f8159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e4003970 0x7f50e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e40047c0 0x7f50e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80cb0a0 con 0x7f50e40047c0 2023-10-21T16:27:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8159cf0 con 0x7f50e4003970 2023-10-21T16:27:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.911+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4005590 con 0x7f50f8153490 2023-10-21T16:27:46.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.915+0000 7efcf27fc640 1 -- 172.21.15.12:0/744616355 >> v1:172.21.15.99:6789/0 conn(0x7efcf4157720 legacy=0x7efcf40c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:46.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.915+0000 7efcf27fc640 1 -- 172.21.15.12:0/744616355 >> v1:172.21.15.12:6789/0 conn(0x7efcf40c7550 legacy=0x7efcf4160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.915+0000 7efcf27fc640 1 -- 172.21.15.12:0/744616355 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf415da60 con 0x7efcf4070780 2023-10-21T16:27:46.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.919+0000 7efcf27fc640 1 --2- 172.21.15.12:0/744616355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf4070780 0x7efcf40c7010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efce80097a0 tx=0x7efce802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759630ee5875f14d server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.920+0000 7fae92084640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.920+0000 7fae92084640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47688/0 (socket says 172.21.15.12:47688) 2023-10-21T16:27:46.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.920+0000 7fae92084640 1 -- 172.21.15.12:0/3456558484 learned_addr learned my addr 172.21.15.12:0/3456558484 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.925+0000 7fae92084640 1 -- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0ca560 msgr2=0x7fae8c1ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.925+0000 7fae92084640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0ca560 0x7fae8c1ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.925+0000 7fae92084640 1 -- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0c97e0 msgr2=0x7fae8c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.925+0000 7fae92084640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0c97e0 0x7fae8c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.925+0000 7fae92084640 1 -- 172.21.15.12:0/3456558484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009400 con 0x7fae8c153490 2023-10-21T16:27:46.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.929+0000 7f8b537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.932+0000 7f88dcce4640 1 -- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d80c59d0 msgr2=0x7f88d8071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.932+0000 7f88dcce4640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d80c59d0 0x7f88d8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.932+0000 7f88dcce4640 1 -- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d80c55f0 msgr2=0x7f88d80c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.932+0000 7f88dcce4640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d80c55f0 0x7f88d80c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.933+0000 7f88dcce4640 1 -- 172.21.15.12:0/652542871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009400 con 0x7f88d8157cc0 2023-10-21T16:27:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.934+0000 7f8b537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47700/0 (socket says 172.21.15.12:47700) 2023-10-21T16:27:46.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.934+0000 7f8b537fe640 1 -- 172.21.15.12:0/3595844706 learned_addr learned my addr 172.21.15.12:0/3595844706 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.935+0000 7fae92084640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae8400cbf0 tx=0x7fae8400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.939+0000 7f8b537fe640 1 -- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b540c97e0 msgr2=0x7f8b54155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.939+0000 7f8b537fe640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b540c97e0 0x7f8b54155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.939+0000 7f8b537fe640 1 -- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b54153490 msgr2=0x7f8b540c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.939+0000 7f8b537fe640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b54153490 0x7f8b540c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.939+0000 7f8b537fe640 1 -- 172.21.15.12:0/3595844706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440094d0 con 0x7f8b540ca560 2023-10-21T16:27:46.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.941+0000 7f88dcce4640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88d000efc0 tx=0x7f88d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.941+0000 7f69ea59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.942+0000 7f69ea59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47710/0 (socket says 172.21.15.12:47710) 2023-10-21T16:27:46.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.942+0000 7f69ea59c640 1 -- 172.21.15.12:0/4118148256 learned_addr learned my addr 172.21.15.12:0/4118148256 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:46.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.947+0000 7f8b537fe640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800b410 tx=0x7f8b4800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf1ffb640 1 -- 172.21.15.12:0/744616355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8031830 con 0x7efcf4070780 2023-10-21T16:27:46.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf1ffb640 1 -- 172.21.15.12:0/744616355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8031990 con 0x7efcf4070780 2023-10-21T16:27:46.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf1ffb640 1 -- 172.21.15.12:0/744616355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8031d20 con 0x7efcf4070780 2023-10-21T16:27:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf974e640 1 -- 172.21.15.12:0/744616355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf4070780 msgr2=0x7efcf40c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf974e640 1 --2- 172.21.15.12:0/744616355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf4070780 0x7efcf40c7010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efce80097a0 tx=0x7efce802b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf974e640 1 -- 172.21.15.12:0/744616355 shutdown_connections 2023-10-21T16:27:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf974e640 1 --2- 172.21.15.12:0/744616355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf4070780 0x7efcf40c7010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.948+0000 7efcf974e640 1 -- 172.21.15.12:0/744616355 >> 172.21.15.12:0/744616355 conn(0x7efcf4069de0 msgr2=0x7efcf406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.949+0000 7efcf974e640 1 -- 172.21.15.12:0/744616355 shutdown_connections 2023-10-21T16:27:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.949+0000 7efcf974e640 1 -- 172.21.15.12:0/744616355 wait complete. 2023-10-21T16:27:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.950+0000 7efcf974e640 1 Processor -- start 2023-10-21T16:27:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.950+0000 7efcf974e640 1 -- start start 2023-10-21T16:27:46.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf4070780 0x7efcf4145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 0x7efcf4146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 0x7efcf415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:46.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415b490 con 0x7efcf40c7550 2023-10-21T16:27:46.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415bf40 con 0x7efcf4070780 2023-10-21T16:27:46.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.951+0000 7efcf974e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41f3930 con 0x7efcf4157720 2023-10-21T16:27:46.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.953+0000 7f69ea59c640 1 -- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e40d9250 msgr2=0x7f69e40da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.953+0000 7f69ea59c640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e40d9250 0x7f69e40da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.953+0000 7f69ea59c640 1 -- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e4049650 msgr2=0x7f69e40dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:46.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.953+0000 7f69ea59c640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e4049650 0x7f69e40dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:46.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.953+0000 7f69ea59c640 1 -- 172.21.15.12:0/4118148256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc009400 con 0x7f69e400ebd0 2023-10-21T16:27:46.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.954+0000 7f50effff640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e40047c0 0x7f50e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.961+0000 7f69ea59c640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0098c0 tx=0x7f69dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.962+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000cd20 con 0x7f88d8157cc0 2023-10-21T16:27:46.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.962+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d000f040 con 0x7f88d8157cc0 2023-10-21T16:27:46.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.962+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000cea0 con 0x7f88d8157cc0 2023-10-21T16:27:46.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.962+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d815a6d0 con 0x7f88d8157cc0 2023-10-21T16:27:46.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.962+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d8144fa0 con 0x7f88d8157cc0 2023-10-21T16:27:46.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.963+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d815b370 con 0x7f88d8157cc0 2023-10-21T16:27:46.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.968+0000 7efcf27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 0x7efcf4146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.974+0000 7efcf27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 0x7efcf4146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47730/0 (socket says 172.21.15.12:47730) 2023-10-21T16:27:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:46.974+0000 7efcf27fc640 1 -- 172.21.15.12:0/3274546351 learned_addr learned my addr 172.21.15.12:0/3274546351 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.080+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5514032070 con 0x7f55100039c0 2023-10-21T16:27:47.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.081+0000 7f551affd640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 0x7f550806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.082+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55140ab120 con 0x7f55100039c0 2023-10-21T16:27:47.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.082+0000 7f5529b90640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 0x7f550806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.083+0000 7f5529b90640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 0x7f550806d360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55240c5ef0 tx=0x7f551c00c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.099+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55140763a0 con 0x7f55100039c0 2023-10-21T16:27:47.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.156+0000 7f50f6d9d640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.161+0000 7f50f6d9d640 1 -- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e4003970 msgr2=0x7f50e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:47.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.161+0000 7f50f6d9d640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e4003970 0x7f50e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.161+0000 7f50f6d9d640 1 -- 172.21.15.12:0/2597470335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e40047c0 msgr2=0x7f50e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:47.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.161+0000 7f50f6d9d640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e40047c0 0x7f50e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.161+0000 7f50f6d9d640 1 -- 172.21.15.12:0/2597470335 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8159fd0 con 0x7f50f8153490 2023-10-21T16:27:47.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.162+0000 7efcf37fe640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 0x7efcf415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.165+0000 7efcf37fe640 1 -- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf4070780 msgr2=0x7efcf4145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.165+0000 7efcf37fe640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf4070780 0x7efcf4145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.165+0000 7efcf37fe640 1 -- 172.21.15.12:0/3274546351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 msgr2=0x7efcf4146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.165+0000 7efcf37fe640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 0x7efcf4146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.165+0000 7efcf37fe640 1 -- 172.21.15.12:0/3274546351 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8009400 con 0x7efcf4157720 2023-10-21T16:27:47.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.168+0000 7efcf37fe640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 0x7efcf415c3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c5230 tx=0x7efcec00cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.171+0000 7f50f6d9d640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50e400b980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50f000a8a0 tx=0x7f50e40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40b566a3882f4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.173+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00aab0 con 0x7efcf4157720 2023-10-21T16:27:47.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.174+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00ac10 con 0x7efcf4157720 2023-10-21T16:27:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.174+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec012400 con 0x7efcf4157720 2023-10-21T16:27:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.174+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf41f3ba0 con 0x7efcf4157720 2023-10-21T16:27:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.174+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf415b9c0 con 0x7efcf4157720 2023-10-21T16:27:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.176+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf415e000 con 0x7efcf4157720 2023-10-21T16:27:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.177+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400ad40 con 0x7fae8c153490 2023-10-21T16:27:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.177+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84012400 con 0x7fae8c153490 2023-10-21T16:27:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.177+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c1511d0 con 0x7fae8c153490 2023-10-21T16:27:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.177+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c1f2dd0 con 0x7fae8c153490 2023-10-21T16:27:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.179+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0c91e0 con 0x7fae8c153490 2023-10-21T16:27:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.179+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3868058880 con 0x7f38740cab10 2023-10-21T16:27:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.183+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0034630 con 0x7f50f8153490 2023-10-21T16:27:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.183+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f002f070 con 0x7f50f8153490 2023-10-21T16:27:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.183+0000 7f50f5d9b640 1 -- 172.21.15.12:0/2597470335 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00349f0 con 0x7f50f8153490 2023-10-21T16:27:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.184+0000 7f50fcfa9640 1 -- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 msgr2=0x7f50e400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.184+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/2597470335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f8153490 0x7f50e400b980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50f000a8a0 tx=0x7f50e40057f0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.184+0000 7f50f6d9d640 1 -- 172.21.15.12:0/2597470335 reap_dead start 2023-10-21T16:27:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.185+0000 7f50fcfa9640 1 -- 172.21.15.12:0/2597470335 shutdown_connections 2023-10-21T16:27:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.185+0000 7f50fcfa9640 1 -- 172.21.15.12:0/2597470335 >> 172.21.15.12:0/2597470335 conn(0x7f50f80716f0 msgr2=0x7f50f806aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.185+0000 7f50fcfa9640 1 -- 172.21.15.12:0/2597470335 shutdown_connections 2023-10-21T16:27:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.185+0000 7f50fcfa9640 1 -- 172.21.15.12:0/2597470335 wait complete. 2023-10-21T16:27:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.188+0000 7f50fcfa9640 1 Processor -- start 2023-10-21T16:27:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.188+0000 7f50fcfa9640 1 -- start start 2023-10-21T16:27:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.189+0000 7f50fcfa9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 0x7f50f80c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.189+0000 7f50fcfa9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50f80c4ff0 0x7f50f8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.189+0000 7f50fcfa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 0x7f50f8155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.189+0000 7f50fcfa9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c2f20 con 0x7f50f80c4ff0 2023-10-21T16:27:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.190+0000 7f50fcfa9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c4260 con 0x7f50f8153490 2023-10-21T16:27:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.190+0000 7f50fcfa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c2050 con 0x7f50f81559d0 2023-10-21T16:27:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.194+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3868057f50 con 0x7f38740cab10 2023-10-21T16:27:47.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.196+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efcec007070 con 0x7efcf4157720 2023-10-21T16:27:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.197+0000 7efcdb7fe640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 0x7efce006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.198+0000 7efcf2ffd640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 0x7efce006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.198+0000 7efcf2ffd640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 0x7efce006d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efce4009650 tx=0x7efce4006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.199+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcec058be0 con 0x7efcf4157720 2023-10-21T16:27:47.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.199+0000 7f50f6d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 0x7f50f8155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.201+0000 7f50f6d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 0x7f50f8155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54122/0 (socket says 172.21.15.12:54122) 2023-10-21T16:27:47.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.201+0000 7f50f6d9d640 1 -- 172.21.15.12:0/3846661586 learned_addr learned my addr 172.21.15.12:0/3846661586 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:47.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.201+0000 7f50f659c640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 0x7f50f80c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.205+0000 7f50f659c640 1 -- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 msgr2=0x7f50f8155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.205+0000 7f50f659c640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 0x7f50f8155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.205+0000 7f50f659c640 1 -- 172.21.15.12:0/3846661586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50f80c4ff0 msgr2=0x7f50f8157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.205+0000 7f50f659c640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50f80c4ff0 0x7f50f8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.205+0000 7f50f659c640 1 -- 172.21.15.12:0/3846661586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f81563c0 con 0x7f50f8153490 2023-10-21T16:27:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.207+0000 7f50f659c640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 0x7f50f80c3d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50e800b410 tx=0x7f50e800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.211+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8011830 con 0x7f50f8153490 2023-10-21T16:27:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.211+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8011990 con 0x7f50f8153490 2023-10-21T16:27:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.211+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f80c22a0 con 0x7f50f8153490 2023-10-21T16:27:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.211+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f80c2860 con 0x7f50f8153490 2023-10-21T16:27:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.211+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8011d40 con 0x7f50f8153490 2023-10-21T16:27:47.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.212+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc005250 con 0x7f50f8153490 2023-10-21T16:27:47.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.231+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f50e801a400 con 0x7f50f8153490 2023-10-21T16:27:47.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.232+0000 7f50eeffd640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 0x7f50d806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.232+0000 7f50effff640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 0x7f50d806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.233+0000 7f50effff640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 0x7f50d806d3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50f815c8b0 tx=0x7f50e0009480 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.233+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50e8058aa0 con 0x7f50f8153490 2023-10-21T16:27:47.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.256+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400aea0 con 0x7fae8c153490 2023-10-21T16:27:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.276+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc03e040 con 0x7f69e400ebd0 2023-10-21T16:27:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.277+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc039c30 con 0x7f69e400ebd0 2023-10-21T16:27:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.277+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0443f0 con 0x7f69e400ebd0 2023-10-21T16:27:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.277+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4174ae0 con 0x7f69e400ebd0 2023-10-21T16:27:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.277+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e40e1520 con 0x7f69e400ebd0 2023-10-21T16:27:47.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.278+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e404b2d0 con 0x7f69e400ebd0 2023-10-21T16:27:47.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.306+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88d0003bd0 con 0x7f88d8157cc0 2023-10-21T16:27:47.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.308+0000 7f88d4ff9640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 0x7f88c406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.308+0000 7f88d7fff640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 0x7f88c406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.309+0000 7f88d7fff640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 0x7f88c406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88c8036000 tx=0x7f88c8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.310+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f550c0050c0 con 0x7f55100039c0 2023-10-21T16:27:47.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.330+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d0059cb0 con 0x7f88d8157cc0 2023-10-21T16:27:47.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.331+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88d00558f0 con 0x7f88d8157cc0 2023-10-21T16:27:47.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.437+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f38540057d0 con 0x7f38740cab10 2023-10-21T16:27:47.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.446+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcec0582b0 con 0x7efcf4157720 2023-10-21T16:27:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.455+0000 7f551affd640 1 -- 172.21.15.12:0/1781780727 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5514045090 con 0x7f55100039c0 2023-10-21T16:27:47.457 INFO:teuthology.orchestra.run.smithi012.stdout:68719476748 2023-10-21T16:27:47.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.458+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 msgr2=0x7f550806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.458+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 0x7f550806d360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55240c5ef0 tx=0x7f551c00c040 comp rx=0 tx=0).stop 2023-10-21T16:27:47.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.458+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 msgr2=0x7f55240c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.458+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f55240c12f0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.458+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 shutdown_connections 2023-10-21T16:27:47.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f550806aea0 0x7f550806d360 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55240c76a0 0x7f55240849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5524070aa0 0x7f5524084480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 --2- 172.21.15.12:0/1781780727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55100039c0 0x7f55240c7160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 >> 172.21.15.12:0/1781780727 conn(0x7f552406bac0 msgr2=0x7f55240c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:47.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 shutdown_connections 2023-10-21T16:27:47.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.459+0000 7f552b393640 1 -- 172.21.15.12:0/1781780727 wait complete. 2023-10-21T16:27:47.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476749 got 68719476748 for osd.1 2023-10-21T16:27:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.486+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50e8054de0 con 0x7f50f8153490 2023-10-21T16:27:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.487+0000 7f385b7fe640 1 -- 172.21.15.12:0/212159693 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3868015020 con 0x7f38740cab10 2023-10-21T16:27:47.489 INFO:teuthology.orchestra.run.smithi012.stdout:64424509451 2023-10-21T16:27:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 msgr2=0x7f386006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 0x7f386006d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f386c001db0 tx=0x7f386c009040 comp rx=0 tx=0).stop 2023-10-21T16:27:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 msgr2=0x7f38740c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f386800b440 tx=0x7f386800b840 comp rx=0 tx=0).stop 2023-10-21T16:27:47.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 shutdown_connections 2023-10-21T16:27:47.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f386006aed0 0x7f386006d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38740cab10 0x7f38740c60d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f38740ca730 0x7f3874155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 --2- 172.21.15.12:0/212159693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38740705e0 0x7f38741f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 >> 172.21.15.12:0/212159693 conn(0x7f387406baa0 msgr2=0x7f38741575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:47.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 shutdown_connections 2023-10-21T16:27:47.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.490+0000 7f3879009640 1 -- 172.21.15.12:0/212159693 wait complete. 2023-10-21T16:27:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.499+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48011830 con 0x7f8b540ca560 2023-10-21T16:27:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.500+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480119b0 con 0x7f8b540ca560 2023-10-21T16:27:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.500+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48011d60 con 0x7f8b540ca560 2023-10-21T16:27:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.500+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b540c77e0 con 0x7f8b540ca560 2023-10-21T16:27:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.500+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b54154c60 con 0x7f8b540ca560 2023-10-21T16:27:47.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.502+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b540619f0 con 0x7f8b540ca560 2023-10-21T16:27:47.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.4 2023-10-21T16:27:47.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.531+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f88d815b370 con 0x7f88d8157cc0 2023-10-21T16:27:47.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.649+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efcf415e000 con 0x7efcf4157720 2023-10-21T16:27:47.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.653+0000 7efcdb7fe640 1 -- 172.21.15.12:0/3274546351 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcf415e000 con 0x7efcf4157720 2023-10-21T16:27:47.655 INFO:teuthology.orchestra.run.smithi012.stdout:64424509451 2023-10-21T16:27:47.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.655+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 msgr2=0x7efce006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.655+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 0x7efce006d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efce4009650 tx=0x7efce4006ba0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.655+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 msgr2=0x7efcf415c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 0x7efcf415c3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c5230 tx=0x7efcec00cf00 comp rx=0 tx=0).stop 2023-10-21T16:27:47.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 shutdown_connections 2023-10-21T16:27:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efce006aec0 0x7efce006d380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efcf4157720 0x7efcf415c3d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf40c7550 0x7efcf4146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 --2- 172.21.15.12:0/3274546351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf4070780 0x7efcf4145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 >> 172.21.15.12:0/3274546351 conn(0x7efcf4069de0 msgr2=0x7efcf40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:47.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 shutdown_connections 2023-10-21T16:27:47.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.656+0000 7efcf974e640 1 -- 172.21.15.12:0/3274546351 wait complete. 2023-10-21T16:27:47.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.5 2023-10-21T16:27:47.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.687+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50dc0057d0 con 0x7f50f8153490 2023-10-21T16:27:47.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.692+0000 7f50eeffd640 1 -- 172.21.15.12:0/3846661586 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50e8015020 con 0x7f50f8153490 2023-10-21T16:27:47.693 INFO:teuthology.orchestra.run.smithi012.stdout:68719476749 2023-10-21T16:27:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 msgr2=0x7f50d806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 0x7f50d806d3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50f815c8b0 tx=0x7f50e0009480 comp rx=0 tx=0).stop 2023-10-21T16:27:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 msgr2=0x7f50f80c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 0x7f50f80c3d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50e800b410 tx=0x7f50e800b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 shutdown_connections 2023-10-21T16:27:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f50d806aef0 0x7f50d806d3b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50f81559d0 0x7f50f8155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50f80c4ff0 0x7f50f8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 --2- 172.21.15.12:0/3846661586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50f8153490 0x7f50f80c3d20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 >> 172.21.15.12:0/3846661586 conn(0x7f50f80716f0 msgr2=0x7f50f80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:47.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 shutdown_connections 2023-10-21T16:27:47.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.694+0000 7f50fcfa9640 1 -- 172.21.15.12:0/3846661586 wait complete. 2023-10-21T16:27:47.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476750 got 68719476749 for osd.0 2023-10-21T16:27:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.734+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae84012770 con 0x7fae8c153490 2023-10-21T16:27:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.735+0000 7fae827fc640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 0x7fae7006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.736+0000 7fae91883640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 0x7fae7006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:47.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.737+0000 7fae91883640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 0x7fae7006d3b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036000 tx=0x7fae7c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.755+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae84058b30 con 0x7fae8c153490 2023-10-21T16:27:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.756+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae84054e70 con 0x7fae8c153490 2023-10-21T16:27:47.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:47.964+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae8c0619f0 con 0x7fae8c153490 2023-10-21T16:27:48.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.316+0000 7f88d4ff9640 1 -- 172.21.15.12:0/652542871 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88d815b370 con 0x7f88d8157cc0 2023-10-21T16:27:48.319 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-10-21T16:27:48.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 msgr2=0x7f88c406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 0x7f88c406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88c8036000 tx=0x7f88c8030000 comp rx=0 tx=0).stop 2023-10-21T16:27:48.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 msgr2=0x7f88d81f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88d000efc0 tx=0x7f88d000c490 comp rx=0 tx=0).stop 2023-10-21T16:27:48.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 shutdown_connections 2023-10-21T16:27:48.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f88c406aec0 0x7f88c406d380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d8157cc0 0x7f88d81f2760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88d80c59d0 0x7f88d8071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 --2- 172.21.15.12:0/652542871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d80c55f0 0x7f88d80c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 >> 172.21.15.12:0/652542871 conn(0x7f88d8069de0 msgr2=0x7f88d806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.320+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 shutdown_connections 2023-10-21T16:27:48.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.321+0000 7f88de747640 1 -- 172.21.15.12:0/652542871 wait complete. 2023-10-21T16:27:48.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.7 2023-10-21T16:27:48.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.377+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f69dc04d3b0 con 0x7f69e400ebd0 2023-10-21T16:27:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.379+0000 7f69daffd640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 0x7f69cc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.379+0000 7f69e9d9b640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 0x7f69cc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.380+0000 7f69e9d9b640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 0x7f69cc06d380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69e40542e0 tx=0x7f69e0006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.411+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69dc07b620 con 0x7f69e400ebd0 2023-10-21T16:27:48.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.412+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69dc077260 con 0x7f69e400ebd0 2023-10-21T16:27:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.465+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b4801a400 con 0x7f8b540ca560 2023-10-21T16:27:48.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.468+0000 7f8b50ff9640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 0x7f8b4006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.468+0000 7f8b53fff640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 0x7f8b4006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.469+0000 7f8b53fff640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 0x7f8b4006d3b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b44036000 tx=0x7f8b44030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-21T16:27:48.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.515+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b480591a0 con 0x7f8b540ca560 2023-10-21T16:27:48.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.516+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b48054de0 con 0x7f8b540ca560 2023-10-21T16:27:48.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-21T16:27:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.518+0000 7fae827fc640 1 -- 172.21.15.12:0/3456558484 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae84017090 con 0x7fae8c153490 2023-10-21T16:27:48.520 INFO:teuthology.orchestra.run.smithi012.stdout:68719476747 2023-10-21T16:27:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.521+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 msgr2=0x7fae7006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.521+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 0x7fae7006d3b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036000 tx=0x7fae7c030000 comp rx=0 tx=0).stop 2023-10-21T16:27:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.521+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 msgr2=0x7fae8c1ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.521+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae8400cbf0 tx=0x7fae8400a430 comp rx=0 tx=0).stop 2023-10-21T16:27:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 shutdown_connections 2023-10-21T16:27:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fae7006aef0 0x7fae7006d3b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae8c153490 0x7fae8c1ef5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae8c0ca560 0x7fae8c1ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 --2- 172.21.15.12:0/3456558484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0c97e0 0x7fae8c157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 >> 172.21.15.12:0/3456558484 conn(0x7fae8c0716f0 msgr2=0x7fae8c0ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 shutdown_connections 2023-10-21T16:27:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.522+0000 7fae93ae7640 1 -- 172.21.15.12:0/3456558484 wait complete. 2023-10-21T16:27:48.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476747 for osd.3 2023-10-21T16:27:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.645+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69e4050030 con 0x7f69e400ebd0 2023-10-21T16:27:48.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.655+0000 7f69daffd640 1 -- 172.21.15.12:0/4118148256 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69dc049090 con 0x7f69e400ebd0 2023-10-21T16:27:48.657 INFO:teuthology.orchestra.run.smithi012.stdout:68719476749 2023-10-21T16:27:48.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 msgr2=0x7f69cc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 0x7f69cc06d380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69e40542e0 tx=0x7f69e0006bf0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 msgr2=0x7f69e40e2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0098c0 tx=0x7f69dc004730 comp rx=0 tx=0).stop 2023-10-21T16:27:48.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 shutdown_connections 2023-10-21T16:27:48.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f69cc06aec0 0x7f69cc06d380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e40d9250 0x7f69e40da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e4049650 0x7f69e40dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 --2- 172.21.15.12:0/4118148256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e400ebd0 0x7f69e40e2000 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 >> 172.21.15.12:0/4118148256 conn(0x7f69e400e040 msgr2=0x7f69e40e2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 shutdown_connections 2023-10-21T16:27:48.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.658+0000 7f69eb59e640 1 -- 172.21.15.12:0/4118148256 wait complete. 2023-10-21T16:27:48.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-21T16:27:48.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476749 got 68719476749 for osd.2 2023-10-21T16:27:48.684 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:48.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.709+0000 7f46155e9640 1 Processor -- start 2023-10-21T16:27:48.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.709+0000 7f46155e9640 1 -- start start 2023-10-21T16:27:48.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.710+0000 7f46155e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4610153490 0x7f461015a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.711+0000 7f46155e9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46100cbe40 0x7f4610159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.711+0000 7f46155e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100cc250 con 0x7f46100c97e0 2023-10-21T16:27:48.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.711+0000 7f46155e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4610153870 con 0x7f4610153490 2023-10-21T16:27:48.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.711+0000 7f46155e9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46100cb0a0 con 0x7f46100cbe40 2023-10-21T16:27:48.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-21T16:27:48.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.719+0000 7f460f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46100cbe40 0x7f4610159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.720+0000 7f460f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46100cbe40 0x7f4610159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60796/0 (socket says 172.21.15.12:60796) 2023-10-21T16:27:48.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.720+0000 7f460f7fe640 1 -- 172.21.15.12:0/4060503986 learned_addr learned my addr 172.21.15.12:0/4060503986 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:48.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.722+0000 7f460f7fe640 1 -- 172.21.15.12:0/4060503986 >> v2:172.21.15.12:3300/0 conn(0x7f4610153490 msgr2=0x7f461015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.722+0000 7f460f7fe640 1 --2- 172.21.15.12:0/4060503986 >> v2:172.21.15.12:3300/0 conn(0x7f4610153490 0x7f461015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.722+0000 7f460f7fe640 1 -- 172.21.15.12:0/4060503986 >> v1:172.21.15.12:6789/0 conn(0x7f46100c97e0 legacy=0x7f46100ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.722+0000 7f460f7fe640 1 -- 172.21.15.12:0/4060503986 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610159cf0 con 0x7f46100cbe40 2023-10-21T16:27:48.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.724+0000 7f460f7fe640 1 --2- 172.21.15.12:0/4060503986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f4610159110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46100c94b0 tx=0x7f460802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f9b02597504e9a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.728+0000 7f460dffb640 1 -- 172.21.15.12:0/4060503986 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460802ca80 con 0x7f46100cbe40 2023-10-21T16:27:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.728+0000 7f460dffb640 1 -- 172.21.15.12:0/4060503986 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460802cbe0 con 0x7f46100cbe40 2023-10-21T16:27:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.728+0000 7f460dffb640 1 -- 172.21.15.12:0/4060503986 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080343f0 con 0x7f46100cbe40 2023-10-21T16:27:48.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 -- 172.21.15.12:0/4060503986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 msgr2=0x7f4610159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 --2- 172.21.15.12:0/4060503986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f4610159110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46100c94b0 tx=0x7f460802bee0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 -- 172.21.15.12:0/4060503986 shutdown_connections 2023-10-21T16:27:48.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 --2- 172.21.15.12:0/4060503986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f4610159110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 --2- 172.21.15.12:0/4060503986 >> v2:172.21.15.12:3300/0 conn(0x7f4610153490 0x7f461015a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 -- 172.21.15.12:0/4060503986 >> 172.21.15.12:0/4060503986 conn(0x7f46100716f0 msgr2=0x7f461006aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 -- 172.21.15.12:0/4060503986 shutdown_connections 2023-10-21T16:27:48.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.729+0000 7f46155e9640 1 -- 172.21.15.12:0/4060503986 wait complete. 2023-10-21T16:27:48.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.732+0000 7f46155e9640 1 Processor -- start 2023-10-21T16:27:48.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.732+0000 7f46155e9640 1 -- start start 2023-10-21T16:27:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46100c97e0 0x7f46100c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4610153490 0x7f46101f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c7010 con 0x7f46100c97e0 2023-10-21T16:27:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461014a590 con 0x7f46100cbe40 2023-10-21T16:27:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.733+0000 7f46155e9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c6990 con 0x7f4610153490 2023-10-21T16:27:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.734+0000 7f460e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.734+0000 7f460e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60798/0 (socket says 172.21.15.12:60798) 2023-10-21T16:27:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.735+0000 7f460e7fc640 1 -- 172.21.15.12:0/3421640251 learned_addr learned my addr 172.21.15.12:0/3421640251 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:48.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.736+0000 7f460f7fe640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4610153490 0x7f46101f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.738+0000 7f460e7fc640 1 -- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4610153490 msgr2=0x7f46101f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.738+0000 7f460e7fc640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4610153490 0x7f46101f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.738+0000 7f460e7fc640 1 -- 172.21.15.12:0/3421640251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46100c97e0 msgr2=0x7f46100c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.738+0000 7f460e7fc640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46100c97e0 0x7f46100c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.738+0000 7f460e7fc640 1 -- 172.21.15.12:0/3421640251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009b30 con 0x7f46100cbe40 2023-10-21T16:27:48.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.741+0000 7f460e7fc640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f460400c440 tx=0x7f460400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.743+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604005480 con 0x7f46100cbe40 2023-10-21T16:27:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.743+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46100c8750 con 0x7f46100cbe40 2023-10-21T16:27:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.743+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46100c6c30 con 0x7f46100cbe40 2023-10-21T16:27:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.744+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46100c6df0 con 0x7f46100cbe40 2023-10-21T16:27:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.744+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4604001120 con 0x7f46100cbe40 2023-10-21T16:27:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.744+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040037f0 con 0x7f46100cbe40 2023-10-21T16:27:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.762+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8b54155110 con 0x7f8b540ca560 2023-10-21T16:27:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.765+0000 7f23ab094640 1 Processor -- start 2023-10-21T16:27:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.765+0000 7f23ab094640 1 -- start start 2023-10-21T16:27:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.767+0000 7f23ab094640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23a41535c0 0x7f23a40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.767+0000 7f23ab094640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.767+0000 7f23ab094640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a4159430 con 0x7f23a41531e0 2023-10-21T16:27:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.767+0000 7f23ab094640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a41596f0 con 0x7f23a41535c0 2023-10-21T16:27:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.767+0000 7f23ab094640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41599d0 con 0x7f23a40c7540 2023-10-21T16:27:48.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.769+0000 7f23a9631640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.770+0000 7f23a9631640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54140/0 (socket says 172.21.15.12:54140) 2023-10-21T16:27:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.770+0000 7f23a9631640 1 -- 172.21.15.12:0/1148925028 learned_addr learned my addr 172.21.15.12:0/1148925028 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:48.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.772+0000 7f23a9631640 1 -- 172.21.15.12:0/1148925028 >> v2:172.21.15.99:3300/0 conn(0x7f23a41535c0 msgr2=0x7f23a40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.772+0000 7f23a9631640 1 --2- 172.21.15.12:0/1148925028 >> v2:172.21.15.99:3300/0 conn(0x7f23a41535c0 0x7f23a40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.772+0000 7f23a9631640 1 -- 172.21.15.12:0/1148925028 >> v1:172.21.15.99:6789/0 conn(0x7f23a41531e0 legacy=0x7f23a406ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.772+0000 7f23a9631640 1 -- 172.21.15.12:0/1148925028 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4159cb0 con 0x7f23a40c7540 2023-10-21T16:27:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.774+0000 7f23a9631640 1 --2- 172.21.15.12:0/1148925028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f239c009e50 tx=0x7f239c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e704b36c2f343c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.776+0000 7f8b50ff9640 1 -- 172.21.15.12:0/3595844706 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b48015020 con 0x7f8b540ca560 2023-10-21T16:27:48.778 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.778+0000 7f23a37fe640 1 -- 172.21.15.12:0/1148925028 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c02ca80 con 0x7f23a40c7540 2023-10-21T16:27:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.778+0000 7f23a37fe640 1 -- 172.21.15.12:0/1148925028 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c02cbe0 con 0x7f23a40c7540 2023-10-21T16:27:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.778+0000 7f23a37fe640 1 -- 172.21.15.12:0/1148925028 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c0343f0 con 0x7f23a40c7540 2023-10-21T16:27:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 msgr2=0x7f8b4006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 0x7f8b4006d3b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b44036000 tx=0x7f8b44030000 comp rx=0 tx=0).stop 2023-10-21T16:27:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 msgr2=0x7f8b541559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800b410 tx=0x7f8b4800b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 shutdown_connections 2023-10-21T16:27:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8b4006aef0 0x7f8b4006d3b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b54153490 0x7f8b540c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b540ca560 0x7f8b541559a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 --2- 172.21.15.12:0/3595844706 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b540c97e0 0x7f8b54155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 >> 172.21.15.12:0/3595844706 conn(0x7f8b540716f0 msgr2=0x7f8b540ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 shutdown_connections 2023-10-21T16:27:48.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f8b5aa2b640 1 -- 172.21.15.12:0/3595844706 wait complete. 2023-10-21T16:27:48.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f23ab094640 1 -- 172.21.15.12:0/1148925028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 msgr2=0x7f23a40c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.779+0000 7f23ab094640 1 --2- 172.21.15.12:0/1148925028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f239c009e50 tx=0x7f239c02bee0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 -- 172.21.15.12:0/1148925028 shutdown_connections 2023-10-21T16:27:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 --2- 172.21.15.12:0/1148925028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a40c8910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 --2- 172.21.15.12:0/1148925028 >> v2:172.21.15.99:3300/0 conn(0x7f23a41535c0 0x7f23a40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 -- 172.21.15.12:0/1148925028 >> 172.21.15.12:0/1148925028 conn(0x7f23a406b0d0 msgr2=0x7f23a406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 -- 172.21.15.12:0/1148925028 shutdown_connections 2023-10-21T16:27:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.780+0000 7f23ab094640 1 -- 172.21.15.12:0/1148925028 wait complete. 2023-10-21T16:27:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.782+0000 7f23ab094640 1 Processor -- start 2023-10-21T16:27:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.782+0000 7f23ab094640 1 -- start start 2023-10-21T16:27:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23a41531e0 0x7f23a415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a41535c0 0x7f23a40c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a414f1b0 con 0x7f23a41535c0 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a414d480 con 0x7f23a41531e0 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.783+0000 7f23ab094640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a414e5c0 con 0x7f23a40c7540 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.784+0000 7f23a8e30640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.784+0000 7f23a8e30640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54148/0 (socket says 172.21.15.12:54148) 2023-10-21T16:27:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.784+0000 7f23a8e30640 1 -- 172.21.15.12:0/3062839201 learned_addr learned my addr 172.21.15.12:0/3062839201 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.785+0000 7f23a9631640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a41535c0 0x7f23a40c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.787+0000 7f23a8e30640 1 -- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23a41531e0 msgr2=0x7f23a415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.787+0000 7f23a8e30640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23a41531e0 0x7f23a415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.787+0000 7f23a8e30640 1 -- 172.21.15.12:0/3062839201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a41535c0 msgr2=0x7f23a40c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.787+0000 7f23a8e30640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a41535c0 0x7f23a40c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.787+0000 7f23a8e30640 1 -- 172.21.15.12:0/3062839201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c009b30 con 0x7f23a40c7540 2023-10-21T16:27:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.790+0000 7f23a8e30640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f239800c440 tx=0x7f239800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.794+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398005480 con 0x7f23a40c7540 2023-10-21T16:27:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.794+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980035f0 con 0x7f23a40c7540 2023-10-21T16:27:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.794+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980039c0 con 0x7f23a40c7540 2023-10-21T16:27:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.794+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a415b030 con 0x7f23a40c7540 2023-10-21T16:27:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.794+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a414dc90 con 0x7f23a40c7540 2023-10-21T16:27:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.795+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40619f0 con 0x7f23a40c7540 2023-10-21T16:27:48.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.6 2023-10-21T16:27:48.800 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.881+0000 7fd19c0d7640 1 Processor -- start 2023-10-21T16:27:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.881+0000 7fd19c0d7640 1 -- start start 2023-10-21T16:27:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.882+0000 7fd19c0d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 0x7fd1940c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.882+0000 7fd19c0d7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940c23f0 con 0x7fd1940c59d0 2023-10-21T16:27:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.882+0000 7fd19c0d7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd194156fa0 con 0x7fd1940c55f0 2023-10-21T16:27:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.882+0000 7fd19c0d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19415aaf0 con 0x7fd19415a590 2023-10-21T16:27:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.883+0000 7fd199672640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd1940c59d0 0x7fd194150de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44342/0 (socket says 172.21.15.12:44342) 2023-10-21T16:27:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.883+0000 7fd199672640 1 -- 172.21.15.12:0/1174827249 learned_addr learned my addr 172.21.15.12:0/1174827249 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:48.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.886+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424369202 0 0) 0x7fd1940c23f0 con 0x7fd1940c59d0 2023-10-21T16:27:48.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.886+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003520 con 0x7fd1940c59d0 2023-10-21T16:27:48.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776004062 0 0) 0x7fd180003520 con 0x7fd1940c59d0 2023-10-21T16:27:48.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 msgr2=0x7fd1940c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 0x7fd1940c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 >> v1:172.21.15.99:6789/0 conn(0x7fd1940c55f0 legacy=0x7fd194157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19415add0 con 0x7fd1940c59d0 2023-10-21T16:27:48.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7fd184001670 con 0x7fd1940c59d0 2023-10-21T16:27:48.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 >> v1:172.21.15.12:6789/0 conn(0x7fd1940c59d0 legacy=0x7fd194150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1800039a0 0x7fd180003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 0x7fd1800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd180004e20 0x7fd18000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19415aaf0 con 0x7fd1800039a0 2023-10-21T16:27:48.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180005560 con 0x7fd180004e20 2023-10-21T16:27:48.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.890+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000bec0 con 0x7fd19415a590 2023-10-21T16:27:48.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.893+0000 7fd199e73640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1800039a0 0x7fd180003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.896+0000 7fd199e73640 1 -- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 msgr2=0x7fd1800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.896+0000 7fd199e73640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19415a590 0x7fd1800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.896+0000 7fd199e73640 1 -- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd180004e20 msgr2=0x7fd18000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.896+0000 7fd199e73640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd180004e20 0x7fd18000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.896+0000 7fd199e73640 1 -- 172.21.15.12:0/1174827249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180003520 con 0x7fd1800039a0 2023-10-21T16:27:48.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.899+0000 7fd199e73640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1800039a0 0x7fd180003da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd190001650 tx=0x7fd1800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7b130956520e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.904+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190005270 con 0x7fd1800039a0 2023-10-21T16:27:48.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.904+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19002e070 con 0x7fd1800039a0 2023-10-21T16:27:48.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.904+0000 7fd198e71640 1 -- 172.21.15.12:0/1174827249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190003610 con 0x7fd1800039a0 2023-10-21T16:27:48.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7f0635e15640 1 Processor -- start 2023-10-21T16:27:48.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7f0635e15640 1 -- start start 2023-10-21T16:27:48.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1174827249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1800039a0 msgr2=0x7fd180003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1174827249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1800039a0 0x7fd180003da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd190001650 tx=0x7fd1800057f0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19a674640 1 -- 172.21.15.12:0/1174827249 reap_dead start 2023-10-21T16:27:48.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1174827249 shutdown_connections 2023-10-21T16:27:48.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1174827249 >> 172.21.15.12:0/1174827249 conn(0x7fd194069de0 msgr2=0x7fd19406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:48.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1174827249 shutdown_connections 2023-10-21T16:27:48.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.905+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1174827249 wait complete. 2023-10-21T16:27:48.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.906+0000 7f0635e15640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06300c55f0 0x7f0630157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.906+0000 7f0635e15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 0x7f0630150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.906+0000 7f0635e15640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300c23f0 con 0x7f06300c59d0 2023-10-21T16:27:48.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.906+0000 7f0635e15640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0630156fa0 con 0x7f06300c55f0 2023-10-21T16:27:48.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.906+0000 7f0635e15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063015aaf0 con 0x7f0630157cc0 2023-10-21T16:27:48.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.907+0000 7fd19c0d7640 1 Processor -- start 2023-10-21T16:27:48.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.907+0000 7f062ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f06300c59d0 0x7f06300c7020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44344/0 (socket says 172.21.15.12:44344) 2023-10-21T16:27:48.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.907+0000 7f062ffff640 1 -- 172.21.15.12:0/3574474486 learned_addr learned my addr 172.21.15.12:0/3574474486 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:48.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.907+0000 7fd19c0d7640 1 -- start start 2023-10-21T16:27:48.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1800039a0 0x7fd1940c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19414bd00 0x7fd1941537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19414dc50 con 0x7fd19414b8e0 2023-10-21T16:27:48.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941f5dd0 con 0x7fd1800039a0 2023-10-21T16:27:48.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.908+0000 7fd19c0d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941f2840 con 0x7fd19414bd00 2023-10-21T16:27:48.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.910+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724518239 0 0) 0x7f06300c23f0 con 0x7f06300c59d0 2023-10-21T16:27:48.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.910+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f061c003520 con 0x7f06300c59d0 2023-10-21T16:27:48.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.911+0000 7fd199672640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.913+0000 7fd199672640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47784/0 (socket says 172.21.15.12:47784) 2023-10-21T16:27:48.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.913+0000 7fd199672640 1 -- 172.21.15.12:0/1058578196 learned_addr learned my addr 172.21.15.12:0/1058578196 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:48.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14501296 0 0) 0x7f061c003520 con 0x7f06300c59d0 2023-10-21T16:27:48.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 msgr2=0x7f0630150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 0x7f0630150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 >> v2:172.21.15.99:3300/0 conn(0x7f06300c55f0 msgr2=0x7f0630157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 --2- 172.21.15.12:0/3574474486 >> v2:172.21.15.99:3300/0 conn(0x7f06300c55f0 0x7f0630157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063015add0 con 0x7f06300c59d0 2023-10-21T16:27:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f06280019f0 con 0x7f06300c59d0 2023-10-21T16:27:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 >> v1:172.21.15.12:6789/0 conn(0x7f06300c59d0 legacy=0x7f06300c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 0x7f061c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f061c004080 0x7f061c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f061c004d50 0x7f061c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630156fa0 con 0x7f061c004d50 2023-10-21T16:27:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063015aaf0 con 0x7f061c004080 2023-10-21T16:27:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.915+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c00bcd0 con 0x7f0630157cc0 2023-10-21T16:27:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.918+0000 7fd199672640 1 -- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19414bd00 msgr2=0x7fd1941537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.918+0000 7fd199672640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19414bd00 0x7fd1941537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.918+0000 7fd199672640 1 -- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1800039a0 msgr2=0x7fd1940c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.918+0000 7fd199672640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1800039a0 0x7fd1940c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.918+0000 7fd199672640 1 -- 172.21.15.12:0/1058578196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1941f2b00 con 0x7fd19414b8e0 2023-10-21T16:27:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.921+0000 7fd199672640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c7a0 tx=0x7fd18400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:48.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.925+0000 7f062ffff640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f061c004d50 0x7f061c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.926+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840074e0 con 0x7fd19414b8e0 2023-10-21T16:27:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.926+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184007640 con 0x7fd19414b8e0 2023-10-21T16:27:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.926+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184004a20 con 0x7fd19414b8e0 2023-10-21T16:27:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.926+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1941f2de0 con 0x7fd19414b8e0 2023-10-21T16:27:48.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.926+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1941f33a0 con 0x7fd19414b8e0 2023-10-21T16:27:48.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.927+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1941f5f90 con 0x7fd19414b8e0 2023-10-21T16:27:48.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.935+0000 7f062ffff640 1 -- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 msgr2=0x7f061c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.935+0000 7f062ffff640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0630157cc0 0x7f061c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.935+0000 7f062ffff640 1 -- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f061c004080 msgr2=0x7f061c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:48.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.935+0000 7f062ffff640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f061c004080 0x7f061c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:48.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.935+0000 7f062ffff640 1 -- 172.21.15.12:0/3574474486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063015add0 con 0x7f061c004d50 2023-10-21T16:27:48.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.994+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4604007020 con 0x7f46100cbe40 2023-10-21T16:27:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.996+0000 7f45f77fe640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 0x7f45fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.997+0000 7f460effd640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 0x7f45fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.997+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4604057e30 con 0x7f46100cbe40 2023-10-21T16:27:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:48.998+0000 7f460effd640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 0x7f45fc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4600009670 tx=0x7f4600006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.020+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4604054170 con 0x7f46100cbe40 2023-10-21T16:27:49.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.042+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2398003b20 con 0x7f23a40c7540 2023-10-21T16:27:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.044+0000 7f23a17fa640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 0x7f238806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.044+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2398088c80 con 0x7f23a40c7540 2023-10-21T16:27:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.044+0000 7f23a3fff640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 0x7f238806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.045+0000 7f23a3fff640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 0x7f238806d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23a415c620 tx=0x7f2390006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.054+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2398053f50 con 0x7f23a40c7540 2023-10-21T16:27:49.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.217+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46100619f0 con 0x7f46100cbe40 2023-10-21T16:27:49.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.217+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd184004b80 con 0x7fd19414b8e0 2023-10-21T16:27:49.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.218+0000 7fd18a7fc640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 0x7fd17806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.219+0000 7fd199e73640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 0x7fd17806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.220+0000 7fd199e73640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 0x7fd17806d3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd190033000 tx=0x7fd190005000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.221+0000 7f45f77fe640 1 -- 172.21.15.12:0/3421640251 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4604021070 con 0x7f46100cbe40 2023-10-21T16:27:49.223 INFO:teuthology.orchestra.run.smithi012.stdout:68719476749 2023-10-21T16:27:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 msgr2=0x7f45fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 0x7f45fc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4600009670 tx=0x7f4600006bf0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 msgr2=0x7f461014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f460400c440 tx=0x7f460400c900 comp rx=0 tx=0).stop 2023-10-21T16:27:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 shutdown_connections 2023-10-21T16:27:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f45fc06ae70 0x7f45fc06d330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4610153490 0x7f46101f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46100cbe40 0x7f461014a050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 --2- 172.21.15.12:0/3421640251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46100c97e0 0x7f46100c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 >> 172.21.15.12:0/3421640251 conn(0x7f46100716f0 msgr2=0x7f4610151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 shutdown_connections 2023-10-21T16:27:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.224+0000 7f46155e9640 1 -- 172.21.15.12:0/3421640251 wait complete. 2023-10-21T16:27:49.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.237+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd184004e30 con 0x7fd19414b8e0 2023-10-21T16:27:49.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.238+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd184054360 con 0x7fd19414b8e0 2023-10-21T16:27:49.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.241+0000 7f062ffff640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f061c004d50 0x7f061c0051d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f062800a8a0 tx=0x7f061c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aae3b947edbec19 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476749 got 68719476749 for osd.1 2023-10-21T16:27:49.244 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:49.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.276+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f23a40c8c30 con 0x7f23a40c7540 2023-10-21T16:27:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.278+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628034630 con 0x7f061c004d50 2023-10-21T16:27:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.278+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062802f070 con 0x7f061c004d50 2023-10-21T16:27:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.278+0000 7f062effd640 1 -- 172.21.15.12:0/3574474486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628034a10 con 0x7f061c004d50 2023-10-21T16:27:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 -- 172.21.15.12:0/3574474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f061c004d50 msgr2=0x7f061c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 --2- 172.21.15.12:0/3574474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f061c004d50 0x7f061c0051d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f062800a8a0 tx=0x7f061c0057f0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f062ffff640 1 -- 172.21.15.12:0/3574474486 reap_dead start 2023-10-21T16:27:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 -- 172.21.15.12:0/3574474486 shutdown_connections 2023-10-21T16:27:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 -- 172.21.15.12:0/3574474486 >> 172.21.15.12:0/3574474486 conn(0x7f0630069de0 msgr2=0x7f063006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 -- 172.21.15.12:0/3574474486 shutdown_connections 2023-10-21T16:27:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.279+0000 7f0635e15640 1 -- 172.21.15.12:0/3574474486 wait complete. 2023-10-21T16:27:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.281+0000 7f23a17fa640 1 -- 172.21.15.12:0/3062839201 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2398017070 con 0x7f23a40c7540 2023-10-21T16:27:49.283 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.282+0000 7f0635e15640 1 Processor -- start 2023-10-21T16:27:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.282+0000 7f0635e15640 1 -- start start 2023-10-21T16:27:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06301f1fa0 0x7f063006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 msgr2=0x7f238806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 0x7f238806d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23a415c620 tx=0x7f2390006bf0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 msgr2=0x7f23a414ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f239800c440 tx=0x7f239800c900 comp rx=0 tx=0).stop 2023-10-21T16:27:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0630070b40 0x7f0630070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301f2cc0 con 0x7f0630070b40 2023-10-21T16:27:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630071500 con 0x7f0630159f70 2023-10-21T16:27:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0635e15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063014e500 con 0x7f06301f1fa0 2023-10-21T16:27:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 shutdown_connections 2023-10-21T16:27:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f238806aec0 0x7f238806d380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a41535c0 0x7f23a40c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23a41531e0 0x7f23a415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 --2- 172.21.15.12:0/3062839201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23a40c7540 0x7f23a414ea50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 >> 172.21.15.12:0/3062839201 conn(0x7f23a406b0d0 msgr2=0x7f23a4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 shutdown_connections 2023-10-21T16:27:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f23ab094640 1 -- 172.21.15.12:0/3062839201 wait complete. 2023-10-21T16:27:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.284+0000 7f0627fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.285+0000 7f0627fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60858/0 (socket says 172.21.15.12:60858) 2023-10-21T16:27:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.285+0000 7f0627fff640 1 -- 172.21.15.12:0/2969365437 learned_addr learned my addr 172.21.15.12:0/2969365437 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.286+0000 7f062f7fe640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06301f1fa0 0x7f063006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.288+0000 7f0627fff640 1 -- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06301f1fa0 msgr2=0x7f063006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.288+0000 7f0627fff640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06301f1fa0 0x7f063006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.288+0000 7f0627fff640 1 -- 172.21.15.12:0/2969365437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0630070b40 msgr2=0x7f0630070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.288+0000 7f0627fff640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0630070b40 0x7f0630070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.288+0000 7f0627fff640 1 -- 172.21.15.12:0/2969365437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063014e7e0 con 0x7f0630159f70 2023-10-21T16:27:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.291+0000 7f0627fff640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f061800b450 tx=0x7f061800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.296+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011890 con 0x7f0630159f70 2023-10-21T16:27:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.296+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180119f0 con 0x7f0630159f70 2023-10-21T16:27:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.296+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063014eac0 con 0x7f0630159f70 2023-10-21T16:27:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.296+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011da0 con 0x7f0630159f70 2023-10-21T16:27:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.296+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063014f080 con 0x7f0630159f70 2023-10-21T16:27:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.298+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614005250 con 0x7f0630159f70 2023-10-21T16:27:49.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.4 2023-10-21T16:27:49.308 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:49.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-21T16:27:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.444+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd1940619f0 con 0x7fd19414b8e0 2023-10-21T16:27:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.453+0000 7fd18a7fc640 1 -- 172.21.15.12:0/1058578196 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd184018020 con 0x7fd19414b8e0 2023-10-21T16:27:49.455 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-10-21T16:27:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.455+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 msgr2=0x7fd17806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.455+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 0x7fd17806d3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd190033000 tx=0x7fd190005000 comp rx=0 tx=0).stop 2023-10-21T16:27:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.455+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 msgr2=0x7fd194153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.455+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c7a0 tx=0x7fd18400cc60 comp rx=0 tx=0).stop 2023-10-21T16:27:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 shutdown_connections 2023-10-21T16:27:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd17806aef0 0x7fd17806d3b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd19414bd00 0x7fd1941537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19414b8e0 0x7fd194153290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 --2- 172.21.15.12:0/1058578196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1800039a0 0x7fd1940c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 >> 172.21.15.12:0/1058578196 conn(0x7fd194069de0 msgr2=0x7fd194154210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 shutdown_connections 2023-10-21T16:27:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.456+0000 7fd19c0d7640 1 -- 172.21.15.12:0/1058578196 wait complete. 2023-10-21T16:27:49.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.5 2023-10-21T16:27:49.476 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.545+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0618023430 con 0x7f0630159f70 2023-10-21T16:27:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.546+0000 7f062cff9640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 0x7f061006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.547+0000 7f93d2533640 1 Processor -- start 2023-10-21T16:27:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.547+0000 7f93d2533640 1 -- start start 2023-10-21T16:27:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.547+0000 7f062f7fe640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 0x7f061006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f062f7fe640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 0x7f061006d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0620009920 tx=0x7f06200090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f93d2533640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93cc0c97e0 0x7f93cc15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f93d2533640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f93cc0cbe40 0x7f93cc159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f93d2533640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0cc250 con 0x7f93cc153490 2023-10-21T16:27:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f93d2533640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc153870 con 0x7f93cc0cbe40 2023-10-21T16:27:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.548+0000 7f93d2533640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc0cb0a0 con 0x7f93cc0c97e0 2023-10-21T16:27:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.549+0000 7f93cbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f93cc153490 0x7f93cc0ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44354/0 (socket says 172.21.15.12:44354) 2023-10-21T16:27:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.549+0000 7f93cbfff640 1 -- 172.21.15.12:0/1494899903 learned_addr learned my addr 172.21.15.12:0/1494899903 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:49.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-21T16:27:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.549+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/1494899903 >> v2:172.21.15.12:3300/0 conn(0x7f93cc0cbe40 0x7f93cc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.550+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0618058e10 con 0x7f0630159f70 2023-10-21T16:27:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.553+0000 7f93d0ad0640 1 -- 172.21.15.12:0/1494899903 >> v2:172.21.15.99:3300/0 conn(0x7f93cc0c97e0 msgr2=0x7f93cc15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.553+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/1494899903 >> v2:172.21.15.99:3300/0 conn(0x7f93cc0c97e0 0x7f93cc15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.553+0000 7f93d0ad0640 1 -- 172.21.15.12:0/1494899903 >> v1:172.21.15.12:6789/0 conn(0x7f93cc153490 legacy=0x7f93cc0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.553+0000 7f93d0ad0640 1 -- 172.21.15.12:0/1494899903 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc159cf0 con 0x7f93cc0cbe40 2023-10-21T16:27:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.558+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/1494899903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc159110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93cc06aa70 tx=0x7f93c402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef7f09193c70418 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.561+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0618054a50 con 0x7f0630159f70 2023-10-21T16:27:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.563+0000 7f93cb7fe640 1 -- 172.21.15.12:0/1494899903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c402cc70 con 0x7f93cc0cbe40 2023-10-21T16:27:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93cb7fe640 1 -- 172.21.15.12:0/1494899903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c402cdd0 con 0x7f93cc0cbe40 2023-10-21T16:27:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93cb7fe640 1 -- 172.21.15.12:0/1494899903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4034660 con 0x7f93cc0cbe40 2023-10-21T16:27:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 -- 172.21.15.12:0/1494899903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 msgr2=0x7f93cc159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 --2- 172.21.15.12:0/1494899903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc159110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93cc06aa70 tx=0x7f93c402bec0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 -- 172.21.15.12:0/1494899903 shutdown_connections 2023-10-21T16:27:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 --2- 172.21.15.12:0/1494899903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc159110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 --2- 172.21.15.12:0/1494899903 >> v2:172.21.15.99:3300/0 conn(0x7f93cc0c97e0 0x7f93cc15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.564+0000 7f93d2533640 1 -- 172.21.15.12:0/1494899903 >> 172.21.15.12:0/1494899903 conn(0x7f93cc0716f0 msgr2=0x7f93cc06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.565+0000 7f93d2533640 1 -- 172.21.15.12:0/1494899903 shutdown_connections 2023-10-21T16:27:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.565+0000 7f93d2533640 1 -- 172.21.15.12:0/1494899903 wait complete. 2023-10-21T16:27:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.567+0000 7f93d2533640 1 Processor -- start 2023-10-21T16:27:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.567+0000 7f93d2533640 1 -- start start 2023-10-21T16:27:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93cc0c97e0 0x7f93cc1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc1f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc150820 con 0x7f93cc0cbe40 2023-10-21T16:27:49.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c5390 con 0x7f93cc0c97e0 2023-10-21T16:27:49.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d2533640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c4e10 con 0x7f93cc153490 2023-10-21T16:27:49.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.568+0000 7f93d0ad0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.569+0000 7f93d0ad0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54200/0 (socket says 172.21.15.12:54200) 2023-10-21T16:27:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.569+0000 7f93d0ad0640 1 -- 172.21.15.12:0/2887137736 learned_addr learned my addr 172.21.15.12:0/2887137736 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.570+0000 7f93cbfff640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93cc0c97e0 0x7f93cc1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.571+0000 7f93c3fff640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc1f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.572+0000 7f93d0ad0640 1 -- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93cc0c97e0 msgr2=0x7f93cc1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.572+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93cc0c97e0 0x7f93cc1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.572+0000 7f93d0ad0640 1 -- 172.21.15.12:0/2887137736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 msgr2=0x7f93cc1f02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.572+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc1f02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.572+0000 7f93d0ad0640 1 -- 172.21.15.12:0/2887137736 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009a70 con 0x7f93cc153490 2023-10-21T16:27:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.575+0000 7f93d0ad0640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93c4037040 tx=0x7f93c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.579+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4040650 con 0x7f93cc153490 2023-10-21T16:27:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.579+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40407b0 con 0x7f93cc153490 2023-10-21T16:27:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.579+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4040b20 con 0x7f93cc153490 2023-10-21T16:27:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.579+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc152c70 con 0x7f93cc153490 2023-10-21T16:27:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.579+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc150260 con 0x7f93cc153490 2023-10-21T16:27:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.581+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0619f0 con 0x7f93cc153490 2023-10-21T16:27:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.734+0000 7f546bfff640 1 Processor -- start 2023-10-21T16:27:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.734+0000 7f546bfff640 1 -- start start 2023-10-21T16:27:49.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.736+0000 7f546bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.736+0000 7f546bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f546c0cbc30 0x7f546c1638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.736+0000 7f546bfff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c0716b0 con 0x7f546c153100 2023-10-21T16:27:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.736+0000 7f546bfff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0cc0a0 con 0x7f546c0cbc30 2023-10-21T16:27:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.736+0000 7f546bfff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c33d0 con 0x7f546c0c8b90 2023-10-21T16:27:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.737+0000 7f546affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f546c153100 0x7f546c069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:56068/0 (socket says 172.21.15.12:56068) 2023-10-21T16:27:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.737+0000 7f546affd640 1 -- 172.21.15.12:0/3748054509 learned_addr learned my addr 172.21.15.12:0/3748054509 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:49.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.737+0000 7f546b7fe640 1 --2- 172.21.15.12:0/3748054509 >> v2:172.21.15.12:3300/0 conn(0x7f546c0cbc30 0x7f546c1638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.741+0000 7f546b7fe640 1 -- 172.21.15.12:0/3748054509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 msgr2=0x7f546c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.741+0000 7f546b7fe640 1 --2- 172.21.15.12:0/3748054509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.741+0000 7f546b7fe640 1 -- 172.21.15.12:0/3748054509 >> v1:172.21.15.99:6789/0 conn(0x7f546c153100 legacy=0x7f546c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.741+0000 7f546b7fe640 1 -- 172.21.15.12:0/3748054509 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c159e40 con 0x7f546c0cbc30 2023-10-21T16:27:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.744+0000 7f546b7fe640 1 --2- 172.21.15.12:0/3748054509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c1638c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5464009d90 tx=0x7f546402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a386f7d355e31cc server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.748+0000 7f5469ffb640 1 -- 172.21.15.12:0/3748054509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546402cc50 con 0x7f546c0cbc30 2023-10-21T16:27:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.749+0000 7f5469ffb640 1 -- 172.21.15.12:0/3748054509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546402cdb0 con 0x7f546c0cbc30 2023-10-21T16:27:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.749+0000 7f5469ffb640 1 -- 172.21.15.12:0/3748054509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464034660 con 0x7f546c0cbc30 2023-10-21T16:27:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.749+0000 7f546bfff640 1 -- 172.21.15.12:0/3748054509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 msgr2=0x7f546c1638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.749+0000 7f546bfff640 1 --2- 172.21.15.12:0/3748054509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c1638c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5464009d90 tx=0x7f546402bea0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 -- 172.21.15.12:0/3748054509 shutdown_connections 2023-10-21T16:27:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 --2- 172.21.15.12:0/3748054509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c1638c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 --2- 172.21.15.12:0/3748054509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 -- 172.21.15.12:0/3748054509 >> 172.21.15.12:0/3748054509 conn(0x7f546c06e770 msgr2=0x7f546c06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 -- 172.21.15.12:0/3748054509 shutdown_connections 2023-10-21T16:27:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.750+0000 7f546bfff640 1 -- 172.21.15.12:0/3748054509 wait complete. 2023-10-21T16:27:49.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.753+0000 7f546bfff640 1 Processor -- start 2023-10-21T16:27:49.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.753+0000 7f546bfff640 1 -- start start 2023-10-21T16:27:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 0x7f546c148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c159630 con 0x7f546c0cbc30 2023-10-21T16:27:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c14cd30 con 0x7f546c153100 2023-10-21T16:27:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.754+0000 7f546bfff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c15a7f0 con 0x7f546c0c8b90 2023-10-21T16:27:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.755+0000 7f546b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 0x7f546c148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.755+0000 7f546a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.755+0000 7f546b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 0x7f546c148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60886/0 (socket says 172.21.15.12:60886) 2023-10-21T16:27:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.755+0000 7f546b7fe640 1 -- 172.21.15.12:0/3652405145 learned_addr learned my addr 172.21.15.12:0/3652405145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.759+0000 7f546a7fc640 1 -- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 msgr2=0x7f546c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.759+0000 7f546a7fc640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.759+0000 7f546a7fc640 1 -- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 msgr2=0x7f546c148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.759+0000 7f546a7fc640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 0x7f546c148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.759+0000 7f546a7fc640 1 -- 172.21.15.12:0/3652405145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009a70 con 0x7f546c0cbc30 2023-10-21T16:27:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.761+0000 7f546a7fc640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c14c7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f546000b410 tx=0x7f546000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.763+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06140057d0 con 0x7f0630159f70 2023-10-21T16:27:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.764+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460011830 con 0x7f546c0cbc30 2023-10-21T16:27:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.764+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c15a230 con 0x7f546c0cbc30 2023-10-21T16:27:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.764+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c14bd10 con 0x7f546c0cbc30 2023-10-21T16:27:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.765+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c0c2b00 con 0x7f546c0cbc30 2023-10-21T16:27:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.766+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5460009170 con 0x7f546c0cbc30 2023-10-21T16:27:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.766+0000 7f062cff9640 1 -- 172.21.15.12:0/2969365437 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0618015070 con 0x7f0630159f70 2023-10-21T16:27:49.768 INFO:teuthology.orchestra.run.smithi012.stdout:68719476750 2023-10-21T16:27:49.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 msgr2=0x7f061006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 0x7f061006d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0620009920 tx=0x7f06200090e0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 msgr2=0x7f06301f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f061800b450 tx=0x7f061800b910 comp rx=0 tx=0).stop 2023-10-21T16:27:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 shutdown_connections 2023-10-21T16:27:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f061006aef0 0x7f061006d3b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0630070b40 0x7f0630070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0630159f70 0x7f06301f2380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 --2- 172.21.15.12:0/2969365437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06301f1fa0 0x7f063006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 >> 172.21.15.12:0/2969365437 conn(0x7f0630069de0 msgr2=0x7f063006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 shutdown_connections 2023-10-21T16:27:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.768+0000 7f0635e15640 1 -- 172.21.15.12:0/2969365437 wait complete. 2023-10-21T16:27:49.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476750 got 68719476750 for osd.0 2023-10-21T16:27:49.788 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:49.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.786+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460011bb0 con 0x7f546c0cbc30 2023-10-21T16:27:49.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.788+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f546001a400 con 0x7f546c0cbc30 2023-10-21T16:27:49.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.789+0000 7f54537fe640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 0x7f545806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.789+0000 7f546affd640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 0x7f545806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.790+0000 7f546affd640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 0x7f545806d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f545c0015f0 tx=0x7f545c007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.792+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54600590f0 con 0x7f546c0cbc30 2023-10-21T16:27:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.827+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93c4040c80 con 0x7f93cc153490 2023-10-21T16:27:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.829+0000 7f93c97fa640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 0x7f93ac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.830+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93c40ac700 con 0x7f93cc153490 2023-10-21T16:27:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.830+0000 7f93cbfff640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 0x7f93ac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.830+0000 7f93cbfff640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 0x7f93ac06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93bc005880 tx=0x7f93bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:49.839+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93c4077890 con 0x7f93cc153490 2023-10-21T16:27:50.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.047+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93cc0cab00 con 0x7f93cc153490 2023-10-21T16:27:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.050+0000 7f93c97fa640 1 -- 172.21.15.12:0/2887137736 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c407aeb0 con 0x7f93cc153490 2023-10-21T16:27:50.052 INFO:teuthology.orchestra.run.smithi012.stdout:60129542156 2023-10-21T16:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 msgr2=0x7f93ac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 0x7f93ac06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93bc005880 tx=0x7f93bc009040 comp rx=0 tx=0).stop 2023-10-21T16:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 msgr2=0x7f93cc1f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93c4037040 tx=0x7f93c4004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 shutdown_connections 2023-10-21T16:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f93ac06aec0 0x7f93ac06d380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93cc153490 0x7f93cc1f0810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93cc0cbe40 0x7f93cc1f02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 --2- 172.21.15.12:0/2887137736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93cc0c97e0 0x7f93cc1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 >> 172.21.15.12:0/2887137736 conn(0x7f93cc0716f0 msgr2=0x7f93cc15b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 shutdown_connections 2023-10-21T16:27:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.053+0000 7f93d2533640 1 -- 172.21.15.12:0/2887137736 wait complete. 2023-10-21T16:27:50.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.7 2023-10-21T16:27:50.077 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:50.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.090+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5460054d30 con 0x7f546c0cbc30 2023-10-21T16:27:50.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.305+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f546c067560 con 0x7f546c0cbc30 2023-10-21T16:27:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.465+0000 7f54537fe640 1 -- 172.21.15.12:0/3652405145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5460058350 con 0x7f546c0cbc30 2023-10-21T16:27:50.468 INFO:teuthology.orchestra.run.smithi012.stdout:68719476748 2023-10-21T16:27:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.468+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 msgr2=0x7f545806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.468+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 0x7f545806d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f545c0015f0 tx=0x7f545c007a40 comp rx=0 tx=0).stop 2023-10-21T16:27:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.468+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 msgr2=0x7f546c14c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.468+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c14c7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f546000b410 tx=0x7f546000b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 shutdown_connections 2023-10-21T16:27:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f545806ae70 0x7f545806d330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f546c153100 0x7f546c148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f546c0cbc30 0x7f546c14c7f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 --2- 172.21.15.12:0/3652405145 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f546c0c8b90 0x7f546c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 >> 172.21.15.12:0/3652405145 conn(0x7f546c06e770 msgr2=0x7f546c0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 shutdown_connections 2023-10-21T16:27:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.469+0000 7f546bfff640 1 -- 172.21.15.12:0/3652405145 wait complete. 2023-10-21T16:27:50.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.3 2023-10-21T16:27:50.493 DEBUG:teuthology.parallel:result is None 2023-10-21T16:27:50.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-21T16:27:50.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T16:27:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.769+0000 7f264341c640 1 Processor -- start 2023-10-21T16:27:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.769+0000 7f264341c640 1 -- start start 2023-10-21T16:27:50.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f263c0c55f0 0x7f263c157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f263c157cc0 0x7f263c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0c23f0 con 0x7f263c0c55f0 2023-10-21T16:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c156fa0 con 0x7f263c157cc0 2023-10-21T16:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.771+0000 7f264341c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c15aaf0 con 0x7f263c0c59d0 2023-10-21T16:27:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.772+0000 7f26419b9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.772+0000 7f26409b7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f263c157cc0 0x7f263c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.772+0000 7f26419b9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54234/0 (socket says 172.21.15.12:54234) 2023-10-21T16:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.772+0000 7f26419b9640 1 -- 172.21.15.12:0/2448743287 learned_addr learned my addr 172.21.15.12:0/2448743287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.774+0000 7f26419b9640 1 -- 172.21.15.12:0/2448743287 >> v2:172.21.15.99:3300/0 conn(0x7f263c157cc0 msgr2=0x7f263c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.774+0000 7f26419b9640 1 --2- 172.21.15.12:0/2448743287 >> v2:172.21.15.99:3300/0 conn(0x7f263c157cc0 0x7f263c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.774+0000 7f26419b9640 1 -- 172.21.15.12:0/2448743287 >> v2:172.21.15.12:3300/0 conn(0x7f263c0c55f0 msgr2=0x7f263c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.774+0000 7f26419b9640 1 --2- 172.21.15.12:0/2448743287 >> v2:172.21.15.12:3300/0 conn(0x7f263c0c55f0 0x7f263c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.774+0000 7f26419b9640 1 -- 172.21.15.12:0/2448743287 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c15add0 con 0x7f263c0c59d0 2023-10-21T16:27:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.777+0000 7f26419b9640 1 --2- 172.21.15.12:0/2448743287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f263c0c7dc0 tx=0x7f263402b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c53e46d4e24291bc server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:50.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.780+0000 7f2633fff640 1 -- 172.21.15.12:0/2448743287 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634030850 con 0x7f263c0c59d0 2023-10-21T16:27:50.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.780+0000 7f2633fff640 1 -- 172.21.15.12:0/2448743287 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26340309b0 con 0x7f263c0c59d0 2023-10-21T16:27:50.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.780+0000 7f2633fff640 1 -- 172.21.15.12:0/2448743287 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634030d40 con 0x7f263c0c59d0 2023-10-21T16:27:50.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 -- 172.21.15.12:0/2448743287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 msgr2=0x7f263c151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 --2- 172.21.15.12:0/2448743287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f263c0c7dc0 tx=0x7f263402b990 comp rx=0 tx=0).stop 2023-10-21T16:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 -- 172.21.15.12:0/2448743287 shutdown_connections 2023-10-21T16:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 --2- 172.21.15.12:0/2448743287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c0c59d0 0x7f263c151320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 --2- 172.21.15.12:0/2448743287 >> v2:172.21.15.99:3300/0 conn(0x7f263c157cc0 0x7f263c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 --2- 172.21.15.12:0/2448743287 >> v2:172.21.15.12:3300/0 conn(0x7f263c0c55f0 0x7f263c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.781+0000 7f264341c640 1 -- 172.21.15.12:0/2448743287 >> 172.21.15.12:0/2448743287 conn(0x7f263c069de0 msgr2=0x7f263c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.782+0000 7f264341c640 1 -- 172.21.15.12:0/2448743287 shutdown_connections 2023-10-21T16:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.782+0000 7f264341c640 1 -- 172.21.15.12:0/2448743287 wait complete. 2023-10-21T16:27:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.785+0000 7f264341c640 1 Processor -- start 2023-10-21T16:27:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.785+0000 7f264341c640 1 -- start start 2023-10-21T16:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c0c59d0 0x7f263c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c157cc0 0x7f263c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c159390 con 0x7f263c0c59d0 2023-10-21T16:27:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c158160 con 0x7f263c0c55f0 2023-10-21T16:27:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.786+0000 7f264341c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1583b0 con 0x7f263c157cc0 2023-10-21T16:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.787+0000 7f26411b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.787+0000 7f26419b9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c157cc0 0x7f263c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.787+0000 7f26411b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60908/0 (socket says 172.21.15.12:60908) 2023-10-21T16:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.787+0000 7f26411b8640 1 -- 172.21.15.12:0/26800366 learned_addr learned my addr 172.21.15.12:0/26800366 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.788+0000 7f26409b7640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c0c59d0 0x7f263c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.791+0000 7f26411b8640 1 -- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c157cc0 msgr2=0x7f263c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.791+0000 7f26411b8640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c157cc0 0x7f263c14fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.791+0000 7f26411b8640 1 -- 172.21.15.12:0/26800366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c0c59d0 msgr2=0x7f263c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.791+0000 7f26411b8640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c0c59d0 0x7f263c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.791+0000 7f26411b8640 1 -- 172.21.15.12:0/26800366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340094d0 con 0x7f263c0c55f0 2023-10-21T16:27:50.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.793+0000 7f26411b8640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f263800ba50 tx=0x7f263800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.796+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800cbe0 con 0x7f263c0c55f0 2023-10-21T16:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.796+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800cd60 con 0x7f263c0c55f0 2023-10-21T16:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.796+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638014680 con 0x7f263c0c55f0 2023-10-21T16:27:50.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.797+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c158690 con 0x7f263c0c55f0 2023-10-21T16:27:50.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.797+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c1eaab0 con 0x7f263c0c55f0 2023-10-21T16:27:50.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.798+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c1ea630 con 0x7f263c0c55f0 2023-10-21T16:27:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.817+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2638007370 con 0x7f263c0c55f0 2023-10-21T16:27:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.818+0000 7f2631ffb640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 0x7f262006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.819+0000 7f26409b7640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 0x7f262006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:50.820+0000 7f26409b7640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 0x7f262006d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f263c155d40 tx=0x7f262c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:51.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.041+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2638058640 con 0x7f263c0c55f0 2023-10-21T16:27:51.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.064+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2638054980 con 0x7f263c0c55f0 2023-10-21T16:27:51.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.273+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f263c15b0b0 con 0x7f262006aec0 2023-10-21T16:27:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.282+0000 7f2631ffb640 1 -- 172.21.15.12:0/26800366 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264444 (secure 0 0 0) 0x7f262c011a30 con 0x7f262006aec0 2023-10-21T16:27:51.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T16:27:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 msgr2=0x7f262006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 0x7f262006d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f263c155d40 tx=0x7f262c009190 comp rx=0 tx=0).stop 2023-10-21T16:27:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 msgr2=0x7f263c1eafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f263800ba50 tx=0x7f263800bf10 comp rx=0 tx=0).stop 2023-10-21T16:27:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 shutdown_connections 2023-10-21T16:27:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f262006aec0 0x7f262006d380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f263c157cc0 0x7f263c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c0c59d0 0x7f263c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 --2- 172.21.15.12:0/26800366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263c0c55f0 0x7f263c1eafd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 >> 172.21.15.12:0/26800366 conn(0x7f263c069de0 msgr2=0x7f263c1554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 shutdown_connections 2023-10-21T16:27:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.289+0000 7f264341c640 1 -- 172.21.15.12:0/26800366 wait complete. 2023-10-21T16:27:51.314 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-10-21T16:27:51.260181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219172,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755548,"statfs":{"total":773094113280,"available":772869681152,"internally_reserved":0,"allocated":3088384,"data_stored":1823884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002511"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096955+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T16:27:34.096955+0000","last_peered":"2023-10-21T16:27:34.096955+0000","last_clean":"2023-10-21T16:27:34.096955+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T16:27:34.096955+0000","last_undegraded":"2023-10-21T16:27:34.096955+0000","last_fullsized":"2023-10-21T16:27:34.096955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220196+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T16:27:34.220196+0000","last_peered":"2023-10-21T16:27:34.220196+0000","last_clean":"2023-10-21T16:27:34.220196+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T16:27:34.220196+0000","last_undegraded":"2023-10-21T16:27:34.220196+0000","last_fullsized":"2023-10-21T16:27:34.220196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220057+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T16:27:34.220057+0000","last_peered":"2023-10-21T16:27:34.220057+0000","last_clean":"2023-10-21T16:27:34.220057+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T16:27:34.220057+0000","last_undegraded":"2023-10-21T16:27:34.220057+0000","last_fullsized":"2023-10-21T16:27:34.220057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967774+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T16:27:32.967774+0000","last_peered":"2023-10-21T16:27:32.967774+0000","last_clean":"2023-10-21T16:27:32.967774+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T16:27:32.967774+0000","last_undegraded":"2023-10-21T16:27:32.967774+0000","last_fullsized":"2023-10-21T16:27:32.967774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096319+0000","last_change":"2023-10-21T16:27:31.926876+0000","last_active":"2023-10-21T16:27:34.096319+0000","last_peered":"2023-10-21T16:27:34.096319+0000","last_clean":"2023-10-21T16:27:34.096319+0000","last_became_active":"2023-10-21T16:27:31.924739+0000","last_became_peered":"2023-10-21T16:27:31.924739+0000","last_unstale":"2023-10-21T16:27:34.096319+0000","last_undegraded":"2023-10-21T16:27:34.096319+0000","last_fullsized":"2023-10-21T16:27:34.096319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967014+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T16:27:32.967014+0000","last_peered":"2023-10-21T16:27:32.967014+0000","last_clean":"2023-10-21T16:27:32.967014+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T16:27:32.967014+0000","last_undegraded":"2023-10-21T16:27:32.967014+0000","last_fullsized":"2023-10-21T16:27:32.967014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095632+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T16:27:34.095632+0000","last_peered":"2023-10-21T16:27:34.095632+0000","last_clean":"2023-10-21T16:27:34.095632+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T16:27:34.095632+0000","last_undegraded":"2023-10-21T16:27:34.095632+0000","last_fullsized":"2023-10-21T16:27:34.095632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219959+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T16:27:34.219959+0000","last_peered":"2023-10-21T16:27:34.219959+0000","last_clean":"2023-10-21T16:27:34.219959+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T16:27:34.219959+0000","last_undegraded":"2023-10-21T16:27:34.219959+0000","last_fullsized":"2023-10-21T16:27:34.219959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.444446+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T16:27:33.444446+0000","last_peered":"2023-10-21T16:27:33.444446+0000","last_clean":"2023-10-21T16:27:33.444446+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T16:27:33.444446+0000","last_undegraded":"2023-10-21T16:27:33.444446+0000","last_fullsized":"2023-10-21T16:27:33.444446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096902+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T16:27:34.096902+0000","last_peered":"2023-10-21T16:27:34.096902+0000","last_clean":"2023-10-21T16:27:34.096902+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T16:27:34.096902+0000","last_undegraded":"2023-10-21T16:27:34.096902+0000","last_fullsized":"2023-10-21T16:27:34.096902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096870+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T16:27:34.096870+0000","last_peered":"2023-10-21T16:27:34.096870+0000","last_clean":"2023-10-21T16:27:34.096870+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T16:27:34.096870+0000","last_undegraded":"2023-10-21T16:27:34.096870+0000","last_fullsized":"2023-10-21T16:27:34.096870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095803+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T16:27:34.095803+0000","last_peered":"2023-10-21T16:27:34.095803+0000","last_clean":"2023-10-21T16:27:34.095803+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T16:27:34.095803+0000","last_undegraded":"2023-10-21T16:27:34.095803+0000","last_fullsized":"2023-10-21T16:27:34.095803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251595+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T16:27:34.251595+0000","last_peered":"2023-10-21T16:27:34.251595+0000","last_clean":"2023-10-21T16:27:34.251595+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T16:27:34.251595+0000","last_undegraded":"2023-10-21T16:27:34.251595+0000","last_fullsized":"2023-10-21T16:27:34.251595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251551+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T16:27:34.251551+0000","last_peered":"2023-10-21T16:27:34.251551+0000","last_clean":"2023-10-21T16:27:34.251551+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T16:27:34.251551+0000","last_undegraded":"2023-10-21T16:27:34.251551+0000","last_fullsized":"2023-10-21T16:27:34.251551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219911+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T16:27:34.219911+0000","last_peered":"2023-10-21T16:27:34.219911+0000","last_clean":"2023-10-21T16:27:34.219911+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T16:27:34.219911+0000","last_undegraded":"2023-10-21T16:27:34.219911+0000","last_fullsized":"2023-10-21T16:27:34.219911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963543+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T16:27:32.963543+0000","last_peered":"2023-10-21T16:27:32.963543+0000","last_clean":"2023-10-21T16:27:32.963543+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T16:27:32.963543+0000","last_undegraded":"2023-10-21T16:27:32.963543+0000","last_fullsized":"2023-10-21T16:27:32.963543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964833+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T16:27:32.964833+0000","last_peered":"2023-10-21T16:27:32.964833+0000","last_clean":"2023-10-21T16:27:32.964833+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T16:27:32.964833+0000","last_undegraded":"2023-10-21T16:27:32.964833+0000","last_fullsized":"2023-10-21T16:27:32.964833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089146+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T16:27:34.089146+0000","last_peered":"2023-10-21T16:27:34.089146+0000","last_clean":"2023-10-21T16:27:34.089146+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T16:27:34.089146+0000","last_undegraded":"2023-10-21T16:27:34.089146+0000","last_fullsized":"2023-10-21T16:27:34.089146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964685+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T16:27:32.964685+0000","last_peered":"2023-10-21T16:27:32.964685+0000","last_clean":"2023-10-21T16:27:32.964685+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T16:27:32.964685+0000","last_undegraded":"2023-10-21T16:27:32.964685+0000","last_fullsized":"2023-10-21T16:27:32.964685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095995+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T16:27:34.095995+0000","last_peered":"2023-10-21T16:27:34.095995+0000","last_clean":"2023-10-21T16:27:34.095995+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T16:27:34.095995+0000","last_undegraded":"2023-10-21T16:27:34.095995+0000","last_fullsized":"2023-10-21T16:27:34.095995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051716+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T16:27:34.051716+0000","last_peered":"2023-10-21T16:27:34.051716+0000","last_clean":"2023-10-21T16:27:34.051716+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T16:27:34.051716+0000","last_undegraded":"2023-10-21T16:27:34.051716+0000","last_fullsized":"2023-10-21T16:27:34.051716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443049+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T16:27:33.443049+0000","last_peered":"2023-10-21T16:27:33.443049+0000","last_clean":"2023-10-21T16:27:33.443049+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T16:27:33.443049+0000","last_undegraded":"2023-10-21T16:27:33.443049+0000","last_fullsized":"2023-10-21T16:27:33.443049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220071+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T16:27:34.220071+0000","last_peered":"2023-10-21T16:27:34.220071+0000","last_clean":"2023-10-21T16:27:34.220071+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T16:27:34.220071+0000","last_undegraded":"2023-10-21T16:27:34.220071+0000","last_fullsized":"2023-10-21T16:27:34.220071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963620+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T16:27:32.963620+0000","last_peered":"2023-10-21T16:27:32.963620+0000","last_clean":"2023-10-21T16:27:32.963620+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T16:27:32.963620+0000","last_undegraded":"2023-10-21T16:27:32.963620+0000","last_fullsized":"2023-10-21T16:27:32.963620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220273+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T16:27:34.220273+0000","last_peered":"2023-10-21T16:27:34.220273+0000","last_clean":"2023-10-21T16:27:34.220273+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T16:27:34.220273+0000","last_undegraded":"2023-10-21T16:27:34.220273+0000","last_fullsized":"2023-10-21T16:27:34.220273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968086+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T16:27:32.968086+0000","last_peered":"2023-10-21T16:27:32.968086+0000","last_clean":"2023-10-21T16:27:32.968086+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T16:27:32.968086+0000","last_undegraded":"2023-10-21T16:27:32.968086+0000","last_fullsized":"2023-10-21T16:27:32.968086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251803+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T16:27:34.251803+0000","last_peered":"2023-10-21T16:27:34.251803+0000","last_clean":"2023-10-21T16:27:34.251803+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T16:27:34.251803+0000","last_undegraded":"2023-10-21T16:27:34.251803+0000","last_fullsized":"2023-10-21T16:27:34.251803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251649+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T16:27:34.251649+0000","last_peered":"2023-10-21T16:27:34.251649+0000","last_clean":"2023-10-21T16:27:34.251649+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T16:27:34.251649+0000","last_undegraded":"2023-10-21T16:27:34.251649+0000","last_fullsized":"2023-10-21T16:27:34.251649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220059+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T16:27:34.220059+0000","last_peered":"2023-10-21T16:27:34.220059+0000","last_clean":"2023-10-21T16:27:34.220059+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T16:27:34.220059+0000","last_undegraded":"2023-10-21T16:27:34.220059+0000","last_fullsized":"2023-10-21T16:27:34.220059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963880+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T16:27:32.963880+0000","last_peered":"2023-10-21T16:27:32.963880+0000","last_clean":"2023-10-21T16:27:32.963880+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T16:27:32.963880+0000","last_undegraded":"2023-10-21T16:27:32.963880+0000","last_fullsized":"2023-10-21T16:27:32.963880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.088942+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T16:27:34.088942+0000","last_peered":"2023-10-21T16:27:34.088942+0000","last_clean":"2023-10-21T16:27:34.088942+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T16:27:34.088942+0000","last_undegraded":"2023-10-21T16:27:34.088942+0000","last_fullsized":"2023-10-21T16:27:34.088942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966760+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T16:27:32.966760+0000","last_peered":"2023-10-21T16:27:32.966760+0000","last_clean":"2023-10-21T16:27:32.966760+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T16:27:32.966760+0000","last_undegraded":"2023-10-21T16:27:32.966760+0000","last_fullsized":"2023-10-21T16:27:32.966760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443231+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T16:27:33.443231+0000","last_peered":"2023-10-21T16:27:33.443231+0000","last_clean":"2023-10-21T16:27:33.443231+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T16:27:33.443231+0000","last_undegraded":"2023-10-21T16:27:33.443231+0000","last_fullsized":"2023-10-21T16:27:33.443231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220184+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T16:27:34.220184+0000","last_peered":"2023-10-21T16:27:34.220184+0000","last_clean":"2023-10-21T16:27:34.220184+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T16:27:34.220184+0000","last_undegraded":"2023-10-21T16:27:34.220184+0000","last_fullsized":"2023-10-21T16:27:34.220184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051700+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T16:27:34.051700+0000","last_peered":"2023-10-21T16:27:34.051700+0000","last_clean":"2023-10-21T16:27:34.051700+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T16:27:34.051700+0000","last_undegraded":"2023-10-21T16:27:34.051700+0000","last_fullsized":"2023-10-21T16:27:34.051700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964000+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T16:27:32.964000+0000","last_peered":"2023-10-21T16:27:32.964000+0000","last_clean":"2023-10-21T16:27:32.964000+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T16:27:32.964000+0000","last_undegraded":"2023-10-21T16:27:32.964000+0000","last_fullsized":"2023-10-21T16:27:32.964000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385858+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T16:27:32.385858+0000","last_peered":"2023-10-21T16:27:32.385858+0000","last_clean":"2023-10-21T16:27:32.385858+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T16:27:32.385858+0000","last_undegraded":"2023-10-21T16:27:32.385858+0000","last_fullsized":"2023-10-21T16:27:32.385858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220101+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T16:27:34.220101+0000","last_peered":"2023-10-21T16:27:34.220101+0000","last_clean":"2023-10-21T16:27:34.220101+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T16:27:34.220101+0000","last_undegraded":"2023-10-21T16:27:34.220101+0000","last_fullsized":"2023-10-21T16:27:34.220101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895978+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T16:27:31.895978+0000","last_peered":"2023-10-21T16:27:31.895978+0000","last_clean":"2023-10-21T16:27:31.895978+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T16:27:31.895978+0000","last_undegraded":"2023-10-21T16:27:31.895978+0000","last_fullsized":"2023-10-21T16:27:31.895978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051556+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T16:27:34.051556+0000","last_peered":"2023-10-21T16:27:34.051556+0000","last_clean":"2023-10-21T16:27:34.051556+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T16:27:34.051556+0000","last_undegraded":"2023-10-21T16:27:34.051556+0000","last_fullsized":"2023-10-21T16:27:34.051556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.917463+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T16:27:31.917463+0000","last_peered":"2023-10-21T16:27:31.917463+0000","last_clean":"2023-10-21T16:27:31.917463+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T16:27:31.917463+0000","last_undegraded":"2023-10-21T16:27:31.917463+0000","last_fullsized":"2023-10-21T16:27:31.917463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968166+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T16:27:32.968166+0000","last_peered":"2023-10-21T16:27:32.968166+0000","last_clean":"2023-10-21T16:27:32.968166+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T16:27:32.968166+0000","last_undegraded":"2023-10-21T16:27:32.968166+0000","last_fullsized":"2023-10-21T16:27:32.968166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.927903+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T16:27:31.927903+0000","last_peered":"2023-10-21T16:27:31.927903+0000","last_clean":"2023-10-21T16:27:31.927903+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T16:27:31.927903+0000","last_undegraded":"2023-10-21T16:27:31.927903+0000","last_fullsized":"2023-10-21T16:27:31.927903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220385+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T16:27:34.220385+0000","last_peered":"2023-10-21T16:27:34.220385+0000","last_clean":"2023-10-21T16:27:34.220385+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T16:27:34.220385+0000","last_undegraded":"2023-10-21T16:27:34.220385+0000","last_fullsized":"2023-10-21T16:27:34.220385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.091178+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T16:27:34.091178+0000","last_peered":"2023-10-21T16:27:34.091178+0000","last_clean":"2023-10-21T16:27:34.091178+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T16:27:34.091178+0000","last_undegraded":"2023-10-21T16:27:34.091178+0000","last_fullsized":"2023-10-21T16:27:34.091178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963901+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T16:27:32.963901+0000","last_peered":"2023-10-21T16:27:32.963901+0000","last_clean":"2023-10-21T16:27:32.963901+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T16:27:32.963901+0000","last_undegraded":"2023-10-21T16:27:32.963901+0000","last_fullsized":"2023-10-21T16:27:32.963901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.056343+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T16:27:34.056343+0000","last_peered":"2023-10-21T16:27:34.056343+0000","last_clean":"2023-10-21T16:27:34.056343+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T16:27:34.056343+0000","last_undegraded":"2023-10-21T16:27:34.056343+0000","last_fullsized":"2023-10-21T16:27:34.056343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096915+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T16:27:34.096915+0000","last_peered":"2023-10-21T16:27:34.096915+0000","last_clean":"2023-10-21T16:27:34.096915+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T16:27:34.096915+0000","last_undegraded":"2023-10-21T16:27:34.096915+0000","last_fullsized":"2023-10-21T16:27:34.096915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.092667+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T16:27:34.092667+0000","last_peered":"2023-10-21T16:27:34.092667+0000","last_clean":"2023-10-21T16:27:34.092667+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T16:27:34.092667+0000","last_undegraded":"2023-10-21T16:27:34.092667+0000","last_fullsized":"2023-10-21T16:27:34.092667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251614+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T16:27:34.251614+0000","last_peered":"2023-10-21T16:27:34.251614+0000","last_clean":"2023-10-21T16:27:34.251614+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T16:27:34.251614+0000","last_undegraded":"2023-10-21T16:27:34.251614+0000","last_fullsized":"2023-10-21T16:27:34.251614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903139+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T16:27:31.903139+0000","last_peered":"2023-10-21T16:27:31.903139+0000","last_clean":"2023-10-21T16:27:31.903139+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T16:27:31.903139+0000","last_undegraded":"2023-10-21T16:27:31.903139+0000","last_fullsized":"2023-10-21T16:27:31.903139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964065+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T16:27:32.964065+0000","last_peered":"2023-10-21T16:27:32.964065+0000","last_clean":"2023-10-21T16:27:32.964065+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T16:27:32.964065+0000","last_undegraded":"2023-10-21T16:27:32.964065+0000","last_fullsized":"2023-10-21T16:27:32.964065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924836+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T16:27:31.924836+0000","last_peered":"2023-10-21T16:27:31.924836+0000","last_clean":"2023-10-21T16:27:31.924836+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T16:27:31.924836+0000","last_undegraded":"2023-10-21T16:27:31.924836+0000","last_fullsized":"2023-10-21T16:27:31.924836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.442637+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T16:27:33.442637+0000","last_peered":"2023-10-21T16:27:33.442637+0000","last_clean":"2023-10-21T16:27:33.442637+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T16:27:33.442637+0000","last_undegraded":"2023-10-21T16:27:33.442637+0000","last_fullsized":"2023-10-21T16:27:33.442637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.236938+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T16:27:34.236938+0000","last_peered":"2023-10-21T16:27:34.236938+0000","last_clean":"2023-10-21T16:27:34.236938+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T16:27:34.236938+0000","last_undegraded":"2023-10-21T16:27:34.236938+0000","last_fullsized":"2023-10-21T16:27:34.236938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963557+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T16:27:32.963557+0000","last_peered":"2023-10-21T16:27:32.963557+0000","last_clean":"2023-10-21T16:27:32.963557+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T16:27:32.963557+0000","last_undegraded":"2023-10-21T16:27:32.963557+0000","last_fullsized":"2023-10-21T16:27:32.963557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097335+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T16:27:34.097335+0000","last_peered":"2023-10-21T16:27:34.097335+0000","last_clean":"2023-10-21T16:27:34.097335+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T16:27:34.097335+0000","last_undegraded":"2023-10-21T16:27:34.097335+0000","last_fullsized":"2023-10-21T16:27:34.097335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968239+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T16:27:32.968239+0000","last_peered":"2023-10-21T16:27:32.968239+0000","last_clean":"2023-10-21T16:27:32.968239+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T16:27:32.968239+0000","last_undegraded":"2023-10-21T16:27:32.968239+0000","last_fullsized":"2023-10-21T16:27:32.968239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.226690+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T16:27:34.226690+0000","last_peered":"2023-10-21T16:27:34.226690+0000","last_clean":"2023-10-21T16:27:34.226690+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T16:27:34.226690+0000","last_undegraded":"2023-10-21T16:27:34.226690+0000","last_fullsized":"2023-10-21T16:27:34.226690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097096+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T16:27:34.097096+0000","last_peered":"2023-10-21T16:27:34.097096+0000","last_clean":"2023-10-21T16:27:34.097096+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T16:27:34.097096+0000","last_undegraded":"2023-10-21T16:27:34.097096+0000","last_fullsized":"2023-10-21T16:27:34.097096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220126+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T16:27:34.220126+0000","last_peered":"2023-10-21T16:27:34.220126+0000","last_clean":"2023-10-21T16:27:34.220126+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T16:27:34.220126+0000","last_undegraded":"2023-10-21T16:27:34.220126+0000","last_fullsized":"2023-10-21T16:27:34.220126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095946+0000","last_change":"2023-10-21T16:27:31.930741+0000","last_active":"2023-10-21T16:27:34.095946+0000","last_peered":"2023-10-21T16:27:34.095946+0000","last_clean":"2023-10-21T16:27:34.095946+0000","last_became_active":"2023-10-21T16:27:31.928572+0000","last_became_peered":"2023-10-21T16:27:31.928572+0000","last_unstale":"2023-10-21T16:27:34.095946+0000","last_undegraded":"2023-10-21T16:27:34.095946+0000","last_fullsized":"2023-10-21T16:27:34.095946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385988+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T16:27:32.385988+0000","last_peered":"2023-10-21T16:27:32.385988+0000","last_clean":"2023-10-21T16:27:32.385988+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T16:27:32.385988+0000","last_undegraded":"2023-10-21T16:27:32.385988+0000","last_fullsized":"2023-10-21T16:27:32.385988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964475+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T16:27:32.964475+0000","last_peered":"2023-10-21T16:27:32.964475+0000","last_clean":"2023-10-21T16:27:32.964475+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T16:27:32.964475+0000","last_undegraded":"2023-10-21T16:27:32.964475+0000","last_fullsized":"2023-10-21T16:27:32.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.914486+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T16:27:31.914486+0000","last_peered":"2023-10-21T16:27:31.914486+0000","last_clean":"2023-10-21T16:27:31.914486+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T16:27:31.914486+0000","last_undegraded":"2023-10-21T16:27:31.914486+0000","last_fullsized":"2023-10-21T16:27:31.914486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902068+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T16:27:31.902068+0000","last_peered":"2023-10-21T16:27:31.902068+0000","last_clean":"2023-10-21T16:27:31.902068+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T16:27:31.902068+0000","last_undegraded":"2023-10-21T16:27:31.902068+0000","last_fullsized":"2023-10-21T16:27:31.902068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051553+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T16:27:34.051553+0000","last_peered":"2023-10-21T16:27:34.051553+0000","last_clean":"2023-10-21T16:27:34.051553+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T16:27:34.051553+0000","last_undegraded":"2023-10-21T16:27:34.051553+0000","last_fullsized":"2023-10-21T16:27:34.051553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.896424+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T16:27:31.896424+0000","last_peered":"2023-10-21T16:27:31.896424+0000","last_clean":"2023-10-21T16:27:31.896424+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T16:27:31.896424+0000","last_undegraded":"2023-10-21T16:27:31.896424+0000","last_fullsized":"2023-10-21T16:27:31.896424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251499+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T16:27:34.251499+0000","last_peered":"2023-10-21T16:27:34.251499+0000","last_clean":"2023-10-21T16:27:34.251499+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T16:27:34.251499+0000","last_undegraded":"2023-10-21T16:27:34.251499+0000","last_fullsized":"2023-10-21T16:27:34.251499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895353+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T16:27:31.895353+0000","last_peered":"2023-10-21T16:27:31.895353+0000","last_clean":"2023-10-21T16:27:31.895353+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T16:27:31.895353+0000","last_undegraded":"2023-10-21T16:27:31.895353+0000","last_fullsized":"2023-10-21T16:27:31.895353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220030+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T16:27:34.220030+0000","last_peered":"2023-10-21T16:27:34.220030+0000","last_clean":"2023-10-21T16:27:34.220030+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T16:27:34.220030+0000","last_undegraded":"2023-10-21T16:27:34.220030+0000","last_fullsized":"2023-10-21T16:27:34.220030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903352+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T16:27:31.903352+0000","last_peered":"2023-10-21T16:27:31.903352+0000","last_clean":"2023-10-21T16:27:31.903352+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T16:27:31.903352+0000","last_undegraded":"2023-10-21T16:27:31.903352+0000","last_fullsized":"2023-10-21T16:27:31.903352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095853+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T16:27:34.095853+0000","last_peered":"2023-10-21T16:27:34.095853+0000","last_clean":"2023-10-21T16:27:34.095853+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T16:27:34.095853+0000","last_undegraded":"2023-10-21T16:27:34.095853+0000","last_fullsized":"2023-10-21T16:27:34.095853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.453559+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T16:27:32.453559+0000","last_peered":"2023-10-21T16:27:32.453559+0000","last_clean":"2023-10-21T16:27:32.453559+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T16:27:32.453559+0000","last_undegraded":"2023-10-21T16:27:32.453559+0000","last_fullsized":"2023-10-21T16:27:32.453559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966955+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T16:27:32.966955+0000","last_peered":"2023-10-21T16:27:32.966955+0000","last_clean":"2023-10-21T16:27:32.966955+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T16:27:32.966955+0000","last_undegraded":"2023-10-21T16:27:32.966955+0000","last_fullsized":"2023-10-21T16:27:32.966955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902982+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T16:27:31.902982+0000","last_peered":"2023-10-21T16:27:31.902982+0000","last_clean":"2023-10-21T16:27:31.902982+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T16:27:31.902982+0000","last_undegraded":"2023-10-21T16:27:31.902982+0000","last_fullsized":"2023-10-21T16:27:31.902982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251665+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T16:27:34.251665+0000","last_peered":"2023-10-21T16:27:34.251665+0000","last_clean":"2023-10-21T16:27:34.251665+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T16:27:34.251665+0000","last_undegraded":"2023-10-21T16:27:34.251665+0000","last_fullsized":"2023-10-21T16:27:34.251665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051893+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T16:27:34.051893+0000","last_peered":"2023-10-21T16:27:34.051893+0000","last_clean":"2023-10-21T16:27:34.051893+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T16:27:34.051893+0000","last_undegraded":"2023-10-21T16:27:34.051893+0000","last_fullsized":"2023-10-21T16:27:34.051893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051698+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T16:27:34.051698+0000","last_peered":"2023-10-21T16:27:34.051698+0000","last_clean":"2023-10-21T16:27:34.051698+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T16:27:34.051698+0000","last_undegraded":"2023-10-21T16:27:34.051698+0000","last_fullsized":"2023-10-21T16:27:34.051698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.233077+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T16:27:34.233077+0000","last_peered":"2023-10-21T16:27:34.233077+0000","last_clean":"2023-10-21T16:27:34.233077+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T16:27:34.233077+0000","last_undegraded":"2023-10-21T16:27:34.233077+0000","last_fullsized":"2023-10-21T16:27:34.233077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051731+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T16:27:34.051731+0000","last_peered":"2023-10-21T16:27:34.051731+0000","last_clean":"2023-10-21T16:27:34.051731+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T16:27:34.051731+0000","last_undegraded":"2023-10-21T16:27:34.051731+0000","last_fullsized":"2023-10-21T16:27:34.051731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924681+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T16:27:31.924681+0000","last_peered":"2023-10-21T16:27:31.924681+0000","last_clean":"2023-10-21T16:27:31.924681+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T16:27:31.924681+0000","last_undegraded":"2023-10-21T16:27:31.924681+0000","last_fullsized":"2023-10-21T16:27:31.924681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963711+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T16:27:32.963711+0000","last_peered":"2023-10-21T16:27:32.963711+0000","last_clean":"2023-10-21T16:27:32.963711+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T16:27:32.963711+0000","last_undegraded":"2023-10-21T16:27:32.963711+0000","last_fullsized":"2023-10-21T16:27:32.963711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.450370+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T16:27:32.450370+0000","last_peered":"2023-10-21T16:27:32.450370+0000","last_clean":"2023-10-21T16:27:32.450370+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T16:27:32.450370+0000","last_undegraded":"2023-10-21T16:27:32.450370+0000","last_fullsized":"2023-10-21T16:27:32.450370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051453+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T16:27:34.051453+0000","last_peered":"2023-10-21T16:27:34.051453+0000","last_clean":"2023-10-21T16:27:34.051453+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T16:27:34.051453+0000","last_undegraded":"2023-10-21T16:27:34.051453+0000","last_fullsized":"2023-10-21T16:27:34.051453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385909+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T16:27:32.385909+0000","last_peered":"2023-10-21T16:27:32.385909+0000","last_clean":"2023-10-21T16:27:32.385909+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T16:27:32.385909+0000","last_undegraded":"2023-10-21T16:27:32.385909+0000","last_fullsized":"2023-10-21T16:27:32.385909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089055+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T16:27:34.089055+0000","last_peered":"2023-10-21T16:27:34.089055+0000","last_clean":"2023-10-21T16:27:34.089055+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T16:27:34.089055+0000","last_undegraded":"2023-10-21T16:27:34.089055+0000","last_fullsized":"2023-10-21T16:27:34.089055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.237359+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T16:27:34.237359+0000","last_peered":"2023-10-21T16:27:34.237359+0000","last_clean":"2023-10-21T16:27:34.237359+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T16:27:34.237359+0000","last_undegraded":"2023-10-21T16:27:34.237359+0000","last_fullsized":"2023-10-21T16:27:34.237359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963889+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T16:27:32.963889+0000","last_peered":"2023-10-21T16:27:32.963889+0000","last_clean":"2023-10-21T16:27:32.963889+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T16:27:32.963889+0000","last_undegraded":"2023-10-21T16:27:32.963889+0000","last_fullsized":"2023-10-21T16:27:32.963889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964440+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T16:27:32.964440+0000","last_peered":"2023-10-21T16:27:32.964440+0000","last_clean":"2023-10-21T16:27:32.964440+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T16:27:32.964440+0000","last_undegraded":"2023-10-21T16:27:32.964440+0000","last_fullsized":"2023-10-21T16:27:32.964440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.221456+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T16:27:34.221456+0000","last_peered":"2023-10-21T16:27:34.221456+0000","last_clean":"2023-10-21T16:27:34.221456+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T16:27:34.221456+0000","last_undegraded":"2023-10-21T16:27:34.221456+0000","last_fullsized":"2023-10-21T16:27:34.221456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443733+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T16:27:33.443733+0000","last_peered":"2023-10-21T16:27:33.443733+0000","last_clean":"2023-10-21T16:27:33.443733+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T16:27:33.443733+0000","last_undegraded":"2023-10-21T16:27:33.443733+0000","last_fullsized":"2023-10-21T16:27:33.443733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.222799+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T16:27:34.222799+0000","last_peered":"2023-10-21T16:27:34.222799+0000","last_clean":"2023-10-21T16:27:34.222799+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T16:27:34.222799+0000","last_undegraded":"2023-10-21T16:27:34.222799+0000","last_fullsized":"2023-10-21T16:27:34.222799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220333+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T16:27:34.220333+0000","last_peered":"2023-10-21T16:27:34.220333+0000","last_clean":"2023-10-21T16:27:34.220333+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T16:27:34.220333+0000","last_undegraded":"2023-10-21T16:27:34.220333+0000","last_fullsized":"2023-10-21T16:27:34.220333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220283+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T16:27:34.220283+0000","last_peered":"2023-10-21T16:27:34.220283+0000","last_clean":"2023-10-21T16:27:34.220283+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T16:27:34.220283+0000","last_undegraded":"2023-10-21T16:27:34.220283+0000","last_fullsized":"2023-10-21T16:27:34.220283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220227+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T16:27:34.220227+0000","last_peered":"2023-10-21T16:27:34.220227+0000","last_clean":"2023-10-21T16:27:34.220227+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T16:27:34.220227+0000","last_undegraded":"2023-10-21T16:27:34.220227+0000","last_fullsized":"2023-10-21T16:27:34.220227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.246388+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T16:27:34.246388+0000","last_peered":"2023-10-21T16:27:34.246388+0000","last_clean":"2023-10-21T16:27:34.246388+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T16:27:34.246388+0000","last_undegraded":"2023-10-21T16:27:34.246388+0000","last_fullsized":"2023-10-21T16:27:34.246388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476749,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3869999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4169999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2880000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5110000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":2,"up_from":16,"seq":68719476750,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.242}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]},{"osd":0,"up_from":16,"seq":68719476751,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]}]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":82075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T16:27:51.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T16:27:51.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:27:51.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:27:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.565+0000 7f44a4ea9640 1 Processor -- start 2023-10-21T16:27:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.565+0000 7f44a4ea9640 1 -- start start 2023-10-21T16:27:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f44a4ea9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44a0156c40 0x7f44a006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f44a4ea9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a015a450 con 0x7f44a01500d0 2023-10-21T16:27:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f44a4ea9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a0156050 con 0x7f44a0071510 2023-10-21T16:27:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f44a4ea9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0159eb0 con 0x7f44a0156c40 2023-10-21T16:27:51.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f449dd9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f44a0071510 0x7f44a0156530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:56078/0 (socket says 172.21.15.12:56078) 2023-10-21T16:27:51.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.567+0000 7f449dd9b640 1 -- 172.21.15.12:0/1994941448 learned_addr learned my addr 172.21.15.12:0/1994941448 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:51.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.568+0000 7f449ed9d640 1 --2- 172.21.15.12:0/1994941448 >> v2:172.21.15.99:3300/0 conn(0x7f44a0156c40 0x7f44a006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.572+0000 7f449ed9d640 1 -- 172.21.15.12:0/1994941448 >> v1:172.21.15.99:6789/0 conn(0x7f44a0071510 legacy=0x7f44a0156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.572+0000 7f449ed9d640 1 -- 172.21.15.12:0/1994941448 >> v1:172.21.15.12:6789/0 conn(0x7f44a01500d0 legacy=0x7f44a00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.572+0000 7f449ed9d640 1 -- 172.21.15.12:0/1994941448 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00721c0 con 0x7f44a0156c40 2023-10-21T16:27:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.575+0000 7f449ed9d640 1 --2- 172.21.15.12:0/1994941448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0156c40 0x7f44a006fd70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4498009d90 tx=0x7f449802e160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa3dcf8df7177bde server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:51.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.581+0000 7f449d59a640 1 -- 172.21.15.12:0/1994941448 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498036440 con 0x7f44a0156c40 2023-10-21T16:27:51.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f449d59a640 1 -- 172.21.15.12:0/1994941448 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44980365a0 con 0x7f44a0156c40 2023-10-21T16:27:51.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f449d59a640 1 -- 172.21.15.12:0/1994941448 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498036930 con 0x7f44a0156c40 2023-10-21T16:27:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f44a4ea9640 1 -- 172.21.15.12:0/1994941448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0156c40 msgr2=0x7f44a006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/1994941448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0156c40 0x7f44a006fd70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4498009d90 tx=0x7f449802e160 comp rx=0 tx=0).stop 2023-10-21T16:27:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f44a4ea9640 1 -- 172.21.15.12:0/1994941448 shutdown_connections 2023-10-21T16:27:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/1994941448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0156c40 0x7f44a006fd70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.582+0000 7f44a4ea9640 1 -- 172.21.15.12:0/1994941448 >> 172.21.15.12:0/1994941448 conn(0x7f44a0069de0 msgr2=0x7f44a006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.583+0000 7f44a4ea9640 1 -- 172.21.15.12:0/1994941448 shutdown_connections 2023-10-21T16:27:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.583+0000 7f44a4ea9640 1 -- 172.21.15.12:0/1994941448 wait complete. 2023-10-21T16:27:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.584+0000 7f44a4ea9640 1 Processor -- start 2023-10-21T16:27:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.585+0000 7f44a4ea9640 1 -- start start 2023-10-21T16:27:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44a01500d0 0x7f44a0158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44a0156c40 0x7f44a0140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01f2300 con 0x7f44a01500d0 2023-10-21T16:27:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01f2820 con 0x7f44a0071510 2023-10-21T16:27:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f44a4ea9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01455c0 con 0x7f44a0156c40 2023-10-21T16:27:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f449e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f449ed9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44a0156c40 0x7f44a0140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f449e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:60928/0 (socket says 172.21.15.12:60928) 2023-10-21T16:27:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.586+0000 7f449e59c640 1 -- 172.21.15.12:0/2667574759 learned_addr learned my addr 172.21.15.12:0/2667574759 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.587+0000 7f449dd9b640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44a01500d0 0x7f44a0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.590+0000 7f449e59c640 1 -- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44a0156c40 msgr2=0x7f44a0140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.590+0000 7f449e59c640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44a0156c40 0x7f44a0140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.590+0000 7f449e59c640 1 -- 172.21.15.12:0/2667574759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44a01500d0 msgr2=0x7f44a0158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:51.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.590+0000 7f449e59c640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44a01500d0 0x7f44a0158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:51.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.590+0000 7f449e59c640 1 -- 172.21.15.12:0/2667574759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009a70 con 0x7f44a0071510 2023-10-21T16:27:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.592+0000 7f449e59c640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449000c400 tx=0x7f449000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.594+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900052d0 con 0x7f44a0071510 2023-10-21T16:27:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.594+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a014ddc0 con 0x7f44a0071510 2023-10-21T16:27:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.594+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a014f340 con 0x7f44a0071510 2023-10-21T16:27:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.596+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490005430 con 0x7f44a0071510 2023-10-21T16:27:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.596+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490007220 con 0x7f44a0071510 2023-10-21T16:27:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.597+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484005250 con 0x7f44a0071510 2023-10-21T16:27:51.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.615+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4490007380 con 0x7f44a0071510 2023-10-21T16:27:51.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.617+0000 7f448effd640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 0x7f448006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:51.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.617+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4490089240 con 0x7f44a0071510 2023-10-21T16:27:51.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.617+0000 7f449dd9b640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 0x7f448006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:51.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.618+0000 7f449dd9b640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 0x7f448006d360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44a0142280 tx=0x7f4494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:51.858+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4490054510 con 0x7f44a0071510 2023-10-21T16:27:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.064+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4484000bc0 con 0x7f448006aea0 2023-10-21T16:27:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.073+0000 7f448effd640 1 -- 172.21.15.12:0/2667574759 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264444 (secure 0 0 0) 0x7f4484000bc0 con 0x7f448006aea0 2023-10-21T16:27:52.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T16:27:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 msgr2=0x7f448006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 0x7f448006d360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44a0142280 tx=0x7f4494009040 comp rx=0 tx=0).stop 2023-10-21T16:27:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 msgr2=0x7f44a014eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449000c400 tx=0x7f449000c8c0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 shutdown_connections 2023-10-21T16:27:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f448006aea0 0x7f448006d360 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44a0156c40 0x7f44a0140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44a01500d0 0x7f44a0158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 --2- 172.21.15.12:0/2667574759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44a0071510 0x7f44a014eb40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 >> 172.21.15.12:0/2667574759 conn(0x7f44a0069de0 msgr2=0x7f44a00c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:52.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 shutdown_connections 2023-10-21T16:27:52.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.079+0000 7f44a4ea9640 1 -- 172.21.15.12:0/2667574759 wait complete. 2023-10-21T16:27:52.099 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-10-21T16:27:51.260181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219172,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755548,"statfs":{"total":773094113280,"available":772869681152,"internally_reserved":0,"allocated":3088384,"data_stored":1823884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002511"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096955+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T16:27:34.096955+0000","last_peered":"2023-10-21T16:27:34.096955+0000","last_clean":"2023-10-21T16:27:34.096955+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T16:27:34.096955+0000","last_undegraded":"2023-10-21T16:27:34.096955+0000","last_fullsized":"2023-10-21T16:27:34.096955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220196+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T16:27:34.220196+0000","last_peered":"2023-10-21T16:27:34.220196+0000","last_clean":"2023-10-21T16:27:34.220196+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T16:27:34.220196+0000","last_undegraded":"2023-10-21T16:27:34.220196+0000","last_fullsized":"2023-10-21T16:27:34.220196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220057+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T16:27:34.220057+0000","last_peered":"2023-10-21T16:27:34.220057+0000","last_clean":"2023-10-21T16:27:34.220057+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T16:27:34.220057+0000","last_undegraded":"2023-10-21T16:27:34.220057+0000","last_fullsized":"2023-10-21T16:27:34.220057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967774+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T16:27:32.967774+0000","last_peered":"2023-10-21T16:27:32.967774+0000","last_clean":"2023-10-21T16:27:32.967774+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T16:27:32.967774+0000","last_undegraded":"2023-10-21T16:27:32.967774+0000","last_fullsized":"2023-10-21T16:27:32.967774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096319+0000","last_change":"2023-10-21T16:27:31.926876+0000","last_active":"2023-10-21T16:27:34.096319+0000","last_peered":"2023-10-21T16:27:34.096319+0000","last_clean":"2023-10-21T16:27:34.096319+0000","last_became_active":"2023-10-21T16:27:31.924739+0000","last_became_peered":"2023-10-21T16:27:31.924739+0000","last_unstale":"2023-10-21T16:27:34.096319+0000","last_undegraded":"2023-10-21T16:27:34.096319+0000","last_fullsized":"2023-10-21T16:27:34.096319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.967014+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T16:27:32.967014+0000","last_peered":"2023-10-21T16:27:32.967014+0000","last_clean":"2023-10-21T16:27:32.967014+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T16:27:32.967014+0000","last_undegraded":"2023-10-21T16:27:32.967014+0000","last_fullsized":"2023-10-21T16:27:32.967014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095632+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T16:27:34.095632+0000","last_peered":"2023-10-21T16:27:34.095632+0000","last_clean":"2023-10-21T16:27:34.095632+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T16:27:34.095632+0000","last_undegraded":"2023-10-21T16:27:34.095632+0000","last_fullsized":"2023-10-21T16:27:34.095632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219959+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T16:27:34.219959+0000","last_peered":"2023-10-21T16:27:34.219959+0000","last_clean":"2023-10-21T16:27:34.219959+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T16:27:34.219959+0000","last_undegraded":"2023-10-21T16:27:34.219959+0000","last_fullsized":"2023-10-21T16:27:34.219959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.444446+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T16:27:33.444446+0000","last_peered":"2023-10-21T16:27:33.444446+0000","last_clean":"2023-10-21T16:27:33.444446+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T16:27:33.444446+0000","last_undegraded":"2023-10-21T16:27:33.444446+0000","last_fullsized":"2023-10-21T16:27:33.444446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096902+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T16:27:34.096902+0000","last_peered":"2023-10-21T16:27:34.096902+0000","last_clean":"2023-10-21T16:27:34.096902+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T16:27:34.096902+0000","last_undegraded":"2023-10-21T16:27:34.096902+0000","last_fullsized":"2023-10-21T16:27:34.096902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096870+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T16:27:34.096870+0000","last_peered":"2023-10-21T16:27:34.096870+0000","last_clean":"2023-10-21T16:27:34.096870+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T16:27:34.096870+0000","last_undegraded":"2023-10-21T16:27:34.096870+0000","last_fullsized":"2023-10-21T16:27:34.096870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095803+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T16:27:34.095803+0000","last_peered":"2023-10-21T16:27:34.095803+0000","last_clean":"2023-10-21T16:27:34.095803+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T16:27:34.095803+0000","last_undegraded":"2023-10-21T16:27:34.095803+0000","last_fullsized":"2023-10-21T16:27:34.095803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251595+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T16:27:34.251595+0000","last_peered":"2023-10-21T16:27:34.251595+0000","last_clean":"2023-10-21T16:27:34.251595+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T16:27:34.251595+0000","last_undegraded":"2023-10-21T16:27:34.251595+0000","last_fullsized":"2023-10-21T16:27:34.251595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251551+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T16:27:34.251551+0000","last_peered":"2023-10-21T16:27:34.251551+0000","last_clean":"2023-10-21T16:27:34.251551+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T16:27:34.251551+0000","last_undegraded":"2023-10-21T16:27:34.251551+0000","last_fullsized":"2023-10-21T16:27:34.251551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.219911+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T16:27:34.219911+0000","last_peered":"2023-10-21T16:27:34.219911+0000","last_clean":"2023-10-21T16:27:34.219911+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T16:27:34.219911+0000","last_undegraded":"2023-10-21T16:27:34.219911+0000","last_fullsized":"2023-10-21T16:27:34.219911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963543+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T16:27:32.963543+0000","last_peered":"2023-10-21T16:27:32.963543+0000","last_clean":"2023-10-21T16:27:32.963543+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T16:27:32.963543+0000","last_undegraded":"2023-10-21T16:27:32.963543+0000","last_fullsized":"2023-10-21T16:27:32.963543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964833+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T16:27:32.964833+0000","last_peered":"2023-10-21T16:27:32.964833+0000","last_clean":"2023-10-21T16:27:32.964833+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T16:27:32.964833+0000","last_undegraded":"2023-10-21T16:27:32.964833+0000","last_fullsized":"2023-10-21T16:27:32.964833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089146+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T16:27:34.089146+0000","last_peered":"2023-10-21T16:27:34.089146+0000","last_clean":"2023-10-21T16:27:34.089146+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T16:27:34.089146+0000","last_undegraded":"2023-10-21T16:27:34.089146+0000","last_fullsized":"2023-10-21T16:27:34.089146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964685+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T16:27:32.964685+0000","last_peered":"2023-10-21T16:27:32.964685+0000","last_clean":"2023-10-21T16:27:32.964685+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T16:27:32.964685+0000","last_undegraded":"2023-10-21T16:27:32.964685+0000","last_fullsized":"2023-10-21T16:27:32.964685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095995+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T16:27:34.095995+0000","last_peered":"2023-10-21T16:27:34.095995+0000","last_clean":"2023-10-21T16:27:34.095995+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T16:27:34.095995+0000","last_undegraded":"2023-10-21T16:27:34.095995+0000","last_fullsized":"2023-10-21T16:27:34.095995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051716+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T16:27:34.051716+0000","last_peered":"2023-10-21T16:27:34.051716+0000","last_clean":"2023-10-21T16:27:34.051716+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T16:27:34.051716+0000","last_undegraded":"2023-10-21T16:27:34.051716+0000","last_fullsized":"2023-10-21T16:27:34.051716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443049+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T16:27:33.443049+0000","last_peered":"2023-10-21T16:27:33.443049+0000","last_clean":"2023-10-21T16:27:33.443049+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T16:27:33.443049+0000","last_undegraded":"2023-10-21T16:27:33.443049+0000","last_fullsized":"2023-10-21T16:27:33.443049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220071+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T16:27:34.220071+0000","last_peered":"2023-10-21T16:27:34.220071+0000","last_clean":"2023-10-21T16:27:34.220071+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T16:27:34.220071+0000","last_undegraded":"2023-10-21T16:27:34.220071+0000","last_fullsized":"2023-10-21T16:27:34.220071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963620+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T16:27:32.963620+0000","last_peered":"2023-10-21T16:27:32.963620+0000","last_clean":"2023-10-21T16:27:32.963620+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T16:27:32.963620+0000","last_undegraded":"2023-10-21T16:27:32.963620+0000","last_fullsized":"2023-10-21T16:27:32.963620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220273+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T16:27:34.220273+0000","last_peered":"2023-10-21T16:27:34.220273+0000","last_clean":"2023-10-21T16:27:34.220273+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T16:27:34.220273+0000","last_undegraded":"2023-10-21T16:27:34.220273+0000","last_fullsized":"2023-10-21T16:27:34.220273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968086+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T16:27:32.968086+0000","last_peered":"2023-10-21T16:27:32.968086+0000","last_clean":"2023-10-21T16:27:32.968086+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T16:27:32.968086+0000","last_undegraded":"2023-10-21T16:27:32.968086+0000","last_fullsized":"2023-10-21T16:27:32.968086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251803+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T16:27:34.251803+0000","last_peered":"2023-10-21T16:27:34.251803+0000","last_clean":"2023-10-21T16:27:34.251803+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T16:27:34.251803+0000","last_undegraded":"2023-10-21T16:27:34.251803+0000","last_fullsized":"2023-10-21T16:27:34.251803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251649+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T16:27:34.251649+0000","last_peered":"2023-10-21T16:27:34.251649+0000","last_clean":"2023-10-21T16:27:34.251649+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T16:27:34.251649+0000","last_undegraded":"2023-10-21T16:27:34.251649+0000","last_fullsized":"2023-10-21T16:27:34.251649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220059+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T16:27:34.220059+0000","last_peered":"2023-10-21T16:27:34.220059+0000","last_clean":"2023-10-21T16:27:34.220059+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T16:27:34.220059+0000","last_undegraded":"2023-10-21T16:27:34.220059+0000","last_fullsized":"2023-10-21T16:27:34.220059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963880+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T16:27:32.963880+0000","last_peered":"2023-10-21T16:27:32.963880+0000","last_clean":"2023-10-21T16:27:32.963880+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T16:27:32.963880+0000","last_undegraded":"2023-10-21T16:27:32.963880+0000","last_fullsized":"2023-10-21T16:27:32.963880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.088942+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T16:27:34.088942+0000","last_peered":"2023-10-21T16:27:34.088942+0000","last_clean":"2023-10-21T16:27:34.088942+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T16:27:34.088942+0000","last_undegraded":"2023-10-21T16:27:34.088942+0000","last_fullsized":"2023-10-21T16:27:34.088942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966760+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T16:27:32.966760+0000","last_peered":"2023-10-21T16:27:32.966760+0000","last_clean":"2023-10-21T16:27:32.966760+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T16:27:32.966760+0000","last_undegraded":"2023-10-21T16:27:32.966760+0000","last_fullsized":"2023-10-21T16:27:32.966760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443231+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T16:27:33.443231+0000","last_peered":"2023-10-21T16:27:33.443231+0000","last_clean":"2023-10-21T16:27:33.443231+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T16:27:33.443231+0000","last_undegraded":"2023-10-21T16:27:33.443231+0000","last_fullsized":"2023-10-21T16:27:33.443231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220184+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T16:27:34.220184+0000","last_peered":"2023-10-21T16:27:34.220184+0000","last_clean":"2023-10-21T16:27:34.220184+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T16:27:34.220184+0000","last_undegraded":"2023-10-21T16:27:34.220184+0000","last_fullsized":"2023-10-21T16:27:34.220184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051700+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T16:27:34.051700+0000","last_peered":"2023-10-21T16:27:34.051700+0000","last_clean":"2023-10-21T16:27:34.051700+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T16:27:34.051700+0000","last_undegraded":"2023-10-21T16:27:34.051700+0000","last_fullsized":"2023-10-21T16:27:34.051700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964000+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T16:27:32.964000+0000","last_peered":"2023-10-21T16:27:32.964000+0000","last_clean":"2023-10-21T16:27:32.964000+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T16:27:32.964000+0000","last_undegraded":"2023-10-21T16:27:32.964000+0000","last_fullsized":"2023-10-21T16:27:32.964000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385858+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T16:27:32.385858+0000","last_peered":"2023-10-21T16:27:32.385858+0000","last_clean":"2023-10-21T16:27:32.385858+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T16:27:32.385858+0000","last_undegraded":"2023-10-21T16:27:32.385858+0000","last_fullsized":"2023-10-21T16:27:32.385858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220101+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T16:27:34.220101+0000","last_peered":"2023-10-21T16:27:34.220101+0000","last_clean":"2023-10-21T16:27:34.220101+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T16:27:34.220101+0000","last_undegraded":"2023-10-21T16:27:34.220101+0000","last_fullsized":"2023-10-21T16:27:34.220101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895978+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T16:27:31.895978+0000","last_peered":"2023-10-21T16:27:31.895978+0000","last_clean":"2023-10-21T16:27:31.895978+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T16:27:31.895978+0000","last_undegraded":"2023-10-21T16:27:31.895978+0000","last_fullsized":"2023-10-21T16:27:31.895978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051556+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T16:27:34.051556+0000","last_peered":"2023-10-21T16:27:34.051556+0000","last_clean":"2023-10-21T16:27:34.051556+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T16:27:34.051556+0000","last_undegraded":"2023-10-21T16:27:34.051556+0000","last_fullsized":"2023-10-21T16:27:34.051556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.917463+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T16:27:31.917463+0000","last_peered":"2023-10-21T16:27:31.917463+0000","last_clean":"2023-10-21T16:27:31.917463+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T16:27:31.917463+0000","last_undegraded":"2023-10-21T16:27:31.917463+0000","last_fullsized":"2023-10-21T16:27:31.917463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968166+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T16:27:32.968166+0000","last_peered":"2023-10-21T16:27:32.968166+0000","last_clean":"2023-10-21T16:27:32.968166+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T16:27:32.968166+0000","last_undegraded":"2023-10-21T16:27:32.968166+0000","last_fullsized":"2023-10-21T16:27:32.968166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.927903+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T16:27:31.927903+0000","last_peered":"2023-10-21T16:27:31.927903+0000","last_clean":"2023-10-21T16:27:31.927903+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T16:27:31.927903+0000","last_undegraded":"2023-10-21T16:27:31.927903+0000","last_fullsized":"2023-10-21T16:27:31.927903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220385+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T16:27:34.220385+0000","last_peered":"2023-10-21T16:27:34.220385+0000","last_clean":"2023-10-21T16:27:34.220385+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T16:27:34.220385+0000","last_undegraded":"2023-10-21T16:27:34.220385+0000","last_fullsized":"2023-10-21T16:27:34.220385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.091178+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T16:27:34.091178+0000","last_peered":"2023-10-21T16:27:34.091178+0000","last_clean":"2023-10-21T16:27:34.091178+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T16:27:34.091178+0000","last_undegraded":"2023-10-21T16:27:34.091178+0000","last_fullsized":"2023-10-21T16:27:34.091178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963901+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T16:27:32.963901+0000","last_peered":"2023-10-21T16:27:32.963901+0000","last_clean":"2023-10-21T16:27:32.963901+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T16:27:32.963901+0000","last_undegraded":"2023-10-21T16:27:32.963901+0000","last_fullsized":"2023-10-21T16:27:32.963901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.056343+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T16:27:34.056343+0000","last_peered":"2023-10-21T16:27:34.056343+0000","last_clean":"2023-10-21T16:27:34.056343+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T16:27:34.056343+0000","last_undegraded":"2023-10-21T16:27:34.056343+0000","last_fullsized":"2023-10-21T16:27:34.056343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.096915+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T16:27:34.096915+0000","last_peered":"2023-10-21T16:27:34.096915+0000","last_clean":"2023-10-21T16:27:34.096915+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T16:27:34.096915+0000","last_undegraded":"2023-10-21T16:27:34.096915+0000","last_fullsized":"2023-10-21T16:27:34.096915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.092667+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T16:27:34.092667+0000","last_peered":"2023-10-21T16:27:34.092667+0000","last_clean":"2023-10-21T16:27:34.092667+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T16:27:34.092667+0000","last_undegraded":"2023-10-21T16:27:34.092667+0000","last_fullsized":"2023-10-21T16:27:34.092667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251614+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T16:27:34.251614+0000","last_peered":"2023-10-21T16:27:34.251614+0000","last_clean":"2023-10-21T16:27:34.251614+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T16:27:34.251614+0000","last_undegraded":"2023-10-21T16:27:34.251614+0000","last_fullsized":"2023-10-21T16:27:34.251614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903139+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T16:27:31.903139+0000","last_peered":"2023-10-21T16:27:31.903139+0000","last_clean":"2023-10-21T16:27:31.903139+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T16:27:31.903139+0000","last_undegraded":"2023-10-21T16:27:31.903139+0000","last_fullsized":"2023-10-21T16:27:31.903139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964065+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T16:27:32.964065+0000","last_peered":"2023-10-21T16:27:32.964065+0000","last_clean":"2023-10-21T16:27:32.964065+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T16:27:32.964065+0000","last_undegraded":"2023-10-21T16:27:32.964065+0000","last_fullsized":"2023-10-21T16:27:32.964065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924836+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T16:27:31.924836+0000","last_peered":"2023-10-21T16:27:31.924836+0000","last_clean":"2023-10-21T16:27:31.924836+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T16:27:31.924836+0000","last_undegraded":"2023-10-21T16:27:31.924836+0000","last_fullsized":"2023-10-21T16:27:31.924836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.442637+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T16:27:33.442637+0000","last_peered":"2023-10-21T16:27:33.442637+0000","last_clean":"2023-10-21T16:27:33.442637+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T16:27:33.442637+0000","last_undegraded":"2023-10-21T16:27:33.442637+0000","last_fullsized":"2023-10-21T16:27:33.442637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.236938+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T16:27:34.236938+0000","last_peered":"2023-10-21T16:27:34.236938+0000","last_clean":"2023-10-21T16:27:34.236938+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T16:27:34.236938+0000","last_undegraded":"2023-10-21T16:27:34.236938+0000","last_fullsized":"2023-10-21T16:27:34.236938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963557+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T16:27:32.963557+0000","last_peered":"2023-10-21T16:27:32.963557+0000","last_clean":"2023-10-21T16:27:32.963557+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T16:27:32.963557+0000","last_undegraded":"2023-10-21T16:27:32.963557+0000","last_fullsized":"2023-10-21T16:27:32.963557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097335+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T16:27:34.097335+0000","last_peered":"2023-10-21T16:27:34.097335+0000","last_clean":"2023-10-21T16:27:34.097335+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T16:27:34.097335+0000","last_undegraded":"2023-10-21T16:27:34.097335+0000","last_fullsized":"2023-10-21T16:27:34.097335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.968239+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T16:27:32.968239+0000","last_peered":"2023-10-21T16:27:32.968239+0000","last_clean":"2023-10-21T16:27:32.968239+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T16:27:32.968239+0000","last_undegraded":"2023-10-21T16:27:32.968239+0000","last_fullsized":"2023-10-21T16:27:32.968239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.226690+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T16:27:34.226690+0000","last_peered":"2023-10-21T16:27:34.226690+0000","last_clean":"2023-10-21T16:27:34.226690+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T16:27:34.226690+0000","last_undegraded":"2023-10-21T16:27:34.226690+0000","last_fullsized":"2023-10-21T16:27:34.226690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.097096+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T16:27:34.097096+0000","last_peered":"2023-10-21T16:27:34.097096+0000","last_clean":"2023-10-21T16:27:34.097096+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T16:27:34.097096+0000","last_undegraded":"2023-10-21T16:27:34.097096+0000","last_fullsized":"2023-10-21T16:27:34.097096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220126+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T16:27:34.220126+0000","last_peered":"2023-10-21T16:27:34.220126+0000","last_clean":"2023-10-21T16:27:34.220126+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T16:27:34.220126+0000","last_undegraded":"2023-10-21T16:27:34.220126+0000","last_fullsized":"2023-10-21T16:27:34.220126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095946+0000","last_change":"2023-10-21T16:27:31.930741+0000","last_active":"2023-10-21T16:27:34.095946+0000","last_peered":"2023-10-21T16:27:34.095946+0000","last_clean":"2023-10-21T16:27:34.095946+0000","last_became_active":"2023-10-21T16:27:31.928572+0000","last_became_peered":"2023-10-21T16:27:31.928572+0000","last_unstale":"2023-10-21T16:27:34.095946+0000","last_undegraded":"2023-10-21T16:27:34.095946+0000","last_fullsized":"2023-10-21T16:27:34.095946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385988+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T16:27:32.385988+0000","last_peered":"2023-10-21T16:27:32.385988+0000","last_clean":"2023-10-21T16:27:32.385988+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T16:27:32.385988+0000","last_undegraded":"2023-10-21T16:27:32.385988+0000","last_fullsized":"2023-10-21T16:27:32.385988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964475+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T16:27:32.964475+0000","last_peered":"2023-10-21T16:27:32.964475+0000","last_clean":"2023-10-21T16:27:32.964475+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T16:27:32.964475+0000","last_undegraded":"2023-10-21T16:27:32.964475+0000","last_fullsized":"2023-10-21T16:27:32.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.914486+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T16:27:31.914486+0000","last_peered":"2023-10-21T16:27:31.914486+0000","last_clean":"2023-10-21T16:27:31.914486+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T16:27:31.914486+0000","last_undegraded":"2023-10-21T16:27:31.914486+0000","last_fullsized":"2023-10-21T16:27:31.914486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902068+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T16:27:31.902068+0000","last_peered":"2023-10-21T16:27:31.902068+0000","last_clean":"2023-10-21T16:27:31.902068+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T16:27:31.902068+0000","last_undegraded":"2023-10-21T16:27:31.902068+0000","last_fullsized":"2023-10-21T16:27:31.902068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051553+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T16:27:34.051553+0000","last_peered":"2023-10-21T16:27:34.051553+0000","last_clean":"2023-10-21T16:27:34.051553+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T16:27:34.051553+0000","last_undegraded":"2023-10-21T16:27:34.051553+0000","last_fullsized":"2023-10-21T16:27:34.051553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.896424+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T16:27:31.896424+0000","last_peered":"2023-10-21T16:27:31.896424+0000","last_clean":"2023-10-21T16:27:31.896424+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T16:27:31.896424+0000","last_undegraded":"2023-10-21T16:27:31.896424+0000","last_fullsized":"2023-10-21T16:27:31.896424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251499+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T16:27:34.251499+0000","last_peered":"2023-10-21T16:27:34.251499+0000","last_clean":"2023-10-21T16:27:34.251499+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T16:27:34.251499+0000","last_undegraded":"2023-10-21T16:27:34.251499+0000","last_fullsized":"2023-10-21T16:27:34.251499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.895353+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T16:27:31.895353+0000","last_peered":"2023-10-21T16:27:31.895353+0000","last_clean":"2023-10-21T16:27:31.895353+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T16:27:31.895353+0000","last_undegraded":"2023-10-21T16:27:31.895353+0000","last_fullsized":"2023-10-21T16:27:31.895353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220030+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T16:27:34.220030+0000","last_peered":"2023-10-21T16:27:34.220030+0000","last_clean":"2023-10-21T16:27:34.220030+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T16:27:34.220030+0000","last_undegraded":"2023-10-21T16:27:34.220030+0000","last_fullsized":"2023-10-21T16:27:34.220030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.903352+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T16:27:31.903352+0000","last_peered":"2023-10-21T16:27:31.903352+0000","last_clean":"2023-10-21T16:27:31.903352+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T16:27:31.903352+0000","last_undegraded":"2023-10-21T16:27:31.903352+0000","last_fullsized":"2023-10-21T16:27:31.903352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.095853+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T16:27:34.095853+0000","last_peered":"2023-10-21T16:27:34.095853+0000","last_clean":"2023-10-21T16:27:34.095853+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T16:27:34.095853+0000","last_undegraded":"2023-10-21T16:27:34.095853+0000","last_fullsized":"2023-10-21T16:27:34.095853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.453559+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T16:27:32.453559+0000","last_peered":"2023-10-21T16:27:32.453559+0000","last_clean":"2023-10-21T16:27:32.453559+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T16:27:32.453559+0000","last_undegraded":"2023-10-21T16:27:32.453559+0000","last_fullsized":"2023-10-21T16:27:32.453559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.966955+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T16:27:32.966955+0000","last_peered":"2023-10-21T16:27:32.966955+0000","last_clean":"2023-10-21T16:27:32.966955+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T16:27:32.966955+0000","last_undegraded":"2023-10-21T16:27:32.966955+0000","last_fullsized":"2023-10-21T16:27:32.966955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.902982+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T16:27:31.902982+0000","last_peered":"2023-10-21T16:27:31.902982+0000","last_clean":"2023-10-21T16:27:31.902982+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T16:27:31.902982+0000","last_undegraded":"2023-10-21T16:27:31.902982+0000","last_fullsized":"2023-10-21T16:27:31.902982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.251665+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T16:27:34.251665+0000","last_peered":"2023-10-21T16:27:34.251665+0000","last_clean":"2023-10-21T16:27:34.251665+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T16:27:34.251665+0000","last_undegraded":"2023-10-21T16:27:34.251665+0000","last_fullsized":"2023-10-21T16:27:34.251665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051893+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T16:27:34.051893+0000","last_peered":"2023-10-21T16:27:34.051893+0000","last_clean":"2023-10-21T16:27:34.051893+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T16:27:34.051893+0000","last_undegraded":"2023-10-21T16:27:34.051893+0000","last_fullsized":"2023-10-21T16:27:34.051893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051698+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T16:27:34.051698+0000","last_peered":"2023-10-21T16:27:34.051698+0000","last_clean":"2023-10-21T16:27:34.051698+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T16:27:34.051698+0000","last_undegraded":"2023-10-21T16:27:34.051698+0000","last_fullsized":"2023-10-21T16:27:34.051698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.233077+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T16:27:34.233077+0000","last_peered":"2023-10-21T16:27:34.233077+0000","last_clean":"2023-10-21T16:27:34.233077+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T16:27:34.233077+0000","last_undegraded":"2023-10-21T16:27:34.233077+0000","last_fullsized":"2023-10-21T16:27:34.233077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051731+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T16:27:34.051731+0000","last_peered":"2023-10-21T16:27:34.051731+0000","last_clean":"2023-10-21T16:27:34.051731+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T16:27:34.051731+0000","last_undegraded":"2023-10-21T16:27:34.051731+0000","last_fullsized":"2023-10-21T16:27:34.051731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:31.924681+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T16:27:31.924681+0000","last_peered":"2023-10-21T16:27:31.924681+0000","last_clean":"2023-10-21T16:27:31.924681+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T16:27:31.924681+0000","last_undegraded":"2023-10-21T16:27:31.924681+0000","last_fullsized":"2023-10-21T16:27:31.924681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963711+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T16:27:32.963711+0000","last_peered":"2023-10-21T16:27:32.963711+0000","last_clean":"2023-10-21T16:27:32.963711+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T16:27:32.963711+0000","last_undegraded":"2023-10-21T16:27:32.963711+0000","last_fullsized":"2023-10-21T16:27:32.963711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.450370+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T16:27:32.450370+0000","last_peered":"2023-10-21T16:27:32.450370+0000","last_clean":"2023-10-21T16:27:32.450370+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T16:27:32.450370+0000","last_undegraded":"2023-10-21T16:27:32.450370+0000","last_fullsized":"2023-10-21T16:27:32.450370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.051453+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T16:27:34.051453+0000","last_peered":"2023-10-21T16:27:34.051453+0000","last_clean":"2023-10-21T16:27:34.051453+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T16:27:34.051453+0000","last_undegraded":"2023-10-21T16:27:34.051453+0000","last_fullsized":"2023-10-21T16:27:34.051453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.385909+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T16:27:32.385909+0000","last_peered":"2023-10-21T16:27:32.385909+0000","last_clean":"2023-10-21T16:27:32.385909+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T16:27:32.385909+0000","last_undegraded":"2023-10-21T16:27:32.385909+0000","last_fullsized":"2023-10-21T16:27:32.385909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.089055+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T16:27:34.089055+0000","last_peered":"2023-10-21T16:27:34.089055+0000","last_clean":"2023-10-21T16:27:34.089055+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T16:27:34.089055+0000","last_undegraded":"2023-10-21T16:27:34.089055+0000","last_fullsized":"2023-10-21T16:27:34.089055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.237359+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T16:27:34.237359+0000","last_peered":"2023-10-21T16:27:34.237359+0000","last_clean":"2023-10-21T16:27:34.237359+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T16:27:34.237359+0000","last_undegraded":"2023-10-21T16:27:34.237359+0000","last_fullsized":"2023-10-21T16:27:34.237359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.963889+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T16:27:32.963889+0000","last_peered":"2023-10-21T16:27:32.963889+0000","last_clean":"2023-10-21T16:27:32.963889+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T16:27:32.963889+0000","last_undegraded":"2023-10-21T16:27:32.963889+0000","last_fullsized":"2023-10-21T16:27:32.963889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:32.964440+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T16:27:32.964440+0000","last_peered":"2023-10-21T16:27:32.964440+0000","last_clean":"2023-10-21T16:27:32.964440+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T16:27:32.964440+0000","last_undegraded":"2023-10-21T16:27:32.964440+0000","last_fullsized":"2023-10-21T16:27:32.964440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.221456+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T16:27:34.221456+0000","last_peered":"2023-10-21T16:27:34.221456+0000","last_clean":"2023-10-21T16:27:34.221456+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T16:27:34.221456+0000","last_undegraded":"2023-10-21T16:27:34.221456+0000","last_fullsized":"2023-10-21T16:27:34.221456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:33.443733+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T16:27:33.443733+0000","last_peered":"2023-10-21T16:27:33.443733+0000","last_clean":"2023-10-21T16:27:33.443733+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T16:27:33.443733+0000","last_undegraded":"2023-10-21T16:27:33.443733+0000","last_fullsized":"2023-10-21T16:27:33.443733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.222799+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T16:27:34.222799+0000","last_peered":"2023-10-21T16:27:34.222799+0000","last_clean":"2023-10-21T16:27:34.222799+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T16:27:34.222799+0000","last_undegraded":"2023-10-21T16:27:34.222799+0000","last_fullsized":"2023-10-21T16:27:34.222799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220333+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T16:27:34.220333+0000","last_peered":"2023-10-21T16:27:34.220333+0000","last_clean":"2023-10-21T16:27:34.220333+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T16:27:34.220333+0000","last_undegraded":"2023-10-21T16:27:34.220333+0000","last_fullsized":"2023-10-21T16:27:34.220333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220283+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T16:27:34.220283+0000","last_peered":"2023-10-21T16:27:34.220283+0000","last_clean":"2023-10-21T16:27:34.220283+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T16:27:34.220283+0000","last_undegraded":"2023-10-21T16:27:34.220283+0000","last_fullsized":"2023-10-21T16:27:34.220283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.220227+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T16:27:34.220227+0000","last_peered":"2023-10-21T16:27:34.220227+0000","last_clean":"2023-10-21T16:27:34.220227+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T16:27:34.220227+0000","last_undegraded":"2023-10-21T16:27:34.220227+0000","last_fullsized":"2023-10-21T16:27:34.220227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-21T16:27:34.246388+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T16:27:34.246388+0000","last_peered":"2023-10-21T16:27:34.246388+0000","last_clean":"2023-10-21T16:27:34.246388+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T16:27:34.246388+0000","last_undegraded":"2023-10-21T16:27:34.246388+0000","last_fullsized":"2023-10-21T16:27:34.246388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476749,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3869999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4169999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2880000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5110000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":2,"up_from":16,"seq":68719476750,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.242}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]},{"osd":0,"up_from":16,"seq":68719476751,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]}]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":82075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T16:27:52.104 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-21T16:27:52.104 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-21T16:27:52.104 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-21T16:27:52.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-21T16:27:52.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.366+0000 7efed454e640 1 Processor -- start 2023-10-21T16:27:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.367+0000 7efed454e640 1 -- start start 2023-10-21T16:27:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.368+0000 7efed454e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efecc0c55f0 0x7efecc157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.368+0000 7efed454e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.368+0000 7efed454e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0c23f0 con 0x7efecc157cc0 2023-10-21T16:27:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.368+0000 7efed454e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc156fa0 con 0x7efecc0c55f0 2023-10-21T16:27:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.368+0000 7efed454e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc15aaf0 con 0x7efecc0c59d0 2023-10-21T16:27:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.369+0000 7efed2aeb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.369+0000 7efed22ea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efecc0c55f0 0x7efecc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.369+0000 7efed2aeb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54272/0 (socket says 172.21.15.12:54272) 2023-10-21T16:27:52.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.369+0000 7efed2aeb640 1 -- 172.21.15.12:0/1174803702 learned_addr learned my addr 172.21.15.12:0/1174803702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:52.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.372+0000 7efed2aeb640 1 -- 172.21.15.12:0/1174803702 >> v2:172.21.15.12:3300/0 conn(0x7efecc0c55f0 msgr2=0x7efecc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:52.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.372+0000 7efed2aeb640 1 --2- 172.21.15.12:0/1174803702 >> v2:172.21.15.12:3300/0 conn(0x7efecc0c55f0 0x7efecc157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.372+0000 7efed2aeb640 1 -- 172.21.15.12:0/1174803702 >> v1:172.21.15.12:6789/0 conn(0x7efecc157cc0 legacy=0x7efecc150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.372+0000 7efed2aeb640 1 -- 172.21.15.12:0/1174803702 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc15add0 con 0x7efecc0c59d0 2023-10-21T16:27:52.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.375+0000 7efed2aeb640 1 --2- 172.21.15.12:0/1174803702 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efec4009e50 tx=0x7efec402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f19e24a5c4acd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:52.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.378+0000 7efed12e8640 1 -- 172.21.15.12:0/1174803702 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec402cb90 con 0x7efecc0c59d0 2023-10-21T16:27:52.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.378+0000 7efed12e8640 1 -- 172.21.15.12:0/1174803702 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec402ccf0 con 0x7efecc0c59d0 2023-10-21T16:27:52.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.378+0000 7efed12e8640 1 -- 172.21.15.12:0/1174803702 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4034610 con 0x7efecc0c59d0 2023-10-21T16:27:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 -- 172.21.15.12:0/1174803702 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 msgr2=0x7efecc0c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 --2- 172.21.15.12:0/1174803702 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efec4009e50 tx=0x7efec402bff0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 -- 172.21.15.12:0/1174803702 shutdown_connections 2023-10-21T16:27:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 --2- 172.21.15.12:0/1174803702 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c59d0 0x7efecc0c7020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 --2- 172.21.15.12:0/1174803702 >> v2:172.21.15.12:3300/0 conn(0x7efecc0c55f0 0x7efecc157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 -- 172.21.15.12:0/1174803702 >> 172.21.15.12:0/1174803702 conn(0x7efecc069de0 msgr2=0x7efecc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 -- 172.21.15.12:0/1174803702 shutdown_connections 2023-10-21T16:27:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.379+0000 7efed454e640 1 -- 172.21.15.12:0/1174803702 wait complete. 2023-10-21T16:27:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.381+0000 7efed454e640 1 Processor -- start 2023-10-21T16:27:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.381+0000 7efed454e640 1 -- start start 2023-10-21T16:27:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efecc0c59d0 0x7efecc14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc157cc0 0x7efecc1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc14b460 con 0x7efecc157cc0 2023-10-21T16:27:52.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc14f820 con 0x7efecc0c59d0 2023-10-21T16:27:52.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.382+0000 7efed454e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc14bec0 con 0x7efecc0c55f0 2023-10-21T16:27:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.383+0000 7efed22ea640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.383+0000 7efed2aeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc157cc0 0x7efecc1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.383+0000 7efed1ae9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efecc0c59d0 0x7efecc14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.383+0000 7efed22ea640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54274/0 (socket says 172.21.15.12:54274) 2023-10-21T16:27:52.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.383+0000 7efed22ea640 1 -- 172.21.15.12:0/2024558710 learned_addr learned my addr 172.21.15.12:0/2024558710 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:52.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.386+0000 7efed22ea640 1 -- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efecc0c59d0 msgr2=0x7efecc14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.387+0000 7efed22ea640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efecc0c59d0 0x7efecc14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.387+0000 7efed22ea640 1 -- 172.21.15.12:0/2024558710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc157cc0 msgr2=0x7efecc1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.387+0000 7efed22ea640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc157cc0 0x7efecc1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.387+0000 7efed22ea640 1 -- 172.21.15.12:0/2024558710 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009b30 con 0x7efecc0c55f0 2023-10-21T16:27:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.389+0000 7efed22ea640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efec800e8a0 tx=0x7efec800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.391+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80094f0 con 0x7efecc0c55f0 2023-10-21T16:27:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.391+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc14e3a0 con 0x7efecc0c55f0 2023-10-21T16:27:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.391+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc1ef1e0 con 0x7efecc0c55f0 2023-10-21T16:27:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.392+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc1551f0 con 0x7efecc0c55f0 2023-10-21T16:27:52.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.410+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8005990 con 0x7efecc0c55f0 2023-10-21T16:27:52.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.410+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8005d00 con 0x7efecc0c55f0 2023-10-21T16:27:52.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.411+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efec800c940 con 0x7efecc0c55f0 2023-10-21T16:27:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.413+0000 7efec2ffd640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 0x7efeb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.413+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efec8089d20 con 0x7efecc0c55f0 2023-10-21T16:27:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.413+0000 7efed1ae9640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 0x7efeb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.414+0000 7efed1ae9640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 0x7efeb006d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efecc0c1620 tx=0x7efebc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.644+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efec8054f20 con 0x7efecc0c55f0 2023-10-21T16:27:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.891+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efecc0619f0 con 0x7efecc0c55f0 2023-10-21T16:27:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.898+0000 7efec2ffd640 1 -- 172.21.15.12:0/2024558710 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efec8017080 con 0x7efecc0c55f0 2023-10-21T16:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-21T16:27:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 msgr2=0x7efeb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 0x7efeb006d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efecc0c1620 tx=0x7efebc009040 comp rx=0 tx=0).stop 2023-10-21T16:27:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 msgr2=0x7efecc14e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efec800e8a0 tx=0x7efec800ed60 comp rx=0 tx=0).stop 2023-10-21T16:27:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 shutdown_connections 2023-10-21T16:27:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7efeb006ae70 0x7efeb006d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc157cc0 0x7efecc1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efecc0c59d0 0x7efecc14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 --2- 172.21.15.12:0/2024558710 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efecc0c55f0 0x7efecc14e8b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 >> 172.21.15.12:0/2024558710 conn(0x7efecc069de0 msgr2=0x7efecc06d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 shutdown_connections 2023-10-21T16:27:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:52.901+0000 7efed454e640 1 -- 172.21.15.12:0/2024558710 wait complete. 2023-10-21T16:27:52.922 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-21T16:27:52.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.144+0000 7fa4cc3dc640 1 Processor -- start 2023-10-21T16:27:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.144+0000 7fa4cc3dc640 1 -- start start 2023-10-21T16:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.146+0000 7fa4cc3dc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa4c4156c40 0x7fa4c406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.146+0000 7fa4cc3dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c415a450 con 0x7fa4c4071510 2023-10-21T16:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.146+0000 7fa4cc3dc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c4156050 con 0x7fa4c41500d0 2023-10-21T16:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.146+0000 7fa4cc3dc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c4159eb0 con 0x7fa4c4156c40 2023-10-21T16:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.146+0000 7fa4ca979640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa4c4156c40 0x7fa4c406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.147+0000 7fa4ca178640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa4c41500d0 0x7fa4c40c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43140/0 (socket says 172.21.15.12:43140) 2023-10-21T16:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.147+0000 7fa4ca178640 1 -- 172.21.15.12:0/2700625464 learned_addr learned my addr 172.21.15.12:0/2700625464 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.149+0000 7fa4ca979640 1 -- 172.21.15.12:0/2700625464 >> v1:172.21.15.99:6789/0 conn(0x7fa4c41500d0 legacy=0x7fa4c40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.150+0000 7fa4ca979640 1 -- 172.21.15.12:0/2700625464 >> v1:172.21.15.12:6789/0 conn(0x7fa4c4071510 legacy=0x7fa4c4156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.150+0000 7fa4ca979640 1 -- 172.21.15.12:0/2700625464 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40721c0 con 0x7fa4c4156c40 2023-10-21T16:27:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.153+0000 7fa4ca979640 1 --2- 172.21.15.12:0/2700625464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c406fd70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8403814bf7ba9e server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.156+0000 7fa4c9176640 1 -- 172.21.15.12:0/2700625464 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc02cd00 con 0x7fa4c4156c40 2023-10-21T16:27:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.157+0000 7fa4c9176640 1 -- 172.21.15.12:0/2700625464 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc02ce60 con 0x7fa4c4156c40 2023-10-21T16:27:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.157+0000 7fa4c9176640 1 -- 172.21.15.12:0/2700625464 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc034660 con 0x7fa4c4156c40 2023-10-21T16:27:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.157+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/2700625464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 msgr2=0x7fa4c406fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/2700625464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c406fd70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc02bf50 comp rx=0 tx=0).stop 2023-10-21T16:27:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/2700625464 shutdown_connections 2023-10-21T16:27:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/2700625464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c406fd70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/2700625464 >> 172.21.15.12:0/2700625464 conn(0x7fa4c4069de0 msgr2=0x7fa4c406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/2700625464 shutdown_connections 2023-10-21T16:27:53.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.158+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/2700625464 wait complete. 2023-10-21T16:27:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.160+0000 7fa4cc3dc640 1 Processor -- start 2023-10-21T16:27:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.161+0000 7fa4cc3dc640 1 -- start start 2023-10-21T16:27:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4c4071510 0x7fa4c4142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41500d0 0x7fa4c41ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4144db0 con 0x7fa4c41500d0 2023-10-21T16:27:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41ef9f0 con 0x7fa4c4156c40 2023-10-21T16:27:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.162+0000 7fa4cc3dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4143ec0 con 0x7fa4c4071510 2023-10-21T16:27:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.163+0000 7fa4ca979640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.163+0000 7fa4ca178640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4c4071510 0x7fa4c4142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.163+0000 7fa4ca979640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59462/0 (socket says 172.21.15.12:59462) 2023-10-21T16:27:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.163+0000 7fa4ca979640 1 -- 172.21.15.12:0/1212456067 learned_addr learned my addr 172.21.15.12:0/1212456067 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.163+0000 7fa4c9977640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41500d0 0x7fa4c41ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.166+0000 7fa4ca979640 1 -- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4c4071510 msgr2=0x7fa4c4142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.166+0000 7fa4ca979640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4c4071510 0x7fa4c4142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.166+0000 7fa4ca979640 1 -- 172.21.15.12:0/1212456067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41500d0 msgr2=0x7fa4c41ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.166+0000 7fa4ca979640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41500d0 0x7fa4c41ef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.166+0000 7fa4ca979640 1 -- 172.21.15.12:0/1212456067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009a70 con 0x7fa4c4156c40 2023-10-21T16:27:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.169+0000 7fa4ca979640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009eb0 tx=0x7fa4bc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.172+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc03e610 con 0x7fa4c4156c40 2023-10-21T16:27:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.172+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc03e770 con 0x7fa4c4156c40 2023-10-21T16:27:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.172+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc03eb20 con 0x7fa4c4156c40 2023-10-21T16:27:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.172+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c41441a0 con 0x7fa4c4156c40 2023-10-21T16:27:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.173+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4144760 con 0x7fa4c4156c40 2023-10-21T16:27:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.174+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c40619f0 con 0x7fa4c4156c40 2023-10-21T16:27:53.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.193+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4bc03b050 con 0x7fa4c4156c40 2023-10-21T16:27:53.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.194+0000 7fa4baffd640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 0x7fa4a806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.194+0000 7fa4ca178640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 0x7fa4a806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.195+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc07b0f0 con 0x7fa4c4156c40 2023-10-21T16:27:53.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.195+0000 7fa4ca178640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 0x7fa4a806d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0007fd0 tx=0x7fa4c0007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:53.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.431+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4bc077430 con 0x7fa4c4156c40 2023-10-21T16:27:53.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.637+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4c40c16b0 con 0x7fa4c4156c40 2023-10-21T16:27:53.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.672+0000 7fa4baffd640 1 -- 172.21.15.12:0/1212456067 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fa4bc04e020 con 0x7fa4c4156c40 2023-10-21T16:27:53.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:53.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:32.687689+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:53.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 msgr2=0x7fa4a806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 0x7fa4a806d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0007fd0 tx=0x7fa4c0007e80 comp rx=0 tx=0).stop 2023-10-21T16:27:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 msgr2=0x7fa4c4142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009eb0 tx=0x7fa4bc004a40 comp rx=0 tx=0).stop 2023-10-21T16:27:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 shutdown_connections 2023-10-21T16:27:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa4a806aef0 0x7fa4a806d3b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c4156c40 0x7fa4c4142f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41500d0 0x7fa4c41ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 --2- 172.21.15.12:0/1212456067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4c4071510 0x7fa4c4142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 >> 172.21.15.12:0/1212456067 conn(0x7fa4c4069de0 msgr2=0x7fa4c4073170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 shutdown_connections 2023-10-21T16:27:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.675+0000 7fa4cc3dc640 1 -- 172.21.15.12:0/1212456067 wait complete. 2023-10-21T16:27:53.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-21T16:27:08.552678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-21T16:27:27.920466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-21T16:27:29.996993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-21T16:27:53.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-21T16:27:53.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.915+0000 7fdbb4283640 1 Processor -- start 2023-10-21T16:27:53.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.915+0000 7fdbb4283640 1 -- start start 2023-10-21T16:27:53.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.917+0000 7fdbb4283640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbac151780 0x7fdbac06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:53.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.917+0000 7fdbb4283640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac06d6f0 con 0x7fdbac0b0ca0 2023-10-21T16:27:53.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.917+0000 7fdbb4283640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac066160 con 0x7fdbac1513a0 2023-10-21T16:27:53.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.917+0000 7fdbb4283640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac065be0 con 0x7fdbac151780 2023-10-21T16:27:53.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.918+0000 7fdbb201f640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdbac1513a0 0x7fdbac157c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43142/0 (socket says 172.21.15.12:43142) 2023-10-21T16:27:53.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.918+0000 7fdbb201f640 1 -- 172.21.15.12:0/4194716731 learned_addr learned my addr 172.21.15.12:0/4194716731 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:53.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.921+0000 7fdbb181e640 1 --2- 172.21.15.12:0/4194716731 >> v2:172.21.15.12:3300/0 conn(0x7fdbac151780 0x7fdbac06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.980+0000 7fdbb181e640 1 -- 172.21.15.12:0/4194716731 >> v1:172.21.15.99:6789/0 conn(0x7fdbac1513a0 legacy=0x7fdbac157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.980+0000 7fdbb181e640 1 -- 172.21.15.12:0/4194716731 >> v1:172.21.15.12:6789/0 conn(0x7fdbac0b0ca0 legacy=0x7fdbac0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.981+0000 7fdbb181e640 1 -- 172.21.15.12:0/4194716731 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac065e80 con 0x7fdbac151780 2023-10-21T16:27:53.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:53.998+0000 7fdbb181e640 1 --2- 172.21.15.12:0/4194716731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac151780 0x7fdbac06adf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0097a0 tx=0x7fdb9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fe072e251cf03b server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.019+0000 7fdbb101d640 1 -- 172.21.15.12:0/4194716731 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c031830 con 0x7fdbac151780 2023-10-21T16:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.019+0000 7fdbb101d640 1 -- 172.21.15.12:0/4194716731 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c031990 con 0x7fdbac151780 2023-10-21T16:27:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.019+0000 7fdbb101d640 1 -- 172.21.15.12:0/4194716731 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c031d20 con 0x7fdbac151780 2023-10-21T16:27:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.020+0000 7fdbb4283640 1 -- 172.21.15.12:0/4194716731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac151780 msgr2=0x7fdbac06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.020+0000 7fdbb4283640 1 --2- 172.21.15.12:0/4194716731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac151780 0x7fdbac06adf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0097a0 tx=0x7fdb9c02b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.021+0000 7fdbb4283640 1 -- 172.21.15.12:0/4194716731 shutdown_connections 2023-10-21T16:27:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.021+0000 7fdbb4283640 1 --2- 172.21.15.12:0/4194716731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac151780 0x7fdbac06adf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.021+0000 7fdbb4283640 1 -- 172.21.15.12:0/4194716731 >> 172.21.15.12:0/4194716731 conn(0x7fdbac06c450 msgr2=0x7fdbac06c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.021+0000 7fdbb4283640 1 -- 172.21.15.12:0/4194716731 shutdown_connections 2023-10-21T16:27:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.021+0000 7fdbb4283640 1 -- 172.21.15.12:0/4194716731 wait complete. 2023-10-21T16:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.024+0000 7fdbb4283640 1 Processor -- start 2023-10-21T16:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.025+0000 7fdbb4283640 1 -- start start 2023-10-21T16:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac0b0ca0 0x7fdbac1e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbac151780 0x7fdbac0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac155bb0 con 0x7fdbac0b0ca0 2023-10-21T16:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1f1a40 con 0x7fdbac151780 2023-10-21T16:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.026+0000 7fdbb4283640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1f1ce0 con 0x7fdbac1513a0 2023-10-21T16:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.027+0000 7fdbb181e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.027+0000 7fdbb2820640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbac151780 0x7fdbac0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.027+0000 7fdbb181e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55260/0 (socket says 172.21.15.12:55260) 2023-10-21T16:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.027+0000 7fdbb181e640 1 -- 172.21.15.12:0/2145999630 learned_addr learned my addr 172.21.15.12:0/2145999630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.029+0000 7fdbb201f640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac0b0ca0 0x7fdbac1e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.031+0000 7fdbb181e640 1 -- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbac151780 msgr2=0x7fdbac0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.031+0000 7fdbb181e640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbac151780 0x7fdbac0c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.031+0000 7fdbb181e640 1 -- 172.21.15.12:0/2145999630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac0b0ca0 msgr2=0x7fdbac1e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.031+0000 7fdbb181e640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac0b0ca0 0x7fdbac1e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.031+0000 7fdbb181e640 1 -- 172.21.15.12:0/2145999630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009400 con 0x7fdbac1513a0 2023-10-21T16:27:54.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.033+0000 7fdbb181e640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c034040 tx=0x7fdb9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.036+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c03abe0 con 0x7fdbac1513a0 2023-10-21T16:27:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.036+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c03ad60 con 0x7fdbac1513a0 2023-10-21T16:27:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.036+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c044640 con 0x7fdbac1513a0 2023-10-21T16:27:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.037+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac14e510 con 0x7fdbac1513a0 2023-10-21T16:27:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.037+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac14ead0 con 0x7fdbac1513a0 2023-10-21T16:27:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.038+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0619f0 con 0x7fdbac1513a0 2023-10-21T16:27:54.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.060+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb9c04d440 con 0x7fdbac1513a0 2023-10-21T16:27:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.061+0000 7fdba2ffd640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 0x7fdb9006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.061+0000 7fdbb201f640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 0x7fdb9006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.062+0000 7fdbb201f640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 0x7fdb9006d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005880 tx=0x7fdba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:54.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.303+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb9c07b100 con 0x7fdbac1513a0 2023-10-21T16:27:54.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.313+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb9c076d40 con 0x7fdbac1513a0 2023-10-21T16:27:54.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.549+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdbac1e1110 con 0x7fdbac1513a0 2023-10-21T16:27:54.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.569+0000 7fdba2ffd640 1 -- 172.21.15.12:0/2145999630 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb9c035070 con 0x7fdbac1513a0 2023-10-21T16:27:54.571 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-21T16:27:54.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 msgr2=0x7fdb9006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 0x7fdb9006d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005880 tx=0x7fdba8009040 comp rx=0 tx=0).stop 2023-10-21T16:27:54.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 msgr2=0x7fdbac0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c034040 tx=0x7fdb9c0046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 shutdown_connections 2023-10-21T16:27:54.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdb9006aec0 0x7fdb9006d380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbac151780 0x7fdbac0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbac1513a0 0x7fdbac0c9810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 --2- 172.21.15.12:0/2145999630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac0b0ca0 0x7fdbac1e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 >> 172.21.15.12:0/2145999630 conn(0x7fdbac06c450 msgr2=0x7fdbac157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:54.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.572+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 shutdown_connections 2023-10-21T16:27:54.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.573+0000 7fdbb4283640 1 -- 172.21.15.12:0/2145999630 wait complete. 2023-10-21T16:27:54.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-21T16:27:54.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.828+0000 7f9c4bfff640 1 Processor -- start 2023-10-21T16:27:54.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.829+0000 7f9c4bfff640 1 -- start start 2023-10-21T16:27:54.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.830+0000 7f9c4bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c4c150f00 0x7f9c4c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.830+0000 7f9c4bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c156d00 0x7f9c4c157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.830+0000 7f9c4bfff640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0c4d10 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.830+0000 7f9c4bfff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0c59a0 con 0x7f9c4c150f00 2023-10-21T16:27:54.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.830+0000 7f9c4bfff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1576d0 con 0x7f9c4c156d00 2023-10-21T16:27:54.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.831+0000 7f9c4affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c4c150f00 0x7f9c4c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.831+0000 7f9c4b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c156d00 0x7f9c4c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.831+0000 7f9c4affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c4c150f00 0x7f9c4c15ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59472/0 (socket says 172.21.15.12:59472) 2023-10-21T16:27:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.831+0000 7f9c4affd640 1 -- 172.21.15.12:0/1653663817 learned_addr learned my addr 172.21.15.12:0/1653663817 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.834+0000 7f9c4affd640 1 -- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c156d00 msgr2=0x7f9c4c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.834+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c156d00 0x7f9c4c157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.834+0000 7f9c4affd640 1 -- 172.21.15.12:0/1653663817 >> v1:172.21.15.12:6789/0 conn(0x7f9c4c0c6af0 legacy=0x7f9c4c0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.834+0000 7f9c4affd640 1 -- 172.21.15.12:0/1653663817 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c1512e0 con 0x7f9c4c150f00 2023-10-21T16:27:54.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.836+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c15ac20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009850 tx=0x7f9c3c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0792158bf17950f server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:54.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.840+0000 7f9c4a7fc640 1 -- 172.21.15.12:0/1653663817 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c004230 con 0x7f9c4c150f00 2023-10-21T16:27:54.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.840+0000 7f9c4a7fc640 1 -- 172.21.15.12:0/1653663817 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c004390 con 0x7f9c4c150f00 2023-10-21T16:27:54.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.840+0000 7f9c4a7fc640 1 -- 172.21.15.12:0/1653663817 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c031830 con 0x7f9c4c150f00 2023-10-21T16:27:54.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 msgr2=0x7f9c4c15ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c15ac20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009850 tx=0x7f9c3c02b8d0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1653663817 shutdown_connections 2023-10-21T16:27:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c156d00 0x7f9c4c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1653663817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c15ac20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1653663817 >> 172.21.15.12:0/1653663817 conn(0x7f9c4c065ab0 msgr2=0x7f9c4c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1653663817 shutdown_connections 2023-10-21T16:27:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.841+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1653663817 wait complete. 2023-10-21T16:27:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.843+0000 7f9c4bfff640 1 Processor -- start 2023-10-21T16:27:54.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.844+0000 7f9c4bfff640 1 -- start start 2023-10-21T16:27:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.844+0000 7f9c4bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.844+0000 7f9c4bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c1ea840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c156d00 0x7f9c4c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4bfff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c151d90 con 0x7f9c4c156d00 2023-10-21T16:27:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4bfff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c158720 con 0x7f9c4c150f00 2023-10-21T16:27:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4bfff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c14af00 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4affd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c1ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c156d00 0x7f9c4c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4affd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55272/0 (socket says 172.21.15.12:55272) 2023-10-21T16:27:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c1ea840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59478/0 (socket says 172.21.15.12:59478) 2023-10-21T16:27:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.845+0000 7f9c4affd640 1 -- 172.21.15.12:0/1579136685 learned_addr learned my addr 172.21.15.12:0/1579136685 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.849+0000 7f9c4affd640 1 -- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 msgr2=0x7f9c4c1ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.849+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c1ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.849+0000 7f9c4affd640 1 -- 172.21.15.12:0/1579136685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c156d00 msgr2=0x7f9c4c14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.849+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c156d00 0x7f9c4c14cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.849+0000 7f9c4affd640 1 -- 172.21.15.12:0/1579136685 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009460 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.851+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009970 tx=0x7f9c3c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.855+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c031630 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.855+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c03f070 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.855+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0319b0 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.855+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c1ea060 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.855+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c154f10 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.856+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c067560 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.874+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c3c041030 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.875+0000 7f9c48ff9640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 0x7f9c2c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.876+0000 7f9c43fff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 0x7f9c2c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.876+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c3c07a870 con 0x7f9c4c0c6af0 2023-10-21T16:27:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:54.877+0000 7f9c43fff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 0x7f9c2c06d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c1566f0 tx=0x7f9c34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:55.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.110+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c3c076bb0 con 0x7f9c4c0c6af0 2023-10-21T16:27:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.370+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c4c158180 con 0x7f9c4c0c6af0 2023-10-21T16:27:55.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.376+0000 7f9c48ff9640 1 -- 172.21.15.12:0/1579136685 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c3c07a1d0 con 0x7f9c4c0c6af0 2023-10-21T16:27:55.378 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-21T16:27:55.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.378+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 msgr2=0x7f9c2c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 0x7f9c2c06d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c1566f0 tx=0x7f9c34009040 comp rx=0 tx=0).stop 2023-10-21T16:27:55.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 msgr2=0x7f9c4c14a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009970 tx=0x7f9c3c0046c0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 shutdown_connections 2023-10-21T16:27:55.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9c2c06aec0 0x7f9c2c06d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c156d00 0x7f9c4c14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c4c150f00 0x7f9c4c1ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 --2- 172.21.15.12:0/1579136685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c4c0c6af0 0x7f9c4c14a9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 >> 172.21.15.12:0/1579136685 conn(0x7f9c4c065ab0 msgr2=0x7f9c4c0c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 shutdown_connections 2023-10-21T16:27:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.379+0000 7f9c4bfff640 1 -- 172.21.15.12:0/1579136685 wait complete. 2023-10-21T16:27:55.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-21T16:27:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.640+0000 7f4c42e75640 1 Processor -- start 2023-10-21T16:27:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.640+0000 7f4c42e75640 1 -- start start 2023-10-21T16:27:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.642+0000 7f4c42e75640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c3c0c8dc0 0x7f4c3c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.642+0000 7f4c42e75640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c159320 con 0x7f4c3c156820 2023-10-21T16:27:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.642+0000 7f4c42e75640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c15a140 con 0x7f4c3c070530 2023-10-21T16:27:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.642+0000 7f4c42e75640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3c0709c0 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.643+0000 7f4c41412640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4c3c070530 0x7f4c3c15ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43146/0 (socket says 172.21.15.12:43146) 2023-10-21T16:27:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.643+0000 7f4c41412640 1 -- 172.21.15.12:0/1572068848 learned_addr learned my addr 172.21.15.12:0/1572068848 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.643+0000 7f4c3bfff640 1 --2- 172.21.15.12:0/1572068848 >> v2:172.21.15.99:3300/0 conn(0x7f4c3c0c8dc0 0x7f4c3c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.646+0000 7f4c3bfff640 1 -- 172.21.15.12:0/1572068848 >> v1:172.21.15.99:6789/0 conn(0x7f4c3c070530 legacy=0x7f4c3c15ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.646+0000 7f4c3bfff640 1 -- 172.21.15.12:0/1572068848 >> v1:172.21.15.12:6789/0 conn(0x7f4c3c156820 legacy=0x7f4c3c0c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:55.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.646+0000 7f4c3bfff640 1 -- 172.21.15.12:0/1572068848 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c1595c0 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.651+0000 7f4c3bfff640 1 --2- 172.21.15.12:0/1572068848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c06fff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c2402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ae56dabcd79188 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.656+0000 7f4c3b7fe640 1 -- 172.21.15.12:0/1572068848 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2402cd00 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.656+0000 7f4c3b7fe640 1 -- 172.21.15.12:0/1572068848 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2402ce60 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.656+0000 7f4c3b7fe640 1 -- 172.21.15.12:0/1572068848 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24034660 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 -- 172.21.15.12:0/1572068848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 msgr2=0x7f4c3c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 --2- 172.21.15.12:0/1572068848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c06fff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c2402bf50 comp rx=0 tx=0).stop 2023-10-21T16:27:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 -- 172.21.15.12:0/1572068848 shutdown_connections 2023-10-21T16:27:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 --2- 172.21.15.12:0/1572068848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c06fff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 -- 172.21.15.12:0/1572068848 >> 172.21.15.12:0/1572068848 conn(0x7f4c3c069de0 msgr2=0x7f4c3c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 -- 172.21.15.12:0/1572068848 shutdown_connections 2023-10-21T16:27:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.657+0000 7f4c42e75640 1 -- 172.21.15.12:0/1572068848 wait complete. 2023-10-21T16:27:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.660+0000 7f4c42e75640 1 Processor -- start 2023-10-21T16:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.660+0000 7f4c42e75640 1 -- start start 2023-10-21T16:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c3c070530 0x7f4c3c0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ad810 con 0x7f4c3c070530 2023-10-21T16:27:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ae4e0 con 0x7f4c3c0c8dc0 2023-10-21T16:27:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.661+0000 7f4c42e75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0adf20 con 0x7f4c3c156820 2023-10-21T16:27:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.662+0000 7f4c41412640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.662+0000 7f4c3bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.663+0000 7f4c41412640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55286/0 (socket says 172.21.15.12:55286) 2023-10-21T16:27:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.663+0000 7f4c41412640 1 -- 172.21.15.12:0/3169203709 learned_addr learned my addr 172.21.15.12:0/3169203709 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.663+0000 7f4c3bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c15ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59502/0 (socket says 172.21.15.12:59502) 2023-10-21T16:27:55.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.666+0000 7f4c41412640 1 -- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 msgr2=0x7f4c3c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.666+0000 7f4c41412640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.666+0000 7f4c41412640 1 -- 172.21.15.12:0/3169203709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c3c070530 msgr2=0x7f4c3c0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:55.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.666+0000 7f4c41412640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c3c070530 0x7f4c3c0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:55.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.666+0000 7f4c41412640 1 -- 172.21.15.12:0/3169203709 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009a70 con 0x7f4c3c156820 2023-10-21T16:27:55.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.669+0000 7f4c41412640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c3c0 tx=0x7f4c2c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.671+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c005ce0 con 0x7f4c3c156820 2023-10-21T16:27:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.671+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c1e4e30 con 0x7f4c3c156820 2023-10-21T16:27:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.671+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c0ae780 con 0x7f4c3c156820 2023-10-21T16:27:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.673+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c005e40 con 0x7f4c3c156820 2023-10-21T16:27:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.673+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c1f1cb0 con 0x7f4c3c156820 2023-10-21T16:27:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.674+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0072d0 con 0x7f4c3c156820 2023-10-21T16:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.923+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c2c0074f0 con 0x7f4c3c156820 2023-10-21T16:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.926+0000 7f4c397fa640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 0x7f4c1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.927+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c2c089070 con 0x7f4c3c156820 2023-10-21T16:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.927+0000 7f4c40c11640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 0x7f4c1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:55.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.928+0000 7f4c40c11640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 0x7f4c1c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009650 tx=0x7f4c34006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:55.935+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c2c054340 con 0x7f4c3c156820 2023-10-21T16:27:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.143+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c3c159b50 con 0x7f4c3c156820 2023-10-21T16:27:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.148+0000 7f4c397fa640 1 -- 172.21.15.12:0/3169203709 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c2c021020 con 0x7f4c3c156820 2023-10-21T16:27:56.151 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-21T16:27:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 msgr2=0x7f4c1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 0x7f4c1c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009650 tx=0x7f4c34006ba0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 msgr2=0x7f4c3c1e4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c3c0 tx=0x7f4c2c00c880 comp rx=0 tx=0).stop 2023-10-21T16:27:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 shutdown_connections 2023-10-21T16:27:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f4c1c06ae70 0x7f4c1c06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3c156820 0x7f4c3c1e4210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3c0c8dc0 0x7f4c3c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 --2- 172.21.15.12:0/3169203709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c3c070530 0x7f4c3c0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 >> 172.21.15.12:0/3169203709 conn(0x7f4c3c069de0 msgr2=0x7f4c3c154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 shutdown_connections 2023-10-21T16:27:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.151+0000 7f4c42e75640 1 -- 172.21.15.12:0/3169203709 wait complete. 2023-10-21T16:27:56.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:27:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.421+0000 7fcfa7ca9640 1 Processor -- start 2023-10-21T16:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.421+0000 7fcfa7ca9640 1 -- start start 2023-10-21T16:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.422+0000 7fcfa7ca9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcfa00c55f0 0x7fcfa0157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.422+0000 7fcfa7ca9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00c23f0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.422+0000 7fcfa7ca9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa0156fa0 con 0x7fcfa0157cc0 2023-10-21T16:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.422+0000 7fcfa7ca9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa015aaf0 con 0x7fcfa00c55f0 2023-10-21T16:27:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.423+0000 7fcfa5a45640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcfa00c55f0 0x7fcfa0157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.423+0000 7fcfa5244640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcfa0157cc0 0x7fcfa0150de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43150/0 (socket says 172.21.15.12:43150) 2023-10-21T16:27:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.423+0000 7fcfa5244640 1 -- 172.21.15.12:0/263438325 learned_addr learned my addr 172.21.15.12:0/263438325 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.426+0000 7fcfa5a45640 1 -- 172.21.15.12:0/263438325 >> v1:172.21.15.99:6789/0 conn(0x7fcfa0157cc0 legacy=0x7fcfa0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.426+0000 7fcfa5a45640 1 -- 172.21.15.12:0/263438325 >> v1:172.21.15.12:6789/0 conn(0x7fcfa00c59d0 legacy=0x7fcfa00c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.426+0000 7fcfa5a45640 1 -- 172.21.15.12:0/263438325 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa015add0 con 0x7fcfa00c55f0 2023-10-21T16:27:56.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.432+0000 7fcfa5a45640 1 --2- 172.21.15.12:0/263438325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c55f0 0x7fcfa0157780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0097a0 tx=0x7fcf9c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28e0d88cdffc8f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:56.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.436+0000 7fcfa4a43640 1 -- 172.21.15.12:0/263438325 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c030610 con 0x7fcfa00c55f0 2023-10-21T16:27:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.436+0000 7fcfa4a43640 1 -- 172.21.15.12:0/263438325 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c030770 con 0x7fcfa00c55f0 2023-10-21T16:27:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.436+0000 7fcfa4a43640 1 -- 172.21.15.12:0/263438325 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c030b00 con 0x7fcfa00c55f0 2023-10-21T16:27:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/263438325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c55f0 msgr2=0x7fcfa0157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/263438325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c55f0 0x7fcfa0157780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0097a0 tx=0x7fcf9c02b960 comp rx=0 tx=0).stop 2023-10-21T16:27:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/263438325 shutdown_connections 2023-10-21T16:27:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/263438325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c55f0 0x7fcfa0157780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/263438325 >> 172.21.15.12:0/263438325 conn(0x7fcfa0069de0 msgr2=0x7fcfa006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:56.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/263438325 shutdown_connections 2023-10-21T16:27:56.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.437+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/263438325 wait complete. 2023-10-21T16:27:56.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.439+0000 7fcfa7ca9640 1 Processor -- start 2023-10-21T16:27:56.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.439+0000 7fcfa7ca9640 1 -- start start 2023-10-21T16:27:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 0x7fcfa0147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa0157cc0 0x7fcfa00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0151ca0 con 0x7fcfa0157cc0 2023-10-21T16:27:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa015a020 con 0x7fcfa00c59d0 2023-10-21T16:27:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.440+0000 7fcfa7ca9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01478b0 con 0x7fcfa00c55f0 2023-10-21T16:27:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.441+0000 7fcfa5244640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.441+0000 7fcfa5a45640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 0x7fcfa0147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.441+0000 7fcfa5244640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59514/0 (socket says 172.21.15.12:59514) 2023-10-21T16:27:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.441+0000 7fcfa6246640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa0157cc0 0x7fcfa00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.441+0000 7fcfa5244640 1 -- 172.21.15.12:0/1946721733 learned_addr learned my addr 172.21.15.12:0/1946721733 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5244640 1 -- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 msgr2=0x7fcfa0147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5244640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 0x7fcfa0147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5244640 1 -- 172.21.15.12:0/1946721733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa0157cc0 msgr2=0x7fcfa00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5244640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa0157cc0 0x7fcfa00c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5244640 1 -- 172.21.15.12:0/1946721733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009400 con 0x7fcfa00c59d0 2023-10-21T16:27:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.444+0000 7fcfa5a45640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 0x7fcfa0147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:27:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.448+0000 7fcfa5244640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c480 tx=0x7fcf9000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.452+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90005ce0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.452+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90005e40 con 0x7fcfa00c59d0 2023-10-21T16:27:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.452+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900072f0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.452+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa01ed8f0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.452+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa01ecd70 con 0x7fcfa00c59d0 2023-10-21T16:27:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.453+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00619f0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.472+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf90007510 con 0x7fcfa00c59d0 2023-10-21T16:27:56.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.473+0000 7fcf967fc640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 0x7fcf8406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:56.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.474+0000 7fcfa5a45640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 0x7fcf8406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:56.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.474+0000 7fcfa5a45640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 0x7fcf8406d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c036000 tx=0x7fcf9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:56.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.702+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcf90057e20 con 0x7fcfa00c59d0 2023-10-21T16:27:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.715+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf90054160 con 0x7fcfa00c59d0 2023-10-21T16:27:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.956+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfa0149ae0 con 0x7fcfa00c59d0 2023-10-21T16:27:56.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.977+0000 7fcf967fc640 1 -- 172.21.15.12:0/1946721733 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6485 (secure 0 0 0) 0x7fcf90057780 con 0x7fcfa00c59d0 2023-10-21T16:27:56.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:56.979 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T16:27:39.342620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T16:27:56.980 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-21T16:27:56.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 msgr2=0x7fcf8406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 0x7fcf8406d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c036000 tx=0x7fcf9c008030 comp rx=0 tx=0).stop 2023-10-21T16:27:56.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 msgr2=0x7fcfa015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:56.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c480 tx=0x7fcf9000c940 comp rx=0 tx=0).stop 2023-10-21T16:27:56.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 shutdown_connections 2023-10-21T16:27:56.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf8406aec0 0x7fcf8406d380 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa0157cc0 0x7fcfa00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfa00c59d0 0x7fcfa015a220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 --2- 172.21.15.12:0/1946721733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcfa00c55f0 0x7fcfa0147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:56.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 >> 172.21.15.12:0/1946721733 conn(0x7fcfa0069de0 msgr2=0x7fcfa00c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:56.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 shutdown_connections 2023-10-21T16:27:56.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:56.980+0000 7fcfa7ca9640 1 -- 172.21.15.12:0/1946721733 wait complete. 2023-10-21T16:27:57.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.213+0000 7f7f3d50a640 1 Processor -- start 2023-10-21T16:27:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.213+0000 7f7f3d50a640 1 -- start start 2023-10-21T16:27:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f38157850 0x7f7f3815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f3806fb50 0x7f7f380ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f38070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f38157c30 con 0x7f7f3806fb50 2023-10-21T16:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3815e420 con 0x7f7f38157850 2023-10-21T16:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.215+0000 7f7f3d50a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38161940 con 0x7f7f380cad00 2023-10-21T16:27:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.216+0000 7f7f37fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f38157850 0x7f7f3815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.216+0000 7f7f3cd09640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f38070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.216+0000 7f7f37fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f38157850 0x7f7f3815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59526/0 (socket says 172.21.15.12:59526) 2023-10-21T16:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.216+0000 7f7f37fff640 1 -- 172.21.15.12:0/1782366848 learned_addr learned my addr 172.21.15.12:0/1782366848 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.216+0000 7f7f377fe640 1 --2- 172.21.15.12:0/1782366848 >> v2:172.21.15.12:3300/0 conn(0x7f7f3806fb50 0x7f7f380ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.218+0000 7f7f37fff640 1 -- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 msgr2=0x7f7f38070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.218+0000 7f7f37fff640 1 --2- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f38070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.218+0000 7f7f37fff640 1 -- 172.21.15.12:0/1782366848 >> v2:172.21.15.12:3300/0 conn(0x7f7f3806fb50 msgr2=0x7f7f380ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.218+0000 7f7f37fff640 1 --2- 172.21.15.12:0/1782366848 >> v2:172.21.15.12:3300/0 conn(0x7f7f3806fb50 0x7f7f380ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.218+0000 7f7f37fff640 1 -- 172.21.15.12:0/1782366848 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380706a0 con 0x7f7f38157850 2023-10-21T16:27:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.220+0000 7f7f37fff640 1 --2- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f38157850 0x7f7f3815dee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f380c6ef0 tx=0x7f7f2802b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f6b972bc39d689 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.222+0000 7f7f36ffd640 1 -- 172.21.15.12:0/1782366848 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28031740 con 0x7f7f38157850 2023-10-21T16:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.223+0000 7f7f36ffd640 1 -- 172.21.15.12:0/1782366848 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f280318a0 con 0x7f7f38157850 2023-10-21T16:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.223+0000 7f7f36ffd640 1 -- 172.21.15.12:0/1782366848 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28031c30 con 0x7f7f38157850 2023-10-21T16:27:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f38157850 msgr2=0x7f7f3815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f38157850 0x7f7f3815dee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f380c6ef0 tx=0x7f7f2802b7e0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1782366848 shutdown_connections 2023-10-21T16:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f38070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1782366848 >> v2:172.21.15.12:3300/0 conn(0x7f7f3806fb50 0x7f7f380ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1782366848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f38157850 0x7f7f3815dee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1782366848 >> 172.21.15.12:0/1782366848 conn(0x7f7f3806bac0 msgr2=0x7f7f3806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.224+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1782366848 shutdown_connections 2023-10-21T16:27:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.225+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1782366848 wait complete. 2023-10-21T16:27:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.226+0000 7f7f3d50a640 1 Processor -- start 2023-10-21T16:27:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.226+0000 7f7f3d50a640 1 -- start start 2023-10-21T16:27:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 0x7f7f38151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f381f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f38157850 0x7f7f381f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3815b990 con 0x7f7f38157850 2023-10-21T16:27:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f381f6ec0 con 0x7f7f3806fb50 2023-10-21T16:27:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.227+0000 7f7f3d50a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3815ae10 con 0x7f7f380cad00 2023-10-21T16:27:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.228+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 0x7f7f38151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.228+0000 7f7f377fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f381f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.228+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 0x7f7f38151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59532/0 (socket says 172.21.15.12:59532) 2023-10-21T16:27:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.228+0000 7f7f37fff640 1 -- 172.21.15.12:0/1877569234 learned_addr learned my addr 172.21.15.12:0/1877569234 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.228+0000 7f7f3cd09640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f38157850 0x7f7f381f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.232+0000 7f7f377fe640 1 -- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 msgr2=0x7f7f38151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.232+0000 7f7f377fe640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 0x7f7f38151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.232+0000 7f7f377fe640 1 -- 172.21.15.12:0/1877569234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f38157850 msgr2=0x7f7f381f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.232+0000 7f7f377fe640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f38157850 0x7f7f381f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.232+0000 7f7f377fe640 1 -- 172.21.15.12:0/1877569234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280094d0 con 0x7f7f380cad00 2023-10-21T16:27:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.234+0000 7f7f377fe640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f381f4870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00ead0 tx=0x7f7f2c00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.238+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c010040 con 0x7f7f380cad00 2023-10-21T16:27:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.238+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00bc80 con 0x7f7f380cad00 2023-10-21T16:27:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.238+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c014400 con 0x7f7f380cad00 2023-10-21T16:27:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.238+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f38158270 con 0x7f7f380cad00 2023-10-21T16:27:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.238+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f381f6be0 con 0x7f7f380cad00 2023-10-21T16:27:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.239+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f38067560 con 0x7f7f380cad00 2023-10-21T16:27:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.258+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f2c014560 con 0x7f7f380cad00 2023-10-21T16:27:57.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.259+0000 7f7f34ff9640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 0x7f7f2406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:57.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.259+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7f2c0591a0 con 0x7f7f380cad00 2023-10-21T16:27:57.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.259+0000 7f7f37fff640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 0x7f7f2406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.261+0000 7f7f37fff640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 0x7f7f2406d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f28036040 tx=0x7f7f28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:57.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.498+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f2c0554e0 con 0x7f7f380cad00 2023-10-21T16:27:57.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.718+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f380c4920 con 0x7f7f380cad00 2023-10-21T16:27:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.847+0000 7f7f34ff9640 1 -- 172.21.15.12:0/1877569234 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16520 (secure 0 0 0) 0x7f7f2c058b00 con 0x7f7f380cad00 2023-10-21T16:27:57.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:27:57.850 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:57.353629+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:27:57.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 msgr2=0x7f7f2406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:57.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 0x7f7f2406d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f28036040 tx=0x7f7f28008030 comp rx=0 tx=0).stop 2023-10-21T16:27:57.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 msgr2=0x7f7f381f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f381f4870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00ead0 tx=0x7f7f2c00ef90 comp rx=0 tx=0).stop 2023-10-21T16:27:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 shutdown_connections 2023-10-21T16:27:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7f2406aec0 0x7f7f2406d380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f38157850 0x7f7f381f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f380cad00 0x7f7f381f4870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 --2- 172.21.15.12:0/1877569234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3806fb50 0x7f7f38151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 >> 172.21.15.12:0/1877569234 conn(0x7f7f3806bac0 msgr2=0x7f7f380c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 shutdown_connections 2023-10-21T16:27:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:57.852+0000 7f7f3d50a640 1 -- 172.21.15.12:0/1877569234 wait complete. 2023-10-21T16:27:57.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-21T16:27:08.552678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-21T16:27:27.920466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-21T16:27:29.996993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-21T16:27:57.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-21T16:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.095+0000 7fd45b92c640 1 Processor -- start 2023-10-21T16:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.095+0000 7fd45b92c640 1 -- start start 2023-10-21T16:27:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd45b92c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd4540c7010 0x7fd4540c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd45b92c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4540c10c0 0x7fd45415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd45b92c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd454157750 con 0x7fd4540c1a00 2023-10-21T16:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd45b92c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540723b0 con 0x7fd4540c10c0 2023-10-21T16:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd45b92c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540c7930 con 0x7fd4540c7010 2023-10-21T16:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.097+0000 7fd4596c8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd4540c7010 0x7fd4540c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.098+0000 7fd4596c8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd4540c7010 0x7fd4540c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59538/0 (socket says 172.21.15.12:59538) 2023-10-21T16:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.098+0000 7fd4596c8640 1 -- 172.21.15.12:0/975802014 learned_addr learned my addr 172.21.15.12:0/975802014 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.098+0000 7fd459ec9640 1 --2- 172.21.15.12:0/975802014 >> v2:172.21.15.12:3300/0 conn(0x7fd4540c10c0 0x7fd45415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.100+0000 7fd4596c8640 1 -- 172.21.15.12:0/975802014 >> v2:172.21.15.12:3300/0 conn(0x7fd4540c10c0 msgr2=0x7fd45415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:58.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.100+0000 7fd4596c8640 1 --2- 172.21.15.12:0/975802014 >> v2:172.21.15.12:3300/0 conn(0x7fd4540c10c0 0x7fd45415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.100+0000 7fd4596c8640 1 -- 172.21.15.12:0/975802014 >> v1:172.21.15.12:6789/0 conn(0x7fd4540c1a00 legacy=0x7fd454156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.100+0000 7fd4596c8640 1 -- 172.21.15.12:0/975802014 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454157a30 con 0x7fd4540c7010 2023-10-21T16:27:58.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.102+0000 7fd4596c8640 1 --2- 172.21.15.12:0/975802014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4540c73f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd45406ade0 tx=0x7fd45002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01652533296f664 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:58.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.106+0000 7fd44bfff640 1 -- 172.21.15.12:0/975802014 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45002cbb0 con 0x7fd4540c7010 2023-10-21T16:27:58.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.106+0000 7fd44bfff640 1 -- 172.21.15.12:0/975802014 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45002cd10 con 0x7fd4540c7010 2023-10-21T16:27:58.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.106+0000 7fd44bfff640 1 -- 172.21.15.12:0/975802014 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450034610 con 0x7fd4540c7010 2023-10-21T16:27:58.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 -- 172.21.15.12:0/975802014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 msgr2=0x7fd4540c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 --2- 172.21.15.12:0/975802014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4540c73f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd45406ade0 tx=0x7fd45002c010 comp rx=0 tx=0).stop 2023-10-21T16:27:58.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 -- 172.21.15.12:0/975802014 shutdown_connections 2023-10-21T16:27:58.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 --2- 172.21.15.12:0/975802014 >> v2:172.21.15.12:3300/0 conn(0x7fd4540c10c0 0x7fd45415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 --2- 172.21.15.12:0/975802014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4540c73f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 -- 172.21.15.12:0/975802014 >> 172.21.15.12:0/975802014 conn(0x7fd454069de0 msgr2=0x7fd45406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:58.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 -- 172.21.15.12:0/975802014 shutdown_connections 2023-10-21T16:27:58.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.107+0000 7fd45b92c640 1 -- 172.21.15.12:0/975802014 wait complete. 2023-10-21T16:27:58.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.109+0000 7fd45b92c640 1 Processor -- start 2023-10-21T16:27:58.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.109+0000 7fd45b92c640 1 -- start start 2023-10-21T16:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd4540c10c0 0x7fd454154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4540c1a00 0x7fd4541e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454156050 con 0x7fd4540c1a00 2023-10-21T16:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454155a90 con 0x7fd4540c7010 2023-10-21T16:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.110+0000 7fd45b92c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd454155d70 con 0x7fd4540c10c0 2023-10-21T16:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.111+0000 7fd458ec7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4540c1a00 0x7fd4541e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.111+0000 7fd459ec9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.111+0000 7fd4596c8640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd4540c10c0 0x7fd454154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.111+0000 7fd459ec9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59544/0 (socket says 172.21.15.12:59544) 2023-10-21T16:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.111+0000 7fd459ec9640 1 -- 172.21.15.12:0/1928000239 learned_addr learned my addr 172.21.15.12:0/1928000239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.114+0000 7fd459ec9640 1 -- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd4540c10c0 msgr2=0x7fd454154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.114+0000 7fd459ec9640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd4540c10c0 0x7fd454154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.114+0000 7fd459ec9640 1 -- 172.21.15.12:0/1928000239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4540c1a00 msgr2=0x7fd4541e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.114+0000 7fd459ec9640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4540c1a00 0x7fd4541e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.114+0000 7fd459ec9640 1 -- 172.21.15.12:0/1928000239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009b30 con 0x7fd4540c7010 2023-10-21T16:27:58.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.117+0000 7fd459ec9640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00d580 tx=0x7fd44c00da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.121+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0125f0 con 0x7fd4540c7010 2023-10-21T16:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.121+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c012770 con 0x7fd4540c7010 2023-10-21T16:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.121+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c012b20 con 0x7fd4540c7010 2023-10-21T16:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.121+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd454159c10 con 0x7fd4540c7010 2023-10-21T16:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.121+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45414e9f0 con 0x7fd4540c7010 2023-10-21T16:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.122+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45415a130 con 0x7fd4540c7010 2023-10-21T16:27:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.141+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd44c012c80 con 0x7fd4540c7010 2023-10-21T16:27:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.143+0000 7fd449ffb640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 0x7fd43806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.143+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd44c08a140 con 0x7fd4540c7010 2023-10-21T16:27:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.144+0000 7fd4596c8640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 0x7fd43806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.145+0000 7fd4596c8640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 0x7fd43806d380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd450035000 tx=0x7fd450030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.378+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd44c0553d0 con 0x7fd4540c7010 2023-10-21T16:27:58.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.587+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd45415a130 con 0x7fd4540c7010 2023-10-21T16:27:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.608+0000 7fd449ffb640 1 -- 172.21.15.12:0/1928000239 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd45415a130 con 0x7fd4540c7010 2023-10-21T16:27:58.610 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-21T16:27:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 msgr2=0x7fd43806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 0x7fd43806d380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd450035000 tx=0x7fd450030000 comp rx=0 tx=0).stop 2023-10-21T16:27:58.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 msgr2=0x7fd4541e4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00d580 tx=0x7fd44c00da40 comp rx=0 tx=0).stop 2023-10-21T16:27:58.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 shutdown_connections 2023-10-21T16:27:58.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd43806aec0 0x7fd43806d380 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4540c7010 0x7fd4541e4180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4540c1a00 0x7fd4541e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 --2- 172.21.15.12:0/1928000239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd4540c10c0 0x7fd454154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 >> 172.21.15.12:0/1928000239 conn(0x7fd454069de0 msgr2=0x7fd45414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:58.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 shutdown_connections 2023-10-21T16:27:58.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.611+0000 7fd45b92c640 1 -- 172.21.15.12:0/1928000239 wait complete. 2023-10-21T16:27:58.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-21T16:27:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.853+0000 7f46ba93c640 1 Processor -- start 2023-10-21T16:27:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.853+0000 7f46ba93c640 1 -- start start 2023-10-21T16:27:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.855+0000 7f46ba93c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46b414fe80 0x7f46b40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.855+0000 7f46ba93c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4150260 con 0x7f46b4159170 2023-10-21T16:27:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.855+0000 7f46ba93c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40c5ad0 con 0x7f46b4069fd0 2023-10-21T16:27:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.855+0000 7f46ba93c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b40c6370 con 0x7f46b414fe80 2023-10-21T16:27:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.855+0000 7f46ba13b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f46b4069fd0 0x7f46b40c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43156/0 (socket says 172.21.15.12:43156) 2023-10-21T16:27:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.856+0000 7f46ba13b640 1 -- 172.21.15.12:0/4050527521 learned_addr learned my addr 172.21.15.12:0/4050527521 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:27:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.856+0000 7f46b993a640 1 --2- 172.21.15.12:0/4050527521 >> v2:172.21.15.12:3300/0 conn(0x7f46b414fe80 0x7f46b40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.858+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406690528 0 0) 0x7f46b40c5ad0 con 0x7f46b4069fd0 2023-10-21T16:27:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.858+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a0003520 con 0x7f46b4069fd0 2023-10-21T16:27:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.860+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111542040 0 0) 0x7f46b4150260 con 0x7f46b4159170 2023-10-21T16:27:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.860+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b40c5ad0 con 0x7f46b4159170 2023-10-21T16:27:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30392381 0 0) 0x7f46a0003520 con 0x7f46b4069fd0 2023-10-21T16:27:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 >> v2:172.21.15.12:3300/0 conn(0x7f46b414fe80 msgr2=0x7f46b40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 --2- 172.21.15.12:0/4050527521 >> v2:172.21.15.12:3300/0 conn(0x7f46b414fe80 0x7f46b40c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 >> v1:172.21.15.12:6789/0 conn(0x7f46b4159170 legacy=0x7f46b4156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40c5db0 con 0x7f46b4069fd0 2023-10-21T16:27:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f46ac0019f0 con 0x7f46b4069fd0 2023-10-21T16:27:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.861+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 >> v1:172.21.15.99:6789/0 conn(0x7f46b4069fd0 legacy=0x7f46b40c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 0x7f46a0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a00047c0 0x7f46a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46a00051f0 0x7f46a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c6370 con 0x7f46a00051f0 2023-10-21T16:27:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a000c0b0 con 0x7f46a00047c0 2023-10-21T16:27:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a000c270 con 0x7f46a0003c30 2023-10-21T16:27:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.862+0000 7f46b993a640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 0x7f46a0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.864+0000 7f46b9139640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a00047c0 0x7f46a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46b993a640 1 -- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a00047c0 msgr2=0x7f46a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46b993a640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a00047c0 0x7f46a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46b993a640 1 -- 172.21.15.12:0/4050527521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46a00051f0 msgr2=0x7f46a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46b993a640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46a00051f0 0x7f46a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46b993a640 1 -- 172.21.15.12:0/4050527521 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0003520 con 0x7f46a0003c30 2023-10-21T16:27:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.865+0000 7f46ba13b640 1 -- 172.21.15.12:0/4050527521 reap_dead start 2023-10-21T16:27:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.867+0000 7f46b993a640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 0x7f46a0004030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ab0 tx=0x7f46a00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c9ae350c736aa server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.870+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005990 con 0x7f46a0003c30 2023-10-21T16:27:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.871+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0005af0 con 0x7f46a0003c30 2023-10-21T16:27:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.871+0000 7f46b8938640 1 -- 172.21.15.12:0/4050527521 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005ea0 con 0x7f46a0003c30 2023-10-21T16:27:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 -- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 msgr2=0x7f46a0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 0x7f46a0004030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ab0 tx=0x7f46a00057f0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 -- 172.21.15.12:0/4050527521 shutdown_connections 2023-10-21T16:27:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 --2- 172.21.15.12:0/4050527521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46a0003c30 0x7f46a0004030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 -- 172.21.15.12:0/4050527521 >> 172.21.15.12:0/4050527521 conn(0x7f46b4065ab0 msgr2=0x7f46b4065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 -- 172.21.15.12:0/4050527521 shutdown_connections 2023-10-21T16:27:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.872+0000 7f46ba93c640 1 -- 172.21.15.12:0/4050527521 wait complete. 2023-10-21T16:27:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.874+0000 7f46ba93c640 1 Processor -- start 2023-10-21T16:27:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.874+0000 7f46ba93c640 1 -- start start 2023-10-21T16:27:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46b4150470 0x7f46b40c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b4152540 0x7f46b41529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4153610 con 0x7f46b4152540 2023-10-21T16:27:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40cab70 con 0x7f46a0003c30 2023-10-21T16:27:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46ba93c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41ef450 con 0x7f46b4150470 2023-10-21T16:27:58.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.875+0000 7f46b993a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.876+0000 7f46ba13b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b4152540 0x7f46b41529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.876+0000 7f46b993a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59566/0 (socket says 172.21.15.12:59566) 2023-10-21T16:27:58.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.876+0000 7f46b993a640 1 -- 172.21.15.12:0/3264629648 learned_addr learned my addr 172.21.15.12:0/3264629648 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:58.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.876+0000 7f46b9139640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46b4150470 0x7f46b40c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.879+0000 7f46b993a640 1 -- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46b4150470 msgr2=0x7f46b40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.879+0000 7f46b993a640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46b4150470 0x7f46b40c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.879+0000 7f46b993a640 1 -- 172.21.15.12:0/3264629648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b4152540 msgr2=0x7f46b41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:58.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.879+0000 7f46b993a640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b4152540 0x7f46b41529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:58.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.879+0000 7f46b993a640 1 -- 172.21.15.12:0/3264629648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40c9a60 con 0x7f46a0003c30 2023-10-21T16:27:58.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.881+0000 7f46b993a640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46b0036040 tx=0x7f46b0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.885+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005e70 con 0x7f46a0003c30 2023-10-21T16:27:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.885+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0006030 con 0x7f46a0003c30 2023-10-21T16:27:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.885+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00063a0 con 0x7f46a0003c30 2023-10-21T16:27:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.885+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40c8310 con 0x7f46a0003c30 2023-10-21T16:27:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.885+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b40c85b0 con 0x7f46a0003c30 2023-10-21T16:27:58.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.886+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4066fe0 con 0x7f46a0003c30 2023-10-21T16:27:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.906+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46b0006500 con 0x7f46a0003c30 2023-10-21T16:27:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.908+0000 7f46aa7fc640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 0x7f469806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.909+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f46b00abec0 con 0x7f46a0003c30 2023-10-21T16:27:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.909+0000 7f46b9139640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 0x7f469806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:58.909+0000 7f46b9139640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 0x7f469806d3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46b4150850 tx=0x7f46a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.157+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46b00770c0 con 0x7f46a0003c30 2023-10-21T16:27:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.370+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46b4067560 con 0x7f46a0003c30 2023-10-21T16:27:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.375+0000 7f46aa7fc640 1 -- 172.21.15.12:0/3264629648 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46b007a6e0 con 0x7f46a0003c30 2023-10-21T16:27:59.376 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-21T16:27:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.377+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 msgr2=0x7f469806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.377+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 0x7f469806d3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46b4150850 tx=0x7f46a4009040 comp rx=0 tx=0).stop 2023-10-21T16:27:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.377+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 msgr2=0x7f46b41eef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.377+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46b0036040 tx=0x7f46b0004730 comp rx=0 tx=0).stop 2023-10-21T16:27:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 shutdown_connections 2023-10-21T16:27:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f469806aef0 0x7f469806d3b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b4152540 0x7f46b41529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f46b4150470 0x7f46b40c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 --2- 172.21.15.12:0/3264629648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46a0003c30 0x7f46b41eef10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 >> 172.21.15.12:0/3264629648 conn(0x7f46b4065ab0 msgr2=0x7f46b40c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 shutdown_connections 2023-10-21T16:27:59.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.378+0000 7f46ba93c640 1 -- 172.21.15.12:0/3264629648 wait complete. 2023-10-21T16:27:59.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-21T16:27:59.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.620+0000 7f8eeb202640 1 Processor -- start 2023-10-21T16:27:59.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.620+0000 7f8eeb202640 1 -- start start 2023-10-21T16:27:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.622+0000 7f8eeb202640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.622+0000 7f8eeb202640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee40c8ae0 0x7f8ee406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.622+0000 7f8eeb202640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee4159430 con 0x7f8ee41535c0 2023-10-21T16:27:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.622+0000 7f8eeb202640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee41596f0 con 0x7f8ee40c8ae0 2023-10-21T16:27:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.622+0000 7f8eeb202640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41599d0 con 0x7f8ee41531e0 2023-10-21T16:27:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.623+0000 7f8ee979f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee40c8ae0 0x7f8ee406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.623+0000 7f8ee8f9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.623+0000 7f8ee8f9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55360/0 (socket says 172.21.15.12:55360) 2023-10-21T16:27:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.623+0000 7f8ee8f9e640 1 -- 172.21.15.12:0/1553978558 learned_addr learned my addr 172.21.15.12:0/1553978558 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.626+0000 7f8ee8f9e640 1 -- 172.21.15.12:0/1553978558 >> v2:172.21.15.99:3300/0 conn(0x7f8ee40c8ae0 msgr2=0x7f8ee406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:27:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.626+0000 7f8ee8f9e640 1 --2- 172.21.15.12:0/1553978558 >> v2:172.21.15.99:3300/0 conn(0x7f8ee40c8ae0 0x7f8ee406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.626+0000 7f8ee8f9e640 1 -- 172.21.15.12:0/1553978558 >> v1:172.21.15.99:6789/0 conn(0x7f8ee41535c0 legacy=0x7f8ee40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.626+0000 7f8ee8f9e640 1 -- 172.21.15.12:0/1553978558 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4159cb0 con 0x7f8ee41531e0 2023-10-21T16:27:59.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.628+0000 7f8ee8f9e640 1 --2- 172.21.15.12:0/1553978558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80098a0 tx=0x7f8ed802ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb720430a71d68b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8ee37fe640 1 -- 172.21.15.12:0/1553978558 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed802f820 con 0x7f8ee41531e0 2023-10-21T16:27:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8ee37fe640 1 -- 172.21.15.12:0/1553978558 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed802f980 con 0x7f8ee41531e0 2023-10-21T16:27:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8ee37fe640 1 -- 172.21.15.12:0/1553978558 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed802fd10 con 0x7f8ee41531e0 2023-10-21T16:27:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 -- 172.21.15.12:0/1553978558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 msgr2=0x7f8ee406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1553978558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80098a0 tx=0x7f8ed802ba00 comp rx=0 tx=0).stop 2023-10-21T16:27:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 -- 172.21.15.12:0/1553978558 shutdown_connections 2023-10-21T16:27:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1553978558 >> v2:172.21.15.99:3300/0 conn(0x7f8ee40c8ae0 0x7f8ee406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1553978558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee41531e0 0x7f8ee406ef90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.632+0000 7f8eeb202640 1 -- 172.21.15.12:0/1553978558 >> 172.21.15.12:0/1553978558 conn(0x7f8ee406b0d0 msgr2=0x7f8ee406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:27:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.633+0000 7f8eeb202640 1 -- 172.21.15.12:0/1553978558 shutdown_connections 2023-10-21T16:27:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.633+0000 7f8eeb202640 1 -- 172.21.15.12:0/1553978558 wait complete. 2023-10-21T16:27:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.634+0000 7f8eeb202640 1 Processor -- start 2023-10-21T16:27:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.634+0000 7f8eeb202640 1 -- start start 2023-10-21T16:27:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 0x7f8ee40c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ee41531e0 0x7f8ee4146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41ee610 con 0x7f8ee41531e0 2023-10-21T16:27:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41ee820 con 0x7f8ee41535c0 2023-10-21T16:27:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.635+0000 7f8eeb202640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41eeb00 con 0x7f8ee40c8ae0 2023-10-21T16:27:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee979f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee8f9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 0x7f8ee40c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ee41531e0 0x7f8ee4146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee979f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59592/0 (socket says 172.21.15.12:59592) 2023-10-21T16:27:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee8f9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 0x7f8ee40c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55372/0 (socket says 172.21.15.12:55372) 2023-10-21T16:27:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.636+0000 7f8ee979f640 1 -- 172.21.15.12:0/1254952670 learned_addr learned my addr 172.21.15.12:0/1254952670 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:27:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.640+0000 7f8ee979f640 1 -- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 msgr2=0x7f8ee40c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.640+0000 7f8ee979f640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 0x7f8ee40c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.640+0000 7f8ee979f640 1 -- 172.21.15.12:0/1254952670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ee41531e0 msgr2=0x7f8ee4146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:27:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.640+0000 7f8ee979f640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ee41531e0 0x7f8ee4146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:27:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.640+0000 7f8ee979f640 1 -- 172.21.15.12:0/1254952670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80094d0 con 0x7f8ee41535c0 2023-10-21T16:27:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.642+0000 7f8ee979f640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00efc0 tx=0x7f8edc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.648+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc009ca0 con 0x7f8ee41535c0 2023-10-21T16:27:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.648+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00f040 con 0x7f8ee41535c0 2023-10-21T16:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.648+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0146c0 con 0x7f8ee41535c0 2023-10-21T16:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.648+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee41eede0 con 0x7f8ee41535c0 2023-10-21T16:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.649+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee41ef3a0 con 0x7f8ee41535c0 2023-10-21T16:27:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.650+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee41ef560 con 0x7f8ee41535c0 2023-10-21T16:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.670+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8edc014820 con 0x7f8ee41535c0 2023-10-21T16:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.672+0000 7f8ee17fa640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 0x7f8ec806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:27:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.672+0000 7f8ee8f9e640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 0x7f8ec806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:27:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.673+0000 7f8ee8f9e640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 0x7f8ec806d380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8036000 tx=0x7f8ed8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:27:59.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.901+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8edc059810 con 0x7f8ee41535c0 2023-10-21T16:27:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:27:59.914+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8edc055b50 con 0x7f8ee41535c0 2023-10-21T16:28:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.119+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ee4067560 con 0x7f8ee41535c0 2023-10-21T16:28:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.285+0000 7f8ee17fa640 1 -- 172.21.15.12:0/1254952670 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8edc018070 con 0x7f8ee41535c0 2023-10-21T16:28:00.287 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-21T16:28:00.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.288+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 msgr2=0x7f8ec806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.288+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 0x7f8ec806d380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8036000 tx=0x7f8ed8008030 comp rx=0 tx=0).stop 2023-10-21T16:28:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.288+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 msgr2=0x7f8ee40c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00efc0 tx=0x7f8edc00c490 comp rx=0 tx=0).stop 2023-10-21T16:28:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 shutdown_connections 2023-10-21T16:28:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8ec806aec0 0x7f8ec806d380 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee41535c0 0x7f8ee40c3cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ee41531e0 0x7f8ee4146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 --2- 172.21.15.12:0/1254952670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee40c8ae0 0x7f8ee40c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 >> 172.21.15.12:0/1254952670 conn(0x7f8ee406b0d0 msgr2=0x7f8ee41487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 shutdown_connections 2023-10-21T16:28:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.289+0000 7f8eeb202640 1 -- 172.21.15.12:0/1254952670 wait complete. 2023-10-21T16:28:00.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:28:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.532+0000 7fcf80d47640 1 Processor -- start 2023-10-21T16:28:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.533+0000 7fcf80d47640 1 -- start start 2023-10-21T16:28:00.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.534+0000 7fcf80d47640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 0x7fcf7c06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.534+0000 7fcf80d47640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 0x7fcf7c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.534+0000 7fcf80d47640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c0c38e0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.534+0000 7fcf80d47640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c06d450 con 0x7fcf7c06e100 2023-10-21T16:28:00.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.534+0000 7fcf80d47640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1562a0 con 0x7fcf7c14fec0 2023-10-21T16:28:00.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.535+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 0x7fcf7c06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.535+0000 7fcf7affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 0x7fcf7c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.535+0000 7fcf7bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf7c155cf0 0x7fcf7c0ca780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:57070/0 (socket says 172.21.15.12:57070) 2023-10-21T16:28:00.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.535+0000 7fcf7bfff640 1 -- 172.21.15.12:0/64573238 learned_addr learned my addr 172.21.15.12:0/64573238 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:28:00.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.538+0000 7fcf7a7fc640 1 -- 172.21.15.12:0/64573238 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360497155 0 0) 0x7fcf7c0c38e0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.538+0000 7fcf7a7fc640 1 -- 172.21.15.12:0/64573238 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf68003520 con 0x7fcf7c155cf0 2023-10-21T16:28:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.539+0000 7fcf7b7fe640 1 -- 172.21.15.12:0/64573238 >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 msgr2=0x7fcf7c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.539+0000 7fcf7b7fe640 1 --2- 172.21.15.12:0/64573238 >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 0x7fcf7c0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.539+0000 7fcf7b7fe640 1 -- 172.21.15.12:0/64573238 >> v1:172.21.15.12:6789/0 conn(0x7fcf7c155cf0 legacy=0x7fcf7c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.539+0000 7fcf7b7fe640 1 -- 172.21.15.12:0/64573238 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c156560 con 0x7fcf7c14fec0 2023-10-21T16:28:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.539+0000 7fcf7affd640 1 --2- 172.21.15.12:0/64573238 >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 0x7fcf7c0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:28:00.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.541+0000 7fcf7b7fe640 1 --2- 172.21.15.12:0/64573238 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 0x7fcf7c06dbc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097a0 tx=0x7fcf6402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888a8c8e5dfbe44b server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:00.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.545+0000 7fcf7a7fc640 1 -- 172.21.15.12:0/64573238 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64031830 con 0x7fcf7c14fec0 2023-10-21T16:28:00.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.545+0000 7fcf7a7fc640 1 -- 172.21.15.12:0/64573238 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64031990 con 0x7fcf7c14fec0 2023-10-21T16:28:00.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.545+0000 7fcf7a7fc640 1 -- 172.21.15.12:0/64573238 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64031d20 con 0x7fcf7c14fec0 2023-10-21T16:28:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 -- 172.21.15.12:0/64573238 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 msgr2=0x7fcf7c06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 --2- 172.21.15.12:0/64573238 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 0x7fcf7c06dbc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097a0 tx=0x7fcf6402b8d0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 -- 172.21.15.12:0/64573238 shutdown_connections 2023-10-21T16:28:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 --2- 172.21.15.12:0/64573238 >> v2:172.21.15.99:3300/0 conn(0x7fcf7c06e100 0x7fcf7c0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 --2- 172.21.15.12:0/64573238 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c14fec0 0x7fcf7c06dbc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 -- 172.21.15.12:0/64573238 >> 172.21.15.12:0/64573238 conn(0x7fcf7c06bac0 msgr2=0x7fcf7c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 -- 172.21.15.12:0/64573238 shutdown_connections 2023-10-21T16:28:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.546+0000 7fcf80d47640 1 -- 172.21.15.12:0/64573238 wait complete. 2023-10-21T16:28:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.548+0000 7fcf80d47640 1 Processor -- start 2023-10-21T16:28:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.548+0000 7fcf80d47640 1 -- start start 2023-10-21T16:28:00.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 0x7fcf7c142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 0x7fcf7c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 0x7fcf7c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1453c0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1463e0 con 0x7fcf7c14fec0 2023-10-21T16:28:00.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.549+0000 7fcf80d47640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c154740 con 0x7fcf7c06e100 2023-10-21T16:28:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 0x7fcf7c142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 0x7fcf7c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 0x7fcf7c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 0x7fcf7c142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55390/0 (socket says 172.21.15.12:55390) 2023-10-21T16:28:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 0x7fcf7c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59600/0 (socket says 172.21.15.12:59600) 2023-10-21T16:28:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.550+0000 7fcf7b7fe640 1 -- 172.21.15.12:0/3850343519 learned_addr learned my addr 172.21.15.12:0/3850343519 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:00.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.554+0000 7fcf7bfff640 1 -- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 msgr2=0x7fcf7c142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.554+0000 7fcf7bfff640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 0x7fcf7c142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.554+0000 7fcf7bfff640 1 -- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 msgr2=0x7fcf7c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.554+0000 7fcf7bfff640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 0x7fcf7c0c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.554+0000 7fcf7bfff640 1 -- 172.21.15.12:0/3850343519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009a70 con 0x7fcf7c155cf0 2023-10-21T16:28:00.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.558+0000 7fcf7bfff640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 0x7fcf7c14e730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c370 tx=0x7fcf74001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.563+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74005da0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.563+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf740070d0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.563+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74007440 con 0x7fcf7c155cf0 2023-10-21T16:28:00.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.563+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf64009400 con 0x7fcf7c155cf0 2023-10-21T16:28:00.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.563+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c154460 con 0x7fcf7c155cf0 2023-10-21T16:28:00.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.565+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c1f2330 con 0x7fcf7c155cf0 2023-10-21T16:28:00.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.888+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf740075a0 con 0x7fcf7c155cf0 2023-10-21T16:28:00.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.889+0000 7fcf73fff640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 0x7fcf5c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.890+0000 7fcf7b7fe640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 0x7fcf5c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.892+0000 7fcf7b7fe640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 0x7fcf5c06d3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402b910 tx=0x7fcf6403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.926+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcf74057c40 con 0x7fcf7c155cf0 2023-10-21T16:28:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:00.927+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf74053f80 con 0x7fcf7c155cf0 2023-10-21T16:28:01.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.175+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf7c1f2330 con 0x7fcf7c155cf0 2023-10-21T16:28:01.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.200+0000 7fcf73fff640 1 -- 172.21.15.12:0/3850343519 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6485 (secure 0 0 0) 0x7fcf7c1f2330 con 0x7fcf7c155cf0 2023-10-21T16:28:01.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:28:01.202 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T16:27:39.342620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T16:28:01.202 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-21T16:28:01.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 msgr2=0x7fcf5c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 0x7fcf5c06d3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402b910 tx=0x7fcf6403c040 comp rx=0 tx=0).stop 2023-10-21T16:28:01.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 msgr2=0x7fcf7c14e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 0x7fcf7c14e730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c370 tx=0x7fcf74001e70 comp rx=0 tx=0).stop 2023-10-21T16:28:01.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 shutdown_connections 2023-10-21T16:28:01.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcf5c06aef0 0x7fcf5c06d3b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7c155cf0 0x7fcf7c14e730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7c14fec0 0x7fcf7c0c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 --2- 172.21.15.12:0/3850343519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7c06e100 0x7fcf7c142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 >> 172.21.15.12:0/3850343519 conn(0x7fcf7c06bac0 msgr2=0x7fcf7c141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:01.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.203+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 shutdown_connections 2023-10-21T16:28:01.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.204+0000 7fcf80d47640 1 -- 172.21.15.12:0/3850343519 wait complete. 2023-10-21T16:28:01.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T16:28:01.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.447+0000 7fa44359e640 1 Processor -- start 2023-10-21T16:28:01.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.447+0000 7fa44359e640 1 -- start start 2023-10-21T16:28:01.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.448+0000 7fa44359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4441534b0 0x7fa44415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.448+0000 7fa44359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa44406fd50 0x7fa444163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.448+0000 7fa44359e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44406e520 con 0x7fa44415d340 2023-10-21T16:28:01.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.449+0000 7fa44359e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440c1f90 con 0x7fa4441534b0 2023-10-21T16:28:01.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.449+0000 7fa44359e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4441595e0 con 0x7fa44406fd50 2023-10-21T16:28:01.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.449+0000 7fa442d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa44406fd50 0x7fa444163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.450+0000 7fa442d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa44406fd50 0x7fa444163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59614/0 (socket says 172.21.15.12:59614) 2023-10-21T16:28:01.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.450+0000 7fa442d9d640 1 -- 172.21.15.12:0/1318187130 learned_addr learned my addr 172.21.15.12:0/1318187130 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:01.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.450+0000 7fa44259c640 1 --2- 172.21.15.12:0/1318187130 >> v2:172.21.15.12:3300/0 conn(0x7fa4441534b0 0x7fa44415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.452+0000 7fa442d9d640 1 -- 172.21.15.12:0/1318187130 >> v2:172.21.15.12:3300/0 conn(0x7fa4441534b0 msgr2=0x7fa44415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.452+0000 7fa442d9d640 1 --2- 172.21.15.12:0/1318187130 >> v2:172.21.15.12:3300/0 conn(0x7fa4441534b0 0x7fa44415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.452+0000 7fa442d9d640 1 -- 172.21.15.12:0/1318187130 >> v1:172.21.15.12:6789/0 conn(0x7fa44415d340 legacy=0x7fa4440ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.452+0000 7fa442d9d640 1 -- 172.21.15.12:0/1318187130 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4441598c0 con 0x7fa44406fd50 2023-10-21T16:28:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.454+0000 7fa442d9d640 1 --2- 172.21.15.12:0/1318187130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa444163990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4440c4b00 tx=0x7fa43c02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3271efb8629b6be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.457+0000 7fa44159a640 1 -- 172.21.15.12:0/1318187130 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c02f850 con 0x7fa44406fd50 2023-10-21T16:28:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.458+0000 7fa44159a640 1 -- 172.21.15.12:0/1318187130 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c02f9b0 con 0x7fa44406fd50 2023-10-21T16:28:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.458+0000 7fa44159a640 1 -- 172.21.15.12:0/1318187130 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c02fd40 con 0x7fa44406fd50 2023-10-21T16:28:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.458+0000 7fa44359e640 1 -- 172.21.15.12:0/1318187130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 msgr2=0x7fa444163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.458+0000 7fa44359e640 1 --2- 172.21.15.12:0/1318187130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa444163990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4440c4b00 tx=0x7fa43c02ba30 comp rx=0 tx=0).stop 2023-10-21T16:28:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 -- 172.21.15.12:0/1318187130 shutdown_connections 2023-10-21T16:28:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 --2- 172.21.15.12:0/1318187130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa444163990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 --2- 172.21.15.12:0/1318187130 >> v2:172.21.15.12:3300/0 conn(0x7fa4441534b0 0x7fa44415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 -- 172.21.15.12:0/1318187130 >> 172.21.15.12:0/1318187130 conn(0x7fa44406bac0 msgr2=0x7fa44406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 -- 172.21.15.12:0/1318187130 shutdown_connections 2023-10-21T16:28:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.459+0000 7fa44359e640 1 -- 172.21.15.12:0/1318187130 wait complete. 2023-10-21T16:28:01.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.461+0000 7fa44359e640 1 Processor -- start 2023-10-21T16:28:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.461+0000 7fa44359e640 1 -- start start 2023-10-21T16:28:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 0x7fa44414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa44415d340 0x7fa44414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441f2a10 con 0x7fa44415d340 2023-10-21T16:28:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441584f0 con 0x7fa44406fd50 2023-10-21T16:28:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444154190 con 0x7fa4441534b0 2023-10-21T16:28:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa44259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.462+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 0x7fa44414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.463+0000 7fa44259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:59622/0 (socket says 172.21.15.12:59622) 2023-10-21T16:28:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.463+0000 7fa44259c640 1 -- 172.21.15.12:0/3839183007 learned_addr learned my addr 172.21.15.12:0/3839183007 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.463+0000 7fa442d9d640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa44415d340 0x7fa44414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa44259c640 1 -- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 msgr2=0x7fa44414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa44259c640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 0x7fa44414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa44259c640 1 -- 172.21.15.12:0/3839183007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa44415d340 msgr2=0x7fa44414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa44259c640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa44415d340 0x7fa44414eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa44259c640 1 -- 172.21.15.12:0/3839183007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0094d0 con 0x7fa44406fd50 2023-10-21T16:28:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.466+0000 7fa441d9b640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 0x7fa44414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T16:28:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.468+0000 7fa44259c640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa43400efc0 tx=0x7fa43400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.472+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434014480 con 0x7fa44406fd50 2023-10-21T16:28:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.472+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400f040 con 0x7fa44406fd50 2023-10-21T16:28:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.472+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434014800 con 0x7fa44406fd50 2023-10-21T16:28:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.472+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa444154470 con 0x7fa44406fd50 2023-10-21T16:28:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.472+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa444158180 con 0x7fa44406fd50 2023-10-21T16:28:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.473+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa444158340 con 0x7fa44406fd50 2023-10-21T16:28:01.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.493+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa434014960 con 0x7fa44406fd50 2023-10-21T16:28:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.494+0000 7fa43affd640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 0x7fa42406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.495+0000 7fa441d9b640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 0x7fa42406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:01.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.495+0000 7fa441d9b640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 0x7fa42406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4440caf90 tx=0x7fa42c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.719+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa4340597e0 con 0x7fa44406fd50 2023-10-21T16:28:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.729+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa434055b20 con 0x7fa44406fd50 2023-10-21T16:28:01.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.940+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa444154660 con 0x7fa44406fd50 2023-10-21T16:28:01.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.979+0000 7fa43affd640 1 -- 172.21.15.12:0/3839183007 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16520 (secure 0 0 0) 0x7fa434059140 con 0x7fa44406fd50 2023-10-21T16:28:01.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:28:01.982 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:57.353629+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T16:28:01.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 msgr2=0x7fa42406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 0x7fa42406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4440caf90 tx=0x7fa42c009040 comp rx=0 tx=0).stop 2023-10-21T16:28:01.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 msgr2=0x7fa4441453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:01.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa43400efc0 tx=0x7fa43400c490 comp rx=0 tx=0).stop 2023-10-21T16:28:01.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 shutdown_connections 2023-10-21T16:28:01.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa42406aec0 0x7fa42406d380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa44415d340 0x7fa44414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4441534b0 0x7fa44414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 --2- 172.21.15.12:0/3839183007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa44406fd50 0x7fa4441453f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:01.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 >> 172.21.15.12:0/3839183007 conn(0x7fa44406bac0 msgr2=0x7fa444151950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:01.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 shutdown_connections 2023-10-21T16:28:01.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:01.983+0000 7fa44359e640 1 -- 172.21.15.12:0/3839183007 wait complete. 2023-10-21T16:28:02.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T16:28:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.232+0000 7fa2c5f90640 1 Processor -- start 2023-10-21T16:28:02.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.232+0000 7fa2c5f90640 1 -- start start 2023-10-21T16:28:02.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.235+0000 7fa2c5f90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 0x7fa2c00c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:02.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.235+0000 7fa2c5f90640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00c7660 con 0x7fa2c015a800 2023-10-21T16:28:02.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.235+0000 7fa2c5f90640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00c91e0 con 0x7fa2c01510c0 2023-10-21T16:28:02.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.235+0000 7fa2c5f90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c94c0 con 0x7fa2c00c7150 2023-10-21T16:28:02.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.236+0000 7fa2bf7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa2c01510c0 0x7fa2c00c82b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:43184/0 (socket says 172.21.15.12:43184) 2023-10-21T16:28:02.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.236+0000 7fa2bf7fe640 1 -- 172.21.15.12:0/62013894 learned_addr learned my addr 172.21.15.12:0/62013894 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:28:02.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.236+0000 7fa2b7fff640 1 --2- 172.21.15.12:0/62013894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 0x7fa2c00c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:02.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.239+0000 7fa2b7fff640 1 -- 172.21.15.12:0/62013894 >> v1:172.21.15.99:6789/0 conn(0x7fa2c01510c0 legacy=0x7fa2c00c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.239+0000 7fa2b7fff640 1 -- 172.21.15.12:0/62013894 >> v1:172.21.15.12:6789/0 conn(0x7fa2c015a800 legacy=0x7fa2c015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:02.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.239+0000 7fa2b7fff640 1 -- 172.21.15.12:0/62013894 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c97a0 con 0x7fa2c00c7150 2023-10-21T16:28:02.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.241+0000 7fa2b7fff640 1 --2- 172.21.15.12:0/62013894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 0x7fa2c00c1770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80097d0 tx=0x7fa2a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2bcdc372f4a8104 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.244+0000 7fa2beffd640 1 -- 172.21.15.12:0/62013894 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8031890 con 0x7fa2c00c7150 2023-10-21T16:28:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.244+0000 7fa2beffd640 1 -- 172.21.15.12:0/62013894 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80319f0 con 0x7fa2c00c7150 2023-10-21T16:28:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.244+0000 7fa2beffd640 1 -- 172.21.15.12:0/62013894 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8031d80 con 0x7fa2c00c7150 2023-10-21T16:28:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.245+0000 7fa2c5f90640 1 -- 172.21.15.12:0/62013894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 msgr2=0x7fa2c00c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.245+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/62013894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 0x7fa2c00c1770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80097d0 tx=0x7fa2a802b930 comp rx=0 tx=0).stop 2023-10-21T16:28:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.245+0000 7fa2c5f90640 1 -- 172.21.15.12:0/62013894 shutdown_connections 2023-10-21T16:28:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.245+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/62013894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c00c7150 0x7fa2c00c1770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.245+0000 7fa2c5f90640 1 -- 172.21.15.12:0/62013894 >> 172.21.15.12:0/62013894 conn(0x7fa2c0065ab0 msgr2=0x7fa2c0065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.246+0000 7fa2c5f90640 1 -- 172.21.15.12:0/62013894 shutdown_connections 2023-10-21T16:28:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.246+0000 7fa2c5f90640 1 -- 172.21.15.12:0/62013894 wait complete. 2023-10-21T16:28:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.248+0000 7fa2c5f90640 1 Processor -- start 2023-10-21T16:28:02.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.248+0000 7fa2c5f90640 1 -- start start 2023-10-21T16:28:02.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c00c7150 0x7fa2c01efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:02.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 0x7fa2c01f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:02.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 0x7fa2c006c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:02.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b29d0 con 0x7fa2c00c7150 2023-10-21T16:28:02.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c01f0360 con 0x7fa2c015a800 2023-10-21T16:28:02.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.249+0000 7fa2c5f90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c01f0d50 con 0x7fa2c01510c0 2023-10-21T16:28:02.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.250+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 0x7fa2c01f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:02.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.250+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 0x7fa2c01f0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55422/0 (socket says 172.21.15.12:55422) 2023-10-21T16:28:02.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.250+0000 7fa2b7fff640 1 -- 172.21.15.12:0/976640906 learned_addr learned my addr 172.21.15.12:0/976640906 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:02.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.252+0000 7fa2bffff640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 0x7fa2c006c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:02.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.256+0000 7fa2bffff640 1 -- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 msgr2=0x7fa2c01f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.256+0000 7fa2bffff640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 0x7fa2c01f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.256+0000 7fa2bffff640 1 -- 172.21.15.12:0/976640906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c00c7150 msgr2=0x7fa2c01efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.256+0000 7fa2bffff640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c00c7150 0x7fa2c01efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.256+0000 7fa2bffff640 1 -- 172.21.15.12:0/976640906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8009400 con 0x7fa2c015a800 2023-10-21T16:28:02.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.299+0000 7fa2bffff640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 0x7fa2c006c1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c7e0 tx=0x7fa2b800cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:02.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.305+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8003b70 con 0x7fa2c015a800 2023-10-21T16:28:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.306+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b8003cd0 con 0x7fa2c015a800 2023-10-21T16:28:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.306+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80052b0 con 0x7fa2c015a800 2023-10-21T16:28:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.306+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00b2450 con 0x7fa2c015a800 2023-10-21T16:28:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.306+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00b0440 con 0x7fa2c015a800 2023-10-21T16:28:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.307+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c00b0280 con 0x7fa2c015a800 2023-10-21T16:28:02.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.328+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa2b8005410 con 0x7fa2c015a800 2023-10-21T16:28:02.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.329+0000 7fa2bcff9640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 0x7fa2a006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:02.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.329+0000 7fa2bf7fe640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 0x7fa2a006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:02.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.330+0000 7fa2bf7fe640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 0x7fa2a006d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0001550 tx=0x7fa2b0007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:02.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.555+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa2b8058800 con 0x7fa2c015a800 2023-10-21T16:28:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.566+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2b8054440 con 0x7fa2c015a800 2023-10-21T16:28:02.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.847+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2c00c8d40 con 0x7fa2c015a800 2023-10-21T16:28:02.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.860+0000 7fa2bcff9640 1 -- 172.21.15.12:0/976640906 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6485 (secure 0 0 0) 0x7fa2b8057a60 con 0x7fa2c015a800 2023-10-21T16:28:02.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T16:28:02.862 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T16:27:39.342620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T16:28:02.863 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-21T16:28:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 msgr2=0x7fa2a006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 0x7fa2a006d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0001550 tx=0x7fa2b0007a40 comp rx=0 tx=0).stop 2023-10-21T16:28:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 msgr2=0x7fa2c006c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 0x7fa2c006c1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c7e0 tx=0x7fa2b800cca0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 shutdown_connections 2023-10-21T16:28:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa2a006aec0 0x7fa2a006d380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2c015a800 0x7fa2c006c1b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2c01510c0 0x7fa2c01f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 --2- 172.21.15.12:0/976640906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c00c7150 0x7fa2c01efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 >> 172.21.15.12:0/976640906 conn(0x7fa2c0065ab0 msgr2=0x7fa2c014e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 shutdown_connections 2023-10-21T16:28:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:02.863+0000 7fa2c5f90640 1 -- 172.21.15.12:0/976640906 wait complete. 2023-10-21T16:28:03.489 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-21T16:27:31.345236+0000', 'modified': '2023-10-21T16:27:39.342620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4274}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4274': {'gid': 4274, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.12:6837/1211628710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6836', 'nonce': 1211628710}, {'type': 'v1', 'addr': '172.21.15.12:6837', 'nonce': 1211628710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-21T16:28:03.490 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-21T16:28:03.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-21T16:28:03.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.732+0000 7fc2a56bb640 1 Processor -- start 2023-10-21T16:28:03.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.732+0000 7fc2a56bb640 1 -- start start 2023-10-21T16:28:03.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.734+0000 7fc2a56bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2a00c59d0 0x7fc2a0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.734+0000 7fc2a56bb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc2a015a590 0x7fc2a0151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.734+0000 7fc2a56bb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00c23f0 con 0x7fc2a00c55f0 2023-10-21T16:28:03.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.734+0000 7fc2a56bb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a0156fa0 con 0x7fc2a015a590 2023-10-21T16:28:03.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.734+0000 7fc2a56bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a015aaf0 con 0x7fc2a00c59d0 2023-10-21T16:28:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.735+0000 7fc29e7fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2a00c59d0 0x7fc2a0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.735+0000 7fc29effd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc2a00c55f0 0x7fc2a0157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:39720/0 (socket says 172.21.15.12:39720) 2023-10-21T16:28:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.735+0000 7fc29effd640 1 -- 172.21.15.12:0/4060738372 learned_addr learned my addr 172.21.15.12:0/4060738372 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:28:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.735+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/4060738372 >> v2:172.21.15.12:3300/0 conn(0x7fc2a015a590 0x7fc2a0151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.738+0000 7fc29e7fc640 1 -- 172.21.15.12:0/4060738372 >> v2:172.21.15.12:3300/0 conn(0x7fc2a015a590 msgr2=0x7fc2a0151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.738+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/4060738372 >> v2:172.21.15.12:3300/0 conn(0x7fc2a015a590 0x7fc2a0151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.738+0000 7fc29e7fc640 1 -- 172.21.15.12:0/4060738372 >> v1:172.21.15.99:6789/0 conn(0x7fc2a00c55f0 legacy=0x7fc2a0157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.738+0000 7fc29e7fc640 1 -- 172.21.15.12:0/4060738372 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a015add0 con 0x7fc2a00c59d0 2023-10-21T16:28:03.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.743+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/4060738372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a00c59d0 0x7fc2a0150de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c7dc0 tx=0x7fc29402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173f29168a48bd80 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.746+0000 7fc29dffb640 1 -- 172.21.15.12:0/4060738372 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294030610 con 0x7fc2a00c59d0 2023-10-21T16:28:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.747+0000 7fc29dffb640 1 -- 172.21.15.12:0/4060738372 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294030770 con 0x7fc2a00c59d0 2023-10-21T16:28:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.747+0000 7fc29dffb640 1 -- 172.21.15.12:0/4060738372 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294030b00 con 0x7fc2a00c59d0 2023-10-21T16:28:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.747+0000 7fc2a56bb640 1 -- 172.21.15.12:0/4060738372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a00c59d0 msgr2=0x7fc2a0150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.747+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/4060738372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a00c59d0 0x7fc2a0150de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c7dc0 tx=0x7fc29402b960 comp rx=0 tx=0).stop 2023-10-21T16:28:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 -- 172.21.15.12:0/4060738372 shutdown_connections 2023-10-21T16:28:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/4060738372 >> v2:172.21.15.12:3300/0 conn(0x7fc2a015a590 0x7fc2a0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/4060738372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a00c59d0 0x7fc2a0150de0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 -- 172.21.15.12:0/4060738372 >> 172.21.15.12:0/4060738372 conn(0x7fc2a0069de0 msgr2=0x7fc2a006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 -- 172.21.15.12:0/4060738372 shutdown_connections 2023-10-21T16:28:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.748+0000 7fc2a56bb640 1 -- 172.21.15.12:0/4060738372 wait complete. 2023-10-21T16:28:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.750+0000 7fc2a56bb640 1 Processor -- start 2023-10-21T16:28:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.750+0000 7fc2a56bb640 1 -- start start 2023-10-21T16:28:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2a00c55f0 0x7fc2a0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 0x7fc2a0146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 0x7fc2a0140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0146480 con 0x7fc2a00c55f0 2023-10-21T16:28:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01455c0 con 0x7fc2a015a590 2023-10-21T16:28:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc2a56bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0145880 con 0x7fc2a00c59d0 2023-10-21T16:28:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc29effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2a00c55f0 0x7fc2a0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.751+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 0x7fc2a0140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.752+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 0x7fc2a0146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.752+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 0x7fc2a0140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57742/0 (socket says 172.21.15.12:57742) 2023-10-21T16:28:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.752+0000 7fc29f7fe640 1 -- 172.21.15.12:0/3464183504 learned_addr learned my addr 172.21.15.12:0/3464183504 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.755+0000 7fc29e7fc640 1 -- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 msgr2=0x7fc2a0140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.755+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 0x7fc2a0140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.755+0000 7fc29e7fc640 1 -- 172.21.15.12:0/3464183504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2a00c55f0 msgr2=0x7fc2a0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.755+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2a00c55f0 0x7fc2a0071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.755+0000 7fc29e7fc640 1 -- 172.21.15.12:0/3464183504 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294009400 con 0x7fc2a00c59d0 2023-10-21T16:28:03.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.758+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 0x7fc2a0146ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc294033000 tx=0x7fc294004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.762+0000 7fc2877fe640 1 -- 172.21.15.12:0/3464183504 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29403e040 con 0x7fc2a00c59d0 2023-10-21T16:28:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.762+0000 7fc2877fe640 1 -- 172.21.15.12:0/3464183504 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294039cb0 con 0x7fc2a00c59d0 2023-10-21T16:28:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.762+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a0145de0 con 0x7fc2a00c59d0 2023-10-21T16:28:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.762+0000 7fc2877fe640 1 -- 172.21.15.12:0/3464183504 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294044630 con 0x7fc2a00c59d0 2023-10-21T16:28:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.762+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00c9e80 con 0x7fc2a00c59d0 2023-10-21T16:28:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.766+0000 7fc2a824e740 1 Processor -- start 2023-10-21T16:28:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.766+0000 7fc2a824e740 1 -- start start 2023-10-21T16:28:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a36432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a36413e0 0x5588a36821e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a355d7a0 con 0x5588a368c800 2023-10-21T16:28:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a35af740 con 0x5588a3642980 2023-10-21T16:28:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.767+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a35ace30 con 0x5588a36413e0 2023-10-21T16:28:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.768+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.768+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57754/0 (socket says 172.21.15.12:57754) 2023-10-21T16:28:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.768+0000 7fc29f7fe640 1 -- 172.21.15.12:0/1325033973 learned_addr learned my addr 172.21.15.12:0/1325033973 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.768+0000 7fc29effd640 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a36432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.770+0000 7fc29f7fe640 1 -- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a36413e0 msgr2=0x5588a36821e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.770+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a36413e0 0x5588a36821e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.770+0000 7fc29f7fe640 1 -- 172.21.15.12:0/1325033973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 msgr2=0x5588a36432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.770+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a36432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.770+0000 7fc29f7fe640 1 -- 172.21.15.12:0/1325033973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a356c910 con 0x5588a3642980 2023-10-21T16:28:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.772+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc298009bd0 tx=0x7fc298011690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9fc84fadb0d9d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.776+0000 7fc284ff9640 1 -- 172.21.15.12:0/1325033973 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011ec0 con 0x5588a3642980 2023-10-21T16:28:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.776+0000 7fc284ff9640 1 -- 172.21.15.12:0/1325033973 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298014440 con 0x5588a3642980 2023-10-21T16:28:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.776+0000 7fc284ff9640 1 -- 172.21.15.12:0/1325033973 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980147b0 con 0x5588a3642980 2023-10-21T16:28:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.776+0000 7fc2a824e740 1 -- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 msgr2=0x5588a3642d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.776+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc298009bd0 tx=0x7fc298011690 comp rx=0 tx=0).stop 2023-10-21T16:28:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 -- 172.21.15.12:0/1325033973 shutdown_connections 2023-10-21T16:28:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a36413e0 0x5588a36821e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a36432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1325033973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a3642980 0x5588a3642d60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 -- 172.21.15.12:0/1325033973 >> 172.21.15.12:0/1325033973 conn(0x5588a363f0f0 msgr2=0x5588a3641a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 -- 172.21.15.12:0/1325033973 shutdown_connections 2023-10-21T16:28:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 -- 172.21.15.12:0/1325033973 wait complete. 2023-10-21T16:28:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.777+0000 7fc2a824e740 1 -- start start 2023-10-21T16:28:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.778+0000 7fc2a824e740 1 Processor -- start 2023-10-21T16:28:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3680070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a3696e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a35a8720 con 0x5588a368c800 2023-10-21T16:28:03.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a3546970 con 0x5588a368b670 2023-10-21T16:28:03.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a3546610 con 0x5588a3642980 2023-10-21T16:28:03.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc2a824e740 10 client.0 _ll_register_callbacks cb 0x5588a35689d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-21T16:28:03.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a3696e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.779+0000 7fc29effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3680070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.780+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a3696e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57758/0 (socket says 172.21.15.12:57758) 2023-10-21T16:28:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.780+0000 7fc29e7fc640 1 -- 172.21.15.12:0/458380379 learned_addr learned my addr 172.21.15.12:0/458380379 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.783+0000 7fc29effd640 1 -- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 msgr2=0x5588a367f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.783+0000 7fc29effd640 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.783+0000 7fc29effd640 1 -- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 msgr2=0x5588a3696e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.783+0000 7fc29effd640 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a3696e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.783+0000 7fc29effd640 1 -- 172.21.15.12:0/458380379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2980098b0 con 0x5588a368c800 2023-10-21T16:28:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.784+0000 7fc2877fe640 1 -- 172.21.15.12:0/3464183504 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc294044790 con 0x7fc2a00c59d0 2023-10-21T16:28:03.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.784+0000 7fc2877fe640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 0x7fc28c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.785+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 0x7fc28c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.785+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 0x7fc28c06d2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc298000c00 tx=0x7fc298016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:03.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.786+0000 7fc29effd640 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3680070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc2900012e0 tx=0x7fc290010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64ac1b8f2c072a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:03.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.786+0000 7fc27dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-21T16:28:03.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.786+0000 7fc2877fe640 1 -- 172.21.15.12:0/3464183504 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc294039e20 con 0x7fc2a00c59d0 2023-10-21T16:28:03.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.790+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290001e30 con 0x5588a368c800 2023-10-21T16:28:03.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.790+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc290001f90 con 0x5588a368c800 2023-10-21T16:28:03.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.790+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588a35cf160 con 0x5588a368c800 2023-10-21T16:28:03.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.792+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2900070d0 con 0x5588a368c800 2023-10-21T16:28:03.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.793+0000 7fc2a824e740 10 client.4488 fetch_fsmap learned FSMap version 8 2023-10-21T16:28:03.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.793+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5588a35a6da0 con 0x5588a368c800 2023-10-21T16:28:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.795+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588a35cf160 con 0x5588a368c800 2023-10-21T16:28:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 8) v1 ==== 4444+0+0 (secure 0 0 0) 0x7fc290007230 con 0x5588a368c800 2023-10-21T16:28:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 10 client.4488 fetch_fsmap finished waiting for FSMap version 8 2023-10-21T16:28:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 10 client.4488 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-21T16:28:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 20 client.4488 populate_metadata read hostname 'smithi012' 2023-10-21T16:28:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a3669810 0x5588a3669bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 4 client.4488 mds_command: new command op to 4274 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-21T16:28:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.804+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 --> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588a357acc0 con 0x5588a3669810 2023-10-21T16:28:03.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.823+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a3669810 0x5588a3669bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.952+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a3669810 0x5588a3669bf0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cbfefb987279743 server_cookie=9394f29a61359316 in_seq=0 out_seq=0 2023-10-21T16:28:03.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:03.952+0000 7fc27dffb640 10 client.4488 ms_handle_connect on v2:172.21.15.12:6836/1211628710 2023-10-21T16:28:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.180+0000 7fc27dffb640 1 -- 172.21.15.12:0/458380379 <== mds.0 v2:172.21.15.12:6836/1211628710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588a357acc0 con 0x5588a3669810 2023-10-21T16:28:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.180+0000 7fc27dffb640 10 client.4488 handle_command_reply: tid=0 2023-10-21T16:28:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.180+0000 7fc2a824e740 1 client.4488 shutdown 2023-10-21T16:28:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 msgr2=0x5588a3680070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3680070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc2900012e0 tx=0x7fc290010610 comp rx=0 tx=0).stop 2023-10-21T16:28:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 shutdown_connections 2023-10-21T16:28:04.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a3669810 0x5588a3669bf0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a3696e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3680070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 --2- 172.21.15.12:0/458380379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc27dffb640 0 client.4488 ms_handle_reset on v2:172.21.15.12:6836/1211628710 2023-10-21T16:28:04.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 >> 172.21.15.12:0/458380379 conn(0x5588a36413e0 msgr2=0x5588a3642d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:04.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.181+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 shutdown_connections 2023-10-21T16:28:04.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.182+0000 7fc2a824e740 1 -- 172.21.15.12:0/458380379 wait complete. 2023-10-21T16:28:04.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.182+0000 7fc2a824e740 20 client.4488 trim_cache size 0 max 16384 2023-10-21T16:28:04.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.206+0000 7fc2a824e740 1 Processor -- start 2023-10-21T16:28:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.206+0000 7fc2a824e740 1 -- start start 2023-10-21T16:28:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368b670 0x5588a36866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368c800 0x5588a3686c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a330cf20 con 0x5588a368b670 2023-10-21T16:28:04.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a3687660 con 0x5588a368c800 2023-10-21T16:28:04.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.208+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a36693f0 con 0x5588a3642980 2023-10-21T16:28:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.209+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368c800 0x5588a3686c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.209+0000 7fc29effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.209+0000 7fc29effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51990/0 (socket says 172.21.15.12:51990) 2023-10-21T16:28:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.209+0000 7fc29effd640 1 -- 172.21.15.12:0/2494793054 learned_addr learned my addr 172.21.15.12:0/2494793054 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.209+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368b670 0x5588a36866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.211+0000 7fc29effd640 1 -- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368c800 msgr2=0x5588a3686c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.211+0000 7fc29effd640 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368c800 0x5588a3686c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.211+0000 7fc29effd640 1 -- 172.21.15.12:0/2494793054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368b670 msgr2=0x5588a36866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.211+0000 7fc29effd640 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368b670 0x5588a36866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.211+0000 7fc29effd640 1 -- 172.21.15.12:0/2494793054 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a3545b80 con 0x5588a3642980 2023-10-21T16:28:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.213+0000 7fc29effd640 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc290001220 tx=0x7fc29000c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ba6b1744b3c562 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:04.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.217+0000 7fc2857fa640 1 -- 172.21.15.12:0/2494793054 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290010b10 con 0x5588a3642980 2023-10-21T16:28:04.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.217+0000 7fc2857fa640 1 -- 172.21.15.12:0/2494793054 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290007aa0 con 0x5588a3642980 2023-10-21T16:28:04.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.217+0000 7fc2857fa640 1 -- 172.21.15.12:0/2494793054 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290012920 con 0x5588a3642980 2023-10-21T16:28:04.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 -- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 msgr2=0x5588a367c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc290001220 tx=0x7fc29000c000 comp rx=0 tx=0).stop 2023-10-21T16:28:04.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 -- 172.21.15.12:0/2494793054 shutdown_connections 2023-10-21T16:28:04.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368c800 0x5588a3686c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368b670 0x5588a36866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 --2- 172.21.15.12:0/2494793054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a367c200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 -- 172.21.15.12:0/2494793054 >> 172.21.15.12:0/2494793054 conn(0x5588a36413e0 msgr2=0x5588a367fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:04.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.218+0000 7fc2a824e740 1 -- 172.21.15.12:0/2494793054 shutdown_connections 2023-10-21T16:28:04.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.219+0000 7fc2a824e740 1 -- 172.21.15.12:0/2494793054 wait complete. 2023-10-21T16:28:04.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.219+0000 7fc2a824e740 1 -- start start 2023-10-21T16:28:04.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.220+0000 7fc2a824e740 1 Processor -- start 2023-10-21T16:28:04.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a36e6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3643020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a367dbb0 con 0x5588a368c800 2023-10-21T16:28:04.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a3682bb0 con 0x5588a368b670 2023-10-21T16:28:04.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a3662c60 con 0x5588a3642980 2023-10-21T16:28:04.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.222+0000 7fc2a824e740 10 client.0 _ll_register_callbacks cb 0x7fc290001c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-21T16:28:04.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.223+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.223+0000 7fc29effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a36e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.223+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57784/0 (socket says 172.21.15.12:57784) 2023-10-21T16:28:04.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.223+0000 7fc29e7fc640 1 -- 172.21.15.12:0/1812409619 learned_addr learned my addr 172.21.15.12:0/1812409619 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:04.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.224+0000 7fc29f7fe640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3643020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.226+0000 7fc29e7fc640 1 -- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 msgr2=0x5588a36e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:04.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.226+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a36e6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.226+0000 7fc29e7fc640 1 -- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 msgr2=0x5588a3643020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T16:28:04.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.226+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3643020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.226+0000 7fc29e7fc640 1 -- 172.21.15.12:0/1812409619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588a35a6da0 con 0x5588a368b670 2023-10-21T16:28:04.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.228+0000 7fc29e7fc640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc29407d690 tx=0x7fc29407f4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205477bc91b0b673 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:04.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.228+0000 7fc27dffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2023-10-21T16:28:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.232+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940852c0 con 0x5588a368b670 2023-10-21T16:28:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.232+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mon.1 v2:172.21.15.99:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc294089500 con 0x5588a368b670 2023-10-21T16:28:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.232+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc298014440 con 0x5588a368b670 2023-10-21T16:28:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.234+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc294089070 con 0x5588a368b670 2023-10-21T16:28:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.234+0000 7fc2a824e740 10 client.4564 fetch_fsmap learned FSMap version 8 2023-10-21T16:28:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.234+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5588a356b170 con 0x5588a368b670 2023-10-21T16:28:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mon.1 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940ae020 con 0x5588a368b670 2023-10-21T16:28:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mon.1 v2:172.21.15.99:3300/0 5 ==== fsmap(e 8) v1 ==== 4444+0+0 (secure 0 0 0) 0x7fc294098d20 con 0x5588a368b670 2023-10-21T16:28:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 10 client.4564 fetch_fsmap finished waiting for FSMap version 8 2023-10-21T16:28:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 10 client.4564 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-21T16:28:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 20 client.4564 populate_metadata read hostname 'smithi012' 2023-10-21T16:28:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a366b570 0x5588a366b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 4 client.4564 mds_command: new command op to 4274 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-21T16:28:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.238+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 --> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5588a35a1700 con 0x5588a366b570 2023-10-21T16:28:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.239+0000 7fc29effd640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a366b570 0x5588a366b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.245+0000 7fc29effd640 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a366b570 0x5588a366b950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c5161a394b60fa server_cookie=cab94c1beb85b487 in_seq=0 out_seq=0 2023-10-21T16:28:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.245+0000 7fc27dffb640 10 client.4564 ms_handle_connect on v2:172.21.15.12:6836/1211628710 2023-10-21T16:28:04.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.279+0000 7fc27dffb640 1 -- 172.21.15.12:0/1812409619 <== mds.0 v2:172.21.15.12:6836/1211628710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5588a35a1700 con 0x5588a366b570 2023-10-21T16:28:04.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.279+0000 7fc27dffb640 10 client.4564 handle_command_reply: tid=0 2023-10-21T16:28:04.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.279+0000 7fc2a824e740 1 client.4564 shutdown 2023-10-21T16:28:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.279+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 msgr2=0x5588a369d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc29407d690 tx=0x7fc29407f4c0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 shutdown_connections 2023-10-21T16:28:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588a368c800 0x5588a3643020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.12:6836/1211628710,v1:172.21.15.12:6837/1211628710] conn(0x5588a366b570 0x5588a366b950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588a368b670 0x5588a369d7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 --2- 172.21.15.12:0/1812409619 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5588a3642980 0x5588a36e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc27dffb640 0 client.4564 ms_handle_reset on v2:172.21.15.12:6836/1211628710 2023-10-21T16:28:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 >> 172.21.15.12:0/1812409619 conn(0x5588a36413e0 msgr2=0x5588a3669ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 shutdown_connections 2023-10-21T16:28:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.280+0000 7fc2a824e740 1 -- 172.21.15.12:0/1812409619 wait complete. 2023-10-21T16:28:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.281+0000 7fc2a824e740 20 client.4564 trim_cache size 0 max 16384 2023-10-21T16:28:04.285 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T16:28:04.285 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "31504b75-3b00-4d04-9abc-c2f1cbe20b72", 2023-10-21T16:28:04.285 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-21T16:28:04.285 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4274, 2023-10-21T16:28:04.286 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-21T16:28:04.286 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-21T16:28:04.286 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-21T16:28:04.286 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 31.382831422999999, 2023-10-21T16:28:04.286 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 8, 2023-10-21T16:28:04.287 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 25, 2023-10-21T16:28:04.287 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 23, 2023-10-21T16:28:04.287 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 40.840846573 2023-10-21T16:28:04.287 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T16:28:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 msgr2=0x7fc28c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 0x7fc28c06d2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc298000c00 tx=0x7fc298016000 comp rx=0 tx=0).stop 2023-10-21T16:28:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 msgr2=0x7fc2a0146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 0x7fc2a0146ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc294033000 tx=0x7fc294004730 comp rx=0 tx=0).stop 2023-10-21T16:28:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 shutdown_connections 2023-10-21T16:28:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc28c06ae30 0x7fc28c06d2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a015a590 0x7fc2a0140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2a00c59d0 0x7fc2a0146ba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 --2- 172.21.15.12:0/3464183504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2a00c55f0 0x7fc2a0071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 >> 172.21.15.12:0/3464183504 conn(0x7fc2a0069de0 msgr2=0x7fc2a00ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 shutdown_connections 2023-10-21T16:28:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.283+0000 7fc2a56bb640 1 -- 172.21.15.12:0/3464183504 wait complete. 2023-10-21T16:28:04.312 INFO:teuthology.run_tasks:Running task kclient... 2023-10-21T16:28:04.337 INFO:tasks.kclient:Mounting kernel clients... 2023-10-21T16:28:04.337 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-21T16:28:04.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:04.338 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-21T16:28:04.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:04.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-21T16:28:04.484 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-10-21T16:28:04.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T16:28:04.488 INFO:tasks.kclient:client.0 config is {} 2023-10-21T16:28:04.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-21T16:28:04.489 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:04.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-21T16:28:04.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.706+0000 7f86a6661640 1 Processor -- start 2023-10-21T16:28:04.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.706+0000 7f86a6661640 1 -- start start 2023-10-21T16:28:04.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.707+0000 7f86a6661640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86a0071510 0x7f86a006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.707+0000 7f86a6661640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a015a450 con 0x7f86a0156530 2023-10-21T16:28:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.707+0000 7f86a6661640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a0156050 con 0x7f86a01500d0 2023-10-21T16:28:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.707+0000 7f86a6661640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a0159eb0 con 0x7f86a0071510 2023-10-21T16:28:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.708+0000 7f869ffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f86a01500d0 0x7f86a00c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:39736/0 (socket says 172.21.15.12:39736) 2023-10-21T16:28:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.708+0000 7f869ffff640 1 -- 172.21.15.12:0/1902435811 learned_addr learned my addr 172.21.15.12:0/1902435811 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T16:28:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.708+0000 7f869f7fe640 1 --2- 172.21.15.12:0/1902435811 >> v2:172.21.15.99:3300/0 conn(0x7f86a0071510 0x7f86a006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.711+0000 7f869f7fe640 1 -- 172.21.15.12:0/1902435811 >> v1:172.21.15.99:6789/0 conn(0x7f86a01500d0 legacy=0x7f86a00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.711+0000 7f869f7fe640 1 -- 172.21.15.12:0/1902435811 >> v1:172.21.15.12:6789/0 conn(0x7f86a0156530 legacy=0x7f86a0156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.711+0000 7f869f7fe640 1 -- 172.21.15.12:0/1902435811 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00721c0 con 0x7f86a0071510 2023-10-21T16:28:04.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.714+0000 7f869f7fe640 1 --2- 172.21.15.12:0/1902435811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a0071510 0x7f86a006fd70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86880097a0 tx=0x7f868802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8478543a5de45a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:04.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.718+0000 7f869effd640 1 -- 172.21.15.12:0/1902435811 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688030610 con 0x7f86a0071510 2023-10-21T16:28:04.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.718+0000 7f869effd640 1 -- 172.21.15.12:0/1902435811 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688030770 con 0x7f86a0071510 2023-10-21T16:28:04.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.718+0000 7f869effd640 1 -- 172.21.15.12:0/1902435811 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688030b00 con 0x7f86a0071510 2023-10-21T16:28:04.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 -- 172.21.15.12:0/1902435811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a0071510 msgr2=0x7f86a006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 --2- 172.21.15.12:0/1902435811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a0071510 0x7f86a006fd70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86880097a0 tx=0x7f868802b960 comp rx=0 tx=0).stop 2023-10-21T16:28:04.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 -- 172.21.15.12:0/1902435811 shutdown_connections 2023-10-21T16:28:04.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 --2- 172.21.15.12:0/1902435811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a0071510 0x7f86a006fd70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 -- 172.21.15.12:0/1902435811 >> 172.21.15.12:0/1902435811 conn(0x7f86a0069de0 msgr2=0x7f86a006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:04.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 -- 172.21.15.12:0/1902435811 shutdown_connections 2023-10-21T16:28:04.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.719+0000 7f86a6661640 1 -- 172.21.15.12:0/1902435811 wait complete. 2023-10-21T16:28:04.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.721+0000 7f86a6661640 1 Processor -- start 2023-10-21T16:28:04.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.721+0000 7f86a6661640 1 -- start start 2023-10-21T16:28:04.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 0x7f86a01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 0x7f86a0141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86a0156530 0x7f86a0157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0143c00 con 0x7f86a0071510 2023-10-21T16:28:04.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a014dc10 con 0x7f86a01500d0 2023-10-21T16:28:04.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.722+0000 7f86a6661640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a014def0 con 0x7f86a0156530 2023-10-21T16:28:04.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.723+0000 7f869f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 0x7f86a0141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.723+0000 7f86a4bfe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86a0156530 0x7f86a0157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.723+0000 7f869ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 0x7f86a01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.723+0000 7f869f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 0x7f86a0141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57792/0 (socket says 172.21.15.12:57792) 2023-10-21T16:28:04.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.723+0000 7f869f7fe640 1 -- 172.21.15.12:0/746357579 learned_addr learned my addr 172.21.15.12:0/746357579 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T16:28:04.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.728+0000 7f869ffff640 1 -- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86a0156530 msgr2=0x7f86a0157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.728+0000 7f869ffff640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86a0156530 0x7f86a0157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.728+0000 7f869ffff640 1 -- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 msgr2=0x7f86a0141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:04.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.728+0000 7f869ffff640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 0x7f86a0141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:04.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.728+0000 7f869ffff640 1 -- 172.21.15.12:0/746357579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688009400 con 0x7f86a0071510 2023-10-21T16:28:04.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.730+0000 7f869ffff640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 0x7f86a01551d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f869000ca80 tx=0x7f869000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:04.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.735+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000ac30 con 0x7f86a0071510 2023-10-21T16:28:04.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.735+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000ad90 con 0x7f86a0071510 2023-10-21T16:28:04.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.735+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690012620 con 0x7f86a0071510 2023-10-21T16:28:04.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.735+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a014e1d0 con 0x7f86a0071510 2023-10-21T16:28:04.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.736+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a0154cd0 con 0x7f86a0071510 2023-10-21T16:28:04.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.737+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00619f0 con 0x7f86a0071510 2023-10-21T16:28:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.760+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8690007070 con 0x7f86a0071510 2023-10-21T16:28:04.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.762+0000 7f869cff9640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 0x7f868006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T16:28:04.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.762+0000 7f869f7fe640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 0x7f868006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T16:28:04.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:04.763+0000 7f869f7fe640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 0x7f868006d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86a0146a70 tx=0x7f868803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T16:28:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.079+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8690013e70 con 0x7f86a0071510 2023-10-21T16:28:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.080+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8690054a80 con 0x7f86a0071510 2023-10-21T16:28:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.331+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86a00c3660 con 0x7f86a0071510 2023-10-21T16:28:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.347+0000 7f869cff9640 1 -- 172.21.15.12:0/746357579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8690017070 con 0x7f86a0071510 2023-10-21T16:28:05.349 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-21T16:28:05.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 msgr2=0x7f868006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 0x7f868006d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86a0146a70 tx=0x7f868803b040 comp rx=0 tx=0).stop 2023-10-21T16:28:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 msgr2=0x7f86a01551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T16:28:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 0x7f86a01551d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f869000ca80 tx=0x7f869000cf40 comp rx=0 tx=0).stop 2023-10-21T16:28:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 shutdown_connections 2023-10-21T16:28:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f868006aec0 0x7f868006d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86a0156530 0x7f86a0157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a01500d0 0x7f86a0141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 --2- 172.21.15.12:0/746357579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a0071510 0x7f86a01551d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T16:28:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.349+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 >> 172.21.15.12:0/746357579 conn(0x7f86a0069de0 msgr2=0x7f86a00c7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T16:28:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.350+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 shutdown_connections 2023-10-21T16:28:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T16:28:05.350+0000 7f86a6661640 1 -- 172.21.15.12:0/746357579 wait complete. 2023-10-21T16:28:05.372 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-21T16:28:05.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-21T16:28:05.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-21T16:28:05.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-21T16:28:05.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:05.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-21T16:28:05.374 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-21T16:28:05.374 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-21T16:28:05.374 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-21T16:28:05.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:05.375 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-21T16:28:05.428 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-21T16:28:05.428 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-21T16:28:05.428 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-21T16:28:05.428 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-21T16:28:05.429 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-21T16:28:05.429 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-21T16:28:05.429 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-21T16:28:05.429 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-21T16:28:05.429 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-21T16:28:05.430 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-21T16:28:05.430 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-21T16:28:05.430 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-21T16:28:05.430 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-21T16:28:05.431 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-21T16:28:05.431 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-21T16:28:05.431 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-21T16:28:05.431 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41925sec preferred_lft 41925sec 2023-10-21T16:28:05.431 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-21T16:28:05.432 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-21T16:28:05.432 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-21T16:28:05.432 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-21T16:28:05.432 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-21T16:28:05.433 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-21T16:28:05.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:05.433 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-21T16:28:05.434 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-21T16:28:05.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2023-10-21T16:28:05.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2023-10-21T16:28:05.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2023-10-21T16:28:05.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-21T16:28:05.435 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-21T16:28:05.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:05.925 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-21T16:28:06.012 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-21T16:28:06.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:06.017 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-21T16:28:06.069 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-21T16:28:06.069 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-21T16:28:06.069 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-21T16:28:06.070 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-21T16:28:06.070 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-21T16:28:06.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:06.071 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-21T16:28:06.071 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-21T16:28:06.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-21T16:28:06.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-21T16:28:06.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-21T16:28:06.073 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-21T16:28:06.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:06.873 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-21T16:28:06.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:06.936 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-10-21T16:28:06.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:06.995 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-21T16:28:06.996 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-21T16:28:06.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-21T16:28:06.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-21T16:28:06.996 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-21T16:28:07.134 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-21T16:28:07.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:07.135 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-21T16:28:07.135 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-21T16:28:07.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-21T16:28:07.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-21T16:28:07.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-21T16:28:07.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-21T16:28:07.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-21T16:28:07.137 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-21T16:28:07.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:07.421 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-21T16:28:07.421 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-21T16:28:07.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-21T16:28:07.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2023-10-21T16:28:07.422 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-21T16:28:07.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-21T16:28:07.590 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:07.640 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-21T16:28:07.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-21T16:28:07.640 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:07.694 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-21T16:28:07.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:07.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-21T16:28:07.855 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-21T16:28:07.856 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-21T16:28:08.792 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-21T16:28:08.792 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-21T16:28:08.792 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.99:3300,172.21.15.99:3301" 2023-10-21T16:28:08.793 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@31504b75-3b00-4d04-9abc-c2f1cbe20b72.cephfs=/ 2023-10-21T16:28:08.793 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.99:3300/172.21.15.99:3301" will pass to kernel 2023-10-21T16:28:08.800 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-10-21T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2023-10-21T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-21T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2023-10-21T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-21T16:28:08.807 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-21T16:28:08.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:08.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:09.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:09.054 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-21T16:28:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:client4573 2023-10-21T16:28:09.621 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:28:09.621 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-21T16:28:09.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:09.684 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-21T16:28:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:client4573 2023-10-21T16:28:10.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:10.436 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-21T16:28:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:client4573 2023-10-21T16:28:10.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T16:28:10.967 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/31504b75-3b00-4d04-9abc-c2f1cbe20b72.client4573/status') 2023-10-21T16:28:11.339 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4573 (3)172.21.15.12:0/836327830 2023-10-21T16:28:11.339 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2023-10-21T16:28:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2023-10-21T16:28:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2023-10-21T16:28:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:69 bytes copied, 8.1916e-05 s, 842 kB/s 2023-10-21T16:28:11.350 INFO:teuthology.run_tasks:Running task workunit... 2023-10-21T16:28:11.362 INFO:tasks.workunit:Pulling workunits from ref f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:28:11.363 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-21T16:28:11.363 INFO:tasks.workunit:timeout=6h 2023-10-21T16:28:11.363 INFO:tasks.workunit:cleanup=True 2023-10-21T16:28:11.364 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-21T16:28:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 27h/39d Inode: 1 Links: 2 2023-10-21T16:28:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-21T16:28:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:unlabeled_t:s0 2023-10-21T16:28:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-21T16:28:11.438 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-21 16:27:33.225271799 +0000 2023-10-21T16:28:11.438 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-21 16:28:08.897770548 +0000 2023-10-21T16:28:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-21 16:27:33.225271799 +0000 2023-10-21T16:28:11.438 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-21T16:28:11.439 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-21T16:28:12.148 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f0804064d67a2a63dbabf1801ff452580a050cfc 2023-10-21T16:28:12.214 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-21T16:28:21.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:28:21.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:28:51.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:28:51.678 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:29:04.803 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 64% (7517/11620) Updating files: 65% (7553/11620) Updating files: 66% (7670/11620) Updating files: 67% (7786/11620) Updating files: 68% (7902/11620) Updating files: 69% (8018/11620) Updating files: 70% (8134/11620) Updating files: 71% (8251/11620) Updating files: 72% (8367/11620) Updating files: 73% (8483/11620) Updating files: 74% (8599/11620) Updating files: 75% (8715/11620) Updating files: 76% (8832/11620) Updating files: 77% (8948/11620) Updating files: 78% (9064/11620) Updating files: 79% (9180/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-10-21T16:29:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'f0804064d67a2a63dbabf1801ff452580a050cfc'. 2023-10-21T16:29:06.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-21T16:29:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-21T16:29:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-21T16:29:06.022 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.022 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-21T16:29:06.022 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-21T16:29:06.022 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.023 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-21T16:29:06.023 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.023 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-21T16:29:06.023 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.023 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-21T16:29:06.024 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.024 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-21T16:29:06.024 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-21T16:29:06.024 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at f0804064d67 Merge pull request #54109 from ceph/wip-yuri-crontab-main 2023-10-21T16:29:06.033 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-21T16:29:06.094 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-21T16:29:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-21T16:29:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-21T16:29:06.880 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-21T16:29:06.999 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-21T16:29:07.095 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-21T16:29:07.101 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-21T16:29:07.102 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-21T16:29:07.190 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-21T16:29:07.199 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T16:29:07.200 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-21T16:29:07.257 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-10-21T16:29:07.259 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-10-21T16:29:07.259 DEBUG:teuthology.orchestra.run.smithi012:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0804064d67a2a63dbabf1801ff452580a050cfc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-10-21T16:29:07.543 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir -p fsstress 2023-10-21T16:29:07.626 INFO:tasks.workunit.client.0.smithi012.stderr:+ pushd fsstress 2023-10-21T16:29:07.626 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-21T16:29:07.627 INFO:tasks.workunit.client.0.smithi012.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-10-21T16:29:08.532 INFO:tasks.workunit.client.0.smithi012.stderr:+ tar xzf ltp-full.tgz 2023-10-21T16:29:21.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:29:21.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:29:51.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:29:51.941 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:30:22.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:30:22.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:30:52.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:30:52.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:31:22.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:31:22.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:31:52.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:31:52.734 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:32:22.867 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:32:22.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:32:53.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:32:53.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:33:23.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:33:23.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:33:53.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:33:53.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:34:23.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:34:23.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:34:53.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:34:53.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:35:23.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:35:23.746 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:35:34.452 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:00.434 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.538 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:00.622 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.543 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:00.627 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.589 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:00.571 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.599 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:00.683 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.604 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:00.689 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.943 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:01.027 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:34.955 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:01.039 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:35.284 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:01.266 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:35:53.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:35:53.893 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:36:24.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:36:24.027 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:36:30.501 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:56.484 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.519 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:56.604 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.522 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:56.606 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.529 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:56.511 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.532 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:56.616 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.536 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:56.620 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.578 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:09:56.662 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.594 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:09:56.678 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:30.791 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:09:56.773 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:36:54.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:36:54.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:37:24.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:37:24.391 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:37:54.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:37:54.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:38:24.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:38:24.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:38:55.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:38:55.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:39:25.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:39:25.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:39:55.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:39:55.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:39:58.399 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:13:24.380 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.409 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:13:24.390 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.471 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:13:24.555 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.478 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:13:24.562 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.487 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:13:24.571 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.488 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:13:24.572 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.547 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:13:24.632 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.559 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:13:24.643 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:39:58.617 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:13:24.599 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:40:25.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:40:25.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:40:55.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:40:55.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:41:25.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:41:25.793 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:41:55.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:41:55.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:42:26.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:42:26.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:42:56.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:42:56.249 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:43:25.232 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:16:51.214 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.240 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:16:51.222 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.281 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:16:51.365 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.282 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:16:51.367 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.299 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:16:51.383 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.300 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:16:51.385 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.358 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:16:51.442 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.370 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:16:51.454 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:25.385 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:16:51.368 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:26.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:43:26.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:43:56.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:43:56.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:43:58.133 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:17:24.115 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.144 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:17:24.127 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.194 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:17:24.278 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.197 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:17:24.281 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.198 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:17:24.282 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.204 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:17:24.288 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.212 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:17:24.195 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.221 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:17:24.305 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:43:58.225 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:17:24.309 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:44:26.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:44:26.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:44:56.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:44:57.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:45:27.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:45:27.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:45:57.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:45:57.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:46:27.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:46:27.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:46:57.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:46:57.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:47:28.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:47:28.150 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:47:58.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:47:58.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:48:28.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:48:28.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:48:58.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:48:58.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:49:28.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:49:28.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:49:58.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:49:58.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:50:20.499 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:23:46.481 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.514 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:23:46.598 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.516 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:23:46.600 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.518 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:23:46.501 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.520 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:23:46.604 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.522 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:23:46.606 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.648 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:23:46.732 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.656 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:23:46.740 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:20.718 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:23:46.700 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:50:29.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:50:29.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:50:59.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:50:59.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:51:01.651 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:24:27.634 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.662 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:24:27.645 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.700 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:24:27.784 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.701 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:24:27.785 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.707 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:24:27.792 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.708 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:24:27.792 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.734 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:24:27.818 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.734 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:24:27.818 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:01.920 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:24:27.903 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:51:29.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:51:29.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:51:59.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:51:59.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:52:17.221 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:25:43.203 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.280 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:25:43.364 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.281 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:25:43.366 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.310 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:25:43.394 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.343 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:25:43.325 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.388 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:25:43.472 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.392 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:25:43.477 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.421 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:25:43.506 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:17.446 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:25:43.426 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:52:29.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:52:29.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:52:59.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:52:59.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:53:29.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:53:29.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:53:47.621 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:27:13.604 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.628 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:27:13.712 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.630 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:27:13.714 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.636 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:27:13.618 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.641 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:27:13.725 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.643 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:27:13.728 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.677 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:27:13.762 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.689 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:27:13.773 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:53:47.758 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:27:13.741 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:54:00.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:54:00.118 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:54:30.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:54:30.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:55:00.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:55:00.385 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:55:30.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:55:30.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:56:00.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:56:00.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:56:30.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:56:30.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:57:01.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:57:01.104 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:57:15.325 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:30:41.307 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.335 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:30:41.420 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.337 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:30:41.422 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.338 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:30:41.422 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.340 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:30:41.424 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.348 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:30:41.331 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.410 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:30:41.494 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.413 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:30:41.498 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:15.625 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:30:41.607 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:57:31.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:57:31.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:58:01.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:58:01.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:58:31.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:58:31.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:59:01.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:59:01.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:59:26.163 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:32:52.146 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.273 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:32:52.256 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.339 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:32:52.423 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.344 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:32:52.429 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.353 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:32:52.437 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.356 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:32:52.441 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.402 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:32:52.486 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.407 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:32:52.492 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:26.458 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:32:52.441 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T16:59:31.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T16:59:31.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:00:01.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:00:01.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:00:32.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:00:32.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:00:39.517 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:34:05.499 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.530 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:34:05.615 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.532 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:34:05.617 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.540 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:34:05.624 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.542 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:34:05.626 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.542 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:34:05.525 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.570 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:34:05.654 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.579 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:34:05.663 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:00:39.679 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:34:05.661 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:01:02.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:01:02.256 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:01:32.378 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:01:32.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:02:02.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:02:02.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:02:32.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:02:32.702 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:02:40.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-10-21T17:02:41.259 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-21T17:02:41.260 INFO:tasks.workunit.client.0.smithi012.stderr:+ make 2023-10-21T17:02:43.116 INFO:tasks.workunit.client.0.smithi012.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-10-21T17:02:44.989 INFO:tasks.workunit.client.0.smithi012.stderr:++ readlink -f fsstress 2023-10-21T17:02:44.992 INFO:tasks.workunit.client.0.smithi012.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-10-21T17:02:44.992 INFO:tasks.workunit.client.0.smithi012.stderr:+ popd 2023-10-21T17:02:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-21T17:02:44.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ popd 2023-10-21T17:02:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp 2023-10-21T17:02:44.994 INFO:tasks.workunit.client.0.smithi012.stderr:++ mktemp -d -p . 2023-10-21T17:02:45.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ T=./tmp.1NpNbR4s6h 2023-10-21T17:02:45.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.1NpNbR4s6h -l 1 -n 1000 -p 10 -v 2023-10-21T17:02:45.105 INFO:tasks.workunit.client.0.smithi012.stdout:seed = 1698013019 2023-10-21T17:02:45.283 INFO:tasks.workunit.client.0.smithi012.stdout:0/0: dread - no filename 2023-10-21T17:02:45.284 INFO:tasks.workunit.client.0.smithi012.stdout:0/1: rename - no filename 2023-10-21T17:02:45.284 INFO:tasks.workunit.client.0.smithi012.stdout:0/2: write - no filename 2023-10-21T17:02:45.284 INFO:tasks.workunit.client.0.smithi012.stdout:0/3: readlink - no filename 2023-10-21T17:02:45.284 INFO:tasks.workunit.client.0.smithi012.stdout:0/4: dwrite - no filename 2023-10-21T17:02:45.285 INFO:tasks.workunit.client.0.smithi012.stdout:0/5: rmdir - no directory 2023-10-21T17:02:45.285 INFO:tasks.workunit.client.0.smithi012.stdout:0/6: dwrite - no filename 2023-10-21T17:02:45.285 INFO:tasks.workunit.client.0.smithi012.stdout:0/7: dread - no filename 2023-10-21T17:02:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:0/8: creat f0 x:0 0 0 2023-10-21T17:02:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:1/0: fsync - no filename 2023-10-21T17:02:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:1/1: fsync - no filename 2023-10-21T17:02:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:1/2: fsync - no filename 2023-10-21T17:02:45.375 INFO:tasks.workunit.client.0.smithi012.stdout:1/3: dread - no filename 2023-10-21T17:02:45.375 INFO:tasks.workunit.client.0.smithi012.stdout:0/9: truncate f0 554657 0 2023-10-21T17:02:45.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/4: creat f0 x:0 0 0 2023-10-21T17:02:45.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/0: write - no filename 2023-10-21T17:02:45.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/1: write - no filename 2023-10-21T17:02:45.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/2: write - no filename 2023-10-21T17:02:45.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/3: chown . 6673 1 2023-10-21T17:02:45.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/4: rename - no filename 2023-10-21T17:02:45.523 INFO:tasks.workunit.client.0.smithi012.stdout:2/5: rmdir - no directory 2023-10-21T17:02:45.523 INFO:tasks.workunit.client.0.smithi012.stdout:2/6: rename - no filename 2023-10-21T17:02:45.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/5: write f0 [526739,112778] 0 2023-10-21T17:02:45.524 INFO:tasks.workunit.client.0.smithi012.stdout:1/6: truncate f0 1313415 0 2023-10-21T17:02:45.524 INFO:tasks.workunit.client.0.smithi012.stdout:1/7: readlink - no filename 2023-10-21T17:02:45.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/10: link f0 f1 0 2023-10-21T17:02:45.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/11: chown f0 7147605 1 2023-10-21T17:02:45.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/7: creat f0 x:0 0 0 2023-10-21T17:02:45.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/8: chown f0 2 1 2023-10-21T17:02:45.727 INFO:tasks.workunit.client.0.smithi012.stdout:2/9: chown f0 2095797969 1 2023-10-21T17:02:45.727 INFO:tasks.workunit.client.0.smithi012.stdout:2/10: stat f0 0 2023-10-21T17:02:45.727 INFO:tasks.workunit.client.0.smithi012.stdout:2/11: chown f0 47 1 2023-10-21T17:02:45.727 INFO:tasks.workunit.client.0.smithi012.stdout:2/12: dread - f0 zero size 2023-10-21T17:02:45.754 INFO:tasks.workunit.client.0.smithi012.stdout:0/12: rename f0 to f2 0 2023-10-21T17:02:45.769 INFO:tasks.workunit.client.0.smithi012.stdout:0/13: write f1 [39700,87283] 0 2023-10-21T17:02:45.769 INFO:tasks.workunit.client.0.smithi012.stdout:0/14: creat f3 x:0 0 0 2023-10-21T17:02:45.819 INFO:tasks.workunit.client.0.smithi012.stdout:2/13: dwrite f0 [0,4194304] 0 2023-10-21T17:02:45.852 INFO:tasks.workunit.client.0.smithi012.stdout:2/14: dread f0 [0,4194304] 0 2023-10-21T17:02:45.920 INFO:tasks.workunit.client.0.smithi012.stdout:2/15: dwrite f0 [0,4194304] 0 2023-10-21T17:02:45.944 INFO:tasks.workunit.client.0.smithi012.stdout:2/16: write f0 [1688298,127383] 0 2023-10-21T17:02:45.950 INFO:tasks.workunit.client.0.smithi012.stdout:2/17: fdatasync f0 0 2023-10-21T17:02:46.014 INFO:tasks.workunit.client.0.smithi012.stdout:2/18: dwrite f0 [0,4194304] 0 2023-10-21T17:02:46.030 INFO:tasks.workunit.client.0.smithi012.stdout:3/0: mkdir d0 0 2023-10-21T17:02:46.030 INFO:tasks.workunit.client.0.smithi012.stdout:3/1: stat d0 0 2023-10-21T17:02:46.030 INFO:tasks.workunit.client.0.smithi012.stdout:4/0: dwrite - no filename 2023-10-21T17:02:46.031 INFO:tasks.workunit.client.0.smithi012.stdout:4/1: dread - no filename 2023-10-21T17:02:46.031 INFO:tasks.workunit.client.0.smithi012.stdout:4/2: write - no filename 2023-10-21T17:02:46.031 INFO:tasks.workunit.client.0.smithi012.stdout:4/3: fsync - no filename 2023-10-21T17:02:46.031 INFO:tasks.workunit.client.0.smithi012.stdout:4/4: dread - no filename 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/5: link - no file 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/6: chown . 5059 1 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/7: dwrite - no filename 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/8: rename - no filename 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/9: fdatasync - no filename 2023-10-21T17:02:46.032 INFO:tasks.workunit.client.0.smithi012.stdout:4/10: dread - no filename 2023-10-21T17:02:46.033 INFO:tasks.workunit.client.0.smithi012.stdout:4/11: truncate - no filename 2023-10-21T17:02:46.033 INFO:tasks.workunit.client.0.smithi012.stdout:4/12: rename - no filename 2023-10-21T17:02:46.033 INFO:tasks.workunit.client.0.smithi012.stdout:3/2: rename d0 to d0/d1 22 2023-10-21T17:02:46.034 INFO:tasks.workunit.client.0.smithi012.stdout:0/15: symlink l4 0 2023-10-21T17:02:46.212 INFO:tasks.workunit.client.0.smithi012.stdout:2/19: mkdir d1 0 2023-10-21T17:02:46.213 INFO:tasks.workunit.client.0.smithi012.stdout:2/20: stat f0 0 2023-10-21T17:02:46.213 INFO:tasks.workunit.client.0.smithi012.stdout:2/21: truncate f0 4279215 0 2023-10-21T17:02:46.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/0: rename - no filename 2023-10-21T17:02:46.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/1: rename - no filename 2023-10-21T17:02:46.246 INFO:tasks.workunit.client.0.smithi012.stdout:2/22: write f0 [1488173,118018] 0 2023-10-21T17:02:46.283 INFO:tasks.workunit.client.0.smithi012.stdout:4/13: symlink l0 0 2023-10-21T17:02:46.284 INFO:tasks.workunit.client.0.smithi012.stdout:4/14: truncate - no filename 2023-10-21T17:02:46.284 INFO:tasks.workunit.client.0.smithi012.stdout:3/3: creat d0/f2 x:0 0 0 2023-10-21T17:02:46.284 INFO:tasks.workunit.client.0.smithi012.stdout:3/4: write d0/f2 [972600,22784] 0 2023-10-21T17:02:46.292 INFO:tasks.workunit.client.0.smithi012.stdout:0/16: link f1 f5 0 2023-10-21T17:02:46.292 INFO:tasks.workunit.client.0.smithi012.stdout:0/17: rmdir - no directory 2023-10-21T17:02:46.292 INFO:tasks.workunit.client.0.smithi012.stdout:0/18: creat f6 x:0 0 0 2023-10-21T17:02:46.342 INFO:tasks.workunit.client.0.smithi012.stdout:0/19: dwrite f2 [0,4194304] 0 2023-10-21T17:02:47.995 INFO:tasks.workunit.client.0.smithi012.stdout:1/8: truncate f0 641636 0 2023-10-21T17:02:48.038 INFO:tasks.workunit.client.0.smithi012.stdout:0/20: fsync f3 0 2023-10-21T17:02:49.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/23: mkdir d1/d2 0 2023-10-21T17:02:49.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/9: write f0 [1445446,37707] 0 2023-10-21T17:02:49.836 INFO:tasks.workunit.client.0.smithi012.stdout:1/10: write f0 [1701408,115258] 0 2023-10-21T17:02:49.837 INFO:tasks.workunit.client.0.smithi012.stdout:1/11: creat f1 x:0 0 0 2023-10-21T17:02:49.850 INFO:tasks.workunit.client.0.smithi012.stdout:2/24: dwrite f0 [0,4194304] 0 2023-10-21T17:02:49.889 INFO:tasks.workunit.client.0.smithi012.stdout:4/15: creat f1 x:0 0 0 2023-10-21T17:02:49.889 INFO:tasks.workunit.client.0.smithi012.stdout:4/16: stat l0 0 2023-10-21T17:02:50.151 INFO:tasks.workunit.client.0.smithi012.stdout:7/0: truncate - no filename 2023-10-21T17:02:50.151 INFO:tasks.workunit.client.0.smithi012.stdout:7/1: dread - no filename 2023-10-21T17:02:50.152 INFO:tasks.workunit.client.0.smithi012.stdout:7/2: link - no file 2023-10-21T17:02:50.152 INFO:tasks.workunit.client.0.smithi012.stdout:7/3: fdatasync - no filename 2023-10-21T17:02:50.152 INFO:tasks.workunit.client.0.smithi012.stdout:7/4: chown . 66915065 1 2023-10-21T17:02:50.152 INFO:tasks.workunit.client.0.smithi012.stdout:7/5: write - no filename 2023-10-21T17:02:50.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/6: dread - no filename 2023-10-21T17:02:50.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/7: dread - no filename 2023-10-21T17:02:50.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/8: dwrite - no filename 2023-10-21T17:02:50.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/9: dread - no filename 2023-10-21T17:03:02.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:03:02.840 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:03:28.492 INFO:tasks.workunit.client.0.smithi012.stdout:0/21: mkdir d7 0 2023-10-21T17:03:28.868 INFO:tasks.workunit.client.0.smithi012.stdout:1/12: mknod c2 0 2023-10-21T17:03:29.000 INFO:tasks.workunit.client.0.smithi012.stdout:4/17: symlink l2 0 2023-10-21T17:03:29.000 INFO:tasks.workunit.client.0.smithi012.stdout:4/18: chown f1 27421633 1 2023-10-21T17:03:29.135 INFO:tasks.workunit.client.0.smithi012.stdout:3/5: rmdir d0 39 2023-10-21T17:03:29.981 INFO:tasks.workunit.client.0.smithi012.stdout:0/22: mkdir d7/d8 0 2023-10-21T17:03:30.020 INFO:tasks.workunit.client.0.smithi012.stdout:0/23: dread f1 [0,4194304] 0 2023-10-21T17:03:30.045 INFO:tasks.workunit.client.0.smithi012.stdout:0/24: dread f5 [0,4194304] 0 2023-10-21T17:03:30.130 INFO:tasks.workunit.client.0.smithi012.stdout:1/13: mknod c3 0 2023-10-21T17:03:30.130 INFO:tasks.workunit.client.0.smithi012.stdout:4/19: symlink l3 0 2023-10-21T17:03:30.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/14: creat f4 x:0 0 0 2023-10-21T17:03:30.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/15: dread - f4 zero size 2023-10-21T17:03:30.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/16: stat c2 0 2023-10-21T17:03:30.154 INFO:tasks.workunit.client.0.smithi012.stdout:1/17: dread f0 [0,4194304] 0 2023-10-21T17:03:30.185 INFO:tasks.workunit.client.0.smithi012.stdout:3/6: symlink d0/l3 0 2023-10-21T17:03:30.301 INFO:tasks.workunit.client.0.smithi012.stdout:0/25: mkdir d7/d8/d9 0 2023-10-21T17:03:30.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/20: symlink l4 0 2023-10-21T17:03:30.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/21: readlink l4 0 2023-10-21T17:03:30.558 INFO:tasks.workunit.client.0.smithi012.stdout:1/18: mkdir d5 0 2023-10-21T17:03:30.559 INFO:tasks.workunit.client.0.smithi012.stdout:1/19: write f1 [336657,39277] 0 2023-10-21T17:03:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/20: dwrite f0 [0,4194304] 0 2023-10-21T17:03:30.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/21: dwrite f1 [0,4194304] 0 2023-10-21T17:03:30.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/22: stat c3 0 2023-10-21T17:03:30.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/23: readlink - no filename 2023-10-21T17:03:30.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/24: readlink - no filename 2023-10-21T17:03:30.726 INFO:tasks.workunit.client.0.smithi012.stdout:1/25: readlink - no filename 2023-10-21T17:03:30.734 INFO:tasks.workunit.client.0.smithi012.stdout:3/7: link d0/f2 d0/f4 0 2023-10-21T17:03:30.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/26: write f1 [3396050,121163] 0 2023-10-21T17:03:30.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/27: getdents d5 0 2023-10-21T17:03:30.760 INFO:tasks.workunit.client.0.smithi012.stdout:1/28: getdents d5 0 2023-10-21T17:03:30.769 INFO:tasks.workunit.client.0.smithi012.stdout:0/26: mknod d7/d8/d9/ca 0 2023-10-21T17:03:31.580 INFO:tasks.workunit.client.0.smithi012.stdout:4/22: symlink l5 0 2023-10-21T17:03:31.694 INFO:tasks.workunit.client.0.smithi012.stdout:4/23: dwrite f1 [0,4194304] 0 2023-10-21T17:03:31.695 INFO:tasks.workunit.client.0.smithi012.stdout:4/24: creat f6 x:0 0 0 2023-10-21T17:03:31.695 INFO:tasks.workunit.client.0.smithi012.stdout:4/25: write f6 [456719,124603] 0 2023-10-21T17:03:31.775 INFO:tasks.workunit.client.0.smithi012.stdout:4/26: dwrite f1 [0,4194304] 0 2023-10-21T17:03:31.776 INFO:tasks.workunit.client.0.smithi012.stdout:4/27: rmdir - no directory 2023-10-21T17:03:31.885 INFO:tasks.workunit.client.0.smithi012.stdout:4/28: dwrite f6 [0,4194304] 0 2023-10-21T17:03:31.898 INFO:tasks.workunit.client.0.smithi012.stdout:1/29: symlink d5/l6 0 2023-10-21T17:03:31.919 INFO:tasks.workunit.client.0.smithi012.stdout:4/29: write f6 [2126543,106243] 0 2023-10-21T17:03:31.919 INFO:tasks.workunit.client.0.smithi012.stdout:4/30: truncate f6 4799209 0 2023-10-21T17:03:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:4/31: chown l3 1014 1 2023-10-21T17:03:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:4/32: write f6 [4046234,40291] 0 2023-10-21T17:03:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:4/33: write f6 [864177,63287] 0 2023-10-21T17:03:31.921 INFO:tasks.workunit.client.0.smithi012.stdout:4/34: creat f7 x:0 0 0 2023-10-21T17:03:32.009 INFO:tasks.workunit.client.0.smithi012.stdout:4/35: dwrite f7 [0,4194304] 0 2023-10-21T17:03:32.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/36: dread f7 [0,4194304] 0 2023-10-21T17:03:32.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/37: chown l5 14195408 1 2023-10-21T17:03:32.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/38: readlink l0 0 2023-10-21T17:03:32.091 INFO:tasks.workunit.client.0.smithi012.stdout:0/27: mknod d7/d8/d9/cb 0 2023-10-21T17:03:32.092 INFO:tasks.workunit.client.0.smithi012.stdout:0/28: fdatasync f2 0 2023-10-21T17:03:32.092 INFO:tasks.workunit.client.0.smithi012.stdout:0/29: read - f6 zero size 2023-10-21T17:03:32.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/30: symlink d5/l7 0 2023-10-21T17:03:32.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/31: stat f1 0 2023-10-21T17:03:32.324 INFO:tasks.workunit.client.0.smithi012.stdout:1/32: fsync f0 0 2023-10-21T17:03:32.509 INFO:tasks.workunit.client.0.smithi012.stdout:4/39: unlink l5 0 2023-10-21T17:03:32.815 INFO:tasks.workunit.client.0.smithi012.stdout:1/33: mkdir d5/d8 0 2023-10-21T17:03:32.978 INFO:tasks.workunit.client.0.smithi012.stdout:4/40: rename f6 to f8 0 2023-10-21T17:03:32.979 INFO:tasks.workunit.client.0.smithi012.stdout:4/41: write f8 [2578180,38797] 0 2023-10-21T17:03:32.979 INFO:tasks.workunit.client.0.smithi012.stdout:4/42: rmdir - no directory 2023-10-21T17:03:32.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:03:32.997 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:03:33.014 INFO:tasks.workunit.client.0.smithi012.stdout:4/43: dread f8 [0,4194304] 0 2023-10-21T17:03:33.057 INFO:tasks.workunit.client.0.smithi012.stdout:1/34: unlink f0 0 2023-10-21T17:03:33.098 INFO:tasks.workunit.client.0.smithi012.stdout:4/44: symlink l9 0 2023-10-21T17:03:33.099 INFO:tasks.workunit.client.0.smithi012.stdout:4/45: chown l4 4512 1 2023-10-21T17:03:35.497 INFO:tasks.workunit.client.0.smithi012.stdout:5/2: sync 2023-10-21T17:03:35.497 INFO:tasks.workunit.client.0.smithi012.stdout:5/3: unlink - no file 2023-10-21T17:03:35.497 INFO:tasks.workunit.client.0.smithi012.stdout:6/0: sync 2023-10-21T17:03:35.497 INFO:tasks.workunit.client.0.smithi012.stdout:6/1: dwrite - no filename 2023-10-21T17:03:35.497 INFO:tasks.workunit.client.0.smithi012.stdout:5/4: chown . 1016798 1 2023-10-21T17:03:35.498 INFO:tasks.workunit.client.0.smithi012.stdout:5/5: dwrite - no filename 2023-10-21T17:03:35.498 INFO:tasks.workunit.client.0.smithi012.stdout:6/2: chown . 7808229 1 2023-10-21T17:03:35.498 INFO:tasks.workunit.client.0.smithi012.stdout:6/3: dread - no filename 2023-10-21T17:03:35.498 INFO:tasks.workunit.client.0.smithi012.stdout:6/4: rename - no filename 2023-10-21T17:03:35.499 INFO:tasks.workunit.client.0.smithi012.stdout:6/5: rename - no filename 2023-10-21T17:03:35.513 INFO:tasks.workunit.client.0.smithi012.stdout:0/30: getdents d7/d8 0 2023-10-21T17:03:35.534 INFO:tasks.workunit.client.0.smithi012.stdout:1/35: fsync f4 0 2023-10-21T17:03:35.570 INFO:tasks.workunit.client.0.smithi012.stdout:3/8: fsync d0/f2 0 2023-10-21T17:03:35.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/46: fsync f7 0 2023-10-21T17:03:36.112 INFO:tasks.workunit.client.0.smithi012.stdout:5/6: symlink l0 0 2023-10-21T17:03:36.112 INFO:tasks.workunit.client.0.smithi012.stdout:5/7: dwrite - no filename 2023-10-21T17:03:36.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/6: symlink l0 0 2023-10-21T17:03:36.391 INFO:tasks.workunit.client.0.smithi012.stdout:0/31: mknod d7/cc 0 2023-10-21T17:03:36.485 INFO:tasks.workunit.client.0.smithi012.stdout:1/36: mknod d5/c9 0 2023-10-21T17:03:36.486 INFO:tasks.workunit.client.0.smithi012.stdout:1/37: read f1 [2653711,21308] 0 2023-10-21T17:03:36.576 INFO:tasks.workunit.client.0.smithi012.stdout:3/9: rename d0/f2 to d0/f5 0 2023-10-21T17:03:36.588 INFO:tasks.workunit.client.0.smithi012.stdout:3/10: write d0/f5 [8339,15860] 0 2023-10-21T17:03:36.589 INFO:tasks.workunit.client.0.smithi012.stdout:3/11: write d0/f4 [286958,79626] 0 2023-10-21T17:03:36.913 INFO:tasks.workunit.client.0.smithi012.stdout:4/47: rename l0 to la 0 2023-10-21T17:03:36.913 INFO:tasks.workunit.client.0.smithi012.stdout:4/48: chown f8 2135397375 1 2023-10-21T17:03:36.998 INFO:tasks.workunit.client.0.smithi012.stdout:5/8: link l0 l1 0 2023-10-21T17:03:37.191 INFO:tasks.workunit.client.0.smithi012.stdout:6/7: creat f1 x:0 0 0 2023-10-21T17:03:37.191 INFO:tasks.workunit.client.0.smithi012.stdout:0/32: symlink d7/ld 0 2023-10-21T17:03:37.191 INFO:tasks.workunit.client.0.smithi012.stdout:0/33: dread - f3 zero size 2023-10-21T17:03:37.192 INFO:tasks.workunit.client.0.smithi012.stdout:6/8: creat f2 x:0 0 0 2023-10-21T17:03:37.192 INFO:tasks.workunit.client.0.smithi012.stdout:6/9: rmdir - no directory 2023-10-21T17:03:37.193 INFO:tasks.workunit.client.0.smithi012.stdout:6/10: chown l0 411 1 2023-10-21T17:03:37.193 INFO:tasks.workunit.client.0.smithi012.stdout:6/11: dread - f1 zero size 2023-10-21T17:03:37.193 INFO:tasks.workunit.client.0.smithi012.stdout:6/12: rmdir - no directory 2023-10-21T17:03:37.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/38: unlink c2 0 2023-10-21T17:03:37.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/13: dwrite f2 [0,4194304] 0 2023-10-21T17:03:37.445 INFO:tasks.workunit.client.0.smithi012.stdout:3/12: link d0/f4 d0/f6 0 2023-10-21T17:03:37.445 INFO:tasks.workunit.client.0.smithi012.stdout:5/9: mkdir d2 0 2023-10-21T17:03:37.589 INFO:tasks.workunit.client.0.smithi012.stdout:2/25: rmdir d1 39 2023-10-21T17:03:37.626 INFO:tasks.workunit.client.0.smithi012.stdout:2/26: write f0 [969216,34234] 0 2023-10-21T17:03:37.665 INFO:tasks.workunit.client.0.smithi012.stdout:2/27: dread f0 [0,4194304] 0 2023-10-21T17:03:37.742 INFO:tasks.workunit.client.0.smithi012.stdout:0/34: creat d7/d8/d9/fe x:0 0 0 2023-10-21T17:03:37.906 INFO:tasks.workunit.client.0.smithi012.stdout:1/39: mknod d5/d8/ca 0 2023-10-21T17:03:37.907 INFO:tasks.workunit.client.0.smithi012.stdout:1/40: write f4 [363507,104922] 0 2023-10-21T17:03:38.009 INFO:tasks.workunit.client.0.smithi012.stdout:1/41: dwrite f1 [0,4194304] 0 2023-10-21T17:03:38.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/13: creat d0/f7 x:0 0 0 2023-10-21T17:03:38.159 INFO:tasks.workunit.client.0.smithi012.stdout:9/0: truncate - no filename 2023-10-21T17:03:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:8/0: mkdir d0 0 2023-10-21T17:03:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:8/1: fdatasync - no filename 2023-10-21T17:03:38.485 INFO:tasks.workunit.client.0.smithi012.stdout:0/35: creat d7/d8/ff x:0 0 0 2023-10-21T17:03:38.485 INFO:tasks.workunit.client.0.smithi012.stdout:0/36: chown f6 5358489 1 2023-10-21T17:03:38.486 INFO:tasks.workunit.client.0.smithi012.stdout:0/37: dread - f3 zero size 2023-10-21T17:03:39.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/42: link f4 d5/d8/fb 0 2023-10-21T17:03:39.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/1: mkdir d0 0 2023-10-21T17:03:39.347 INFO:tasks.workunit.client.0.smithi012.stdout:9/2: chown d0 244645 1 2023-10-21T17:03:39.552 INFO:tasks.workunit.client.0.smithi012.stdout:8/2: creat d0/f1 x:0 0 0 2023-10-21T17:03:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:8/3: write d0/f1 [865629,81157] 0 2023-10-21T17:03:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:8/4: chown d0/f1 67 1 2023-10-21T17:03:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:8/5: truncate d0/f1 1079649 0 2023-10-21T17:03:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:8/6: write d0/f1 [57733,90452] 0 2023-10-21T17:03:39.824 INFO:tasks.workunit.client.0.smithi012.stdout:4/49: sync 2023-10-21T17:03:39.824 INFO:tasks.workunit.client.0.smithi012.stdout:4/50: rmdir - no directory 2023-10-21T17:03:39.824 INFO:tasks.workunit.client.0.smithi012.stdout:7/10: sync 2023-10-21T17:03:39.824 INFO:tasks.workunit.client.0.smithi012.stdout:7/11: link - no file 2023-10-21T17:03:39.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/12: write - no filename 2023-10-21T17:03:39.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/13: dwrite - no filename 2023-10-21T17:03:39.884 INFO:tasks.workunit.client.0.smithi012.stdout:1/43: mknod d5/cc 0 2023-10-21T17:03:39.906 INFO:tasks.workunit.client.0.smithi012.stdout:1/44: dread d5/d8/fb [0,4194304] 0 2023-10-21T17:03:40.058 INFO:tasks.workunit.client.0.smithi012.stdout:9/3: creat d0/f1 x:0 0 0 2023-10-21T17:03:40.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/51: unlink la 0 2023-10-21T17:03:40.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/52: fsync f1 0 2023-10-21T17:03:40.493 INFO:tasks.workunit.client.0.smithi012.stdout:7/14: mknod c0 0 2023-10-21T17:03:40.956 INFO:tasks.workunit.client.0.smithi012.stdout:9/4: rename d0/f1 to d0/f2 0 2023-10-21T17:03:40.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/5: truncate d0/f2 488269 0 2023-10-21T17:03:41.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/15: unlink c0 0 2023-10-21T17:03:41.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/16: write - no filename 2023-10-21T17:03:41.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/17: write - no filename 2023-10-21T17:03:41.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/18: read - no filename 2023-10-21T17:03:41.206 INFO:tasks.workunit.client.0.smithi012.stdout:5/10: sync 2023-10-21T17:03:41.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/14: sync 2023-10-21T17:03:41.206 INFO:tasks.workunit.client.0.smithi012.stdout:2/28: sync 2023-10-21T17:03:41.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/15: read - f1 zero size 2023-10-21T17:03:41.207 INFO:tasks.workunit.client.0.smithi012.stdout:2/29: stat d1/d2 0 2023-10-21T17:03:41.207 INFO:tasks.workunit.client.0.smithi012.stdout:2/30: chown d1/d2 493425123 1 2023-10-21T17:03:41.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/16: creat f3 x:0 0 0 2023-10-21T17:03:41.208 INFO:tasks.workunit.client.0.smithi012.stdout:2/31: write f0 [53852,119152] 0 2023-10-21T17:03:41.233 INFO:tasks.workunit.client.0.smithi012.stdout:6/17: read f2 [1905094,50173] 0 2023-10-21T17:03:41.866 INFO:tasks.workunit.client.0.smithi012.stdout:3/14: sync 2023-10-21T17:03:41.866 INFO:tasks.workunit.client.0.smithi012.stdout:8/7: rmdir d0 39 2023-10-21T17:03:41.868 INFO:tasks.workunit.client.0.smithi012.stdout:1/45: getdents d5 0 2023-10-21T17:03:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:5/11: symlink d2/l3 0 2023-10-21T17:03:41.955 INFO:tasks.workunit.client.0.smithi012.stdout:2/32: rmdir d1 39 2023-10-21T17:03:41.955 INFO:tasks.workunit.client.0.smithi012.stdout:2/33: write f0 [2318046,68958] 0 2023-10-21T17:03:41.956 INFO:tasks.workunit.client.0.smithi012.stdout:2/34: getdents d1/d2 0 2023-10-21T17:03:41.983 INFO:tasks.workunit.client.0.smithi012.stdout:2/35: dread f0 [0,4194304] 0 2023-10-21T17:03:41.983 INFO:tasks.workunit.client.0.smithi012.stdout:2/36: write f0 [2492241,74876] 0 2023-10-21T17:03:42.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/18: mknod c4 0 2023-10-21T17:03:42.117 INFO:tasks.workunit.client.0.smithi012.stdout:3/15: symlink d0/l8 0 2023-10-21T17:03:42.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/8: unlink d0/f1 0 2023-10-21T17:03:42.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/9: truncate - no filename 2023-10-21T17:03:42.293 INFO:tasks.workunit.client.0.smithi012.stdout:8/10: dread - no filename 2023-10-21T17:03:42.293 INFO:tasks.workunit.client.0.smithi012.stdout:8/11: read - no filename 2023-10-21T17:03:42.733 INFO:tasks.workunit.client.0.smithi012.stdout:1/46: getdents d5/d8 0 2023-10-21T17:03:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:5/12: creat d2/f4 x:0 0 0 2023-10-21T17:03:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/19: symlink l5 0 2023-10-21T17:03:42.817 INFO:tasks.workunit.client.0.smithi012.stdout:5/13: write d2/f4 [630098,67161] 0 2023-10-21T17:03:42.827 INFO:tasks.workunit.client.0.smithi012.stdout:1/47: dwrite d5/d8/fb [0,4194304] 0 2023-10-21T17:03:42.910 INFO:tasks.workunit.client.0.smithi012.stdout:1/48: dwrite f1 [0,4194304] 0 2023-10-21T17:03:42.939 INFO:tasks.workunit.client.0.smithi012.stdout:1/49: write d5/d8/fb [1409280,26535] 0 2023-10-21T17:03:42.940 INFO:tasks.workunit.client.0.smithi012.stdout:1/50: read d5/d8/fb [1323069,105288] 0 2023-10-21T17:03:43.019 INFO:tasks.workunit.client.0.smithi012.stdout:8/12: creat d0/f2 x:0 0 0 2023-10-21T17:03:43.019 INFO:tasks.workunit.client.0.smithi012.stdout:8/13: stat d0/f2 0 2023-10-21T17:03:43.019 INFO:tasks.workunit.client.0.smithi012.stdout:3/16: mknod d0/c9 0 2023-10-21T17:03:43.060 INFO:tasks.workunit.client.0.smithi012.stdout:9/6: getdents d0 0 2023-10-21T17:03:43.116 INFO:tasks.workunit.client.0.smithi012.stdout:3/17: dwrite d0/f6 [0,4194304] 0 2023-10-21T17:03:43.126 INFO:tasks.workunit.client.0.smithi012.stdout:4/53: write f1 [4478516,9093] 0 2023-10-21T17:03:43.132 INFO:tasks.workunit.client.0.smithi012.stdout:9/7: dwrite d0/f2 [0,4194304] 0 2023-10-21T17:03:43.145 INFO:tasks.workunit.client.0.smithi012.stdout:0/38: creat d7/f10 x:0 0 0 2023-10-21T17:03:43.153 INFO:tasks.workunit.client.0.smithi012.stdout:9/8: read d0/f2 [1543349,49898] 0 2023-10-21T17:03:43.205 INFO:tasks.workunit.client.0.smithi012.stdout:4/54: dwrite f8 [4194304,4194304] 0 2023-10-21T17:03:43.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/55: rmdir - no directory 2023-10-21T17:03:43.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/56: creat fb x:0 0 0 2023-10-21T17:03:43.362 INFO:tasks.workunit.client.0.smithi012.stdout:6/20: link f2 f6 0 2023-10-21T17:03:43.362 INFO:tasks.workunit.client.0.smithi012.stdout:6/21: readlink l0 0 2023-10-21T17:03:43.363 INFO:tasks.workunit.client.0.smithi012.stdout:6/22: creat f7 x:0 0 0 2023-10-21T17:03:43.363 INFO:tasks.workunit.client.0.smithi012.stdout:6/23: chown f2 195755880 1 2023-10-21T17:03:43.393 INFO:tasks.workunit.client.0.smithi012.stdout:1/51: link d5/d8/fb d5/d8/fd 0 2023-10-21T17:03:43.421 INFO:tasks.workunit.client.0.smithi012.stdout:8/14: symlink d0/l3 0 2023-10-21T17:03:43.450 INFO:tasks.workunit.client.0.smithi012.stdout:1/52: dwrite f1 [4194304,4194304] 0 2023-10-21T17:03:43.529 INFO:tasks.workunit.client.0.smithi012.stdout:8/15: dwrite d0/f2 [0,4194304] 0 2023-10-21T17:03:43.529 INFO:tasks.workunit.client.0.smithi012.stdout:8/16: creat d0/f4 x:0 0 0 2023-10-21T17:03:43.638 INFO:tasks.workunit.client.0.smithi012.stdout:7/19: sync 2023-10-21T17:03:43.639 INFO:tasks.workunit.client.0.smithi012.stdout:7/20: dwrite - no filename 2023-10-21T17:03:43.639 INFO:tasks.workunit.client.0.smithi012.stdout:7/21: dwrite - no filename 2023-10-21T17:03:43.765 INFO:tasks.workunit.client.0.smithi012.stdout:3/18: mkdir d0/da 0 2023-10-21T17:03:43.768 INFO:tasks.workunit.client.0.smithi012.stdout:2/37: truncate f0 14252 0 2023-10-21T17:03:43.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/19: dread d0/f5 [0,4194304] 0 2023-10-21T17:03:43.810 INFO:tasks.workunit.client.0.smithi012.stdout:3/20: chown d0/l8 7596928 1 2023-10-21T17:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:0/39: creat d7/d8/f11 x:0 0 0 2023-10-21T17:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:0/40: fsync f3 0 2023-10-21T17:03:44.510 INFO:tasks.workunit.client.0.smithi012.stdout:4/57: mkdir dc 0 2023-10-21T17:03:44.591 INFO:tasks.workunit.client.0.smithi012.stdout:4/58: dwrite fb [0,4194304] 0 2023-10-21T17:03:44.689 INFO:tasks.workunit.client.0.smithi012.stdout:4/59: dwrite f8 [4194304,4194304] 0 2023-10-21T17:03:44.753 INFO:tasks.workunit.client.0.smithi012.stdout:4/60: dwrite f8 [4194304,4194304] 0 2023-10-21T17:03:44.861 INFO:tasks.workunit.client.0.smithi012.stdout:4/61: dwrite f7 [0,4194304] 0 2023-10-21T17:03:44.862 INFO:tasks.workunit.client.0.smithi012.stdout:4/62: chown f8 5343465 1 2023-10-21T17:03:44.864 INFO:tasks.workunit.client.0.smithi012.stdout:5/14: link d2/f4 d2/f5 0 2023-10-21T17:03:44.872 INFO:tasks.workunit.client.0.smithi012.stdout:2/38: dread f0 [0,4194304] 0 2023-10-21T17:03:44.872 INFO:tasks.workunit.client.0.smithi012.stdout:2/39: truncate f0 170656 0 2023-10-21T17:03:44.873 INFO:tasks.workunit.client.0.smithi012.stdout:2/40: chown d1 4 1 2023-10-21T17:03:44.886 INFO:tasks.workunit.client.0.smithi012.stdout:5/15: dread d2/f4 [0,4194304] 0 2023-10-21T17:03:44.889 INFO:tasks.workunit.client.0.smithi012.stdout:4/63: write f7 [4128569,112705] 0 2023-10-21T17:03:45.005 INFO:tasks.workunit.client.0.smithi012.stdout:6/24: link f6 f8 0 2023-10-21T17:03:45.005 INFO:tasks.workunit.client.0.smithi012.stdout:6/25: write f6 [3235485,70663] 0 2023-10-21T17:03:45.243 INFO:tasks.workunit.client.0.smithi012.stdout:9/9: dwrite d0/f2 [4194304,4194304] 0 2023-10-21T17:03:45.337 INFO:tasks.workunit.client.0.smithi012.stdout:1/53: creat d5/d8/fe x:0 0 0 2023-10-21T17:03:45.413 INFO:tasks.workunit.client.0.smithi012.stdout:1/54: dwrite d5/d8/fd [0,4194304] 0 2023-10-21T17:03:45.780 INFO:tasks.workunit.client.0.smithi012.stdout:8/17: symlink d0/l5 0 2023-10-21T17:03:45.780 INFO:tasks.workunit.client.0.smithi012.stdout:8/18: stat d0 0 2023-10-21T17:03:45.896 INFO:tasks.workunit.client.0.smithi012.stdout:7/22: symlink l1 0 2023-10-21T17:03:45.896 INFO:tasks.workunit.client.0.smithi012.stdout:7/23: chown l1 0 1 2023-10-21T17:03:46.321 INFO:tasks.workunit.client.0.smithi012.stdout:6/26: fsync f8 0 2023-10-21T17:03:46.322 INFO:tasks.workunit.client.0.smithi012.stdout:6/27: chown f6 129705 1 2023-10-21T17:03:47.127 INFO:tasks.workunit.client.0.smithi012.stdout:5/16: mkdir d2/d6 0 2023-10-21T17:03:47.127 INFO:tasks.workunit.client.0.smithi012.stdout:5/17: chown d2/f4 83664 1 2023-10-21T17:03:47.132 INFO:tasks.workunit.client.0.smithi012.stdout:5/18: write d2/f4 [4033,18280] 0 2023-10-21T17:03:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:3/21: sync 2023-10-21T17:03:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:3/22: chown d0/f6 53966 1 2023-10-21T17:03:47.765 INFO:tasks.workunit.client.0.smithi012.stdout:3/23: dwrite d0/f5 [0,4194304] 0 2023-10-21T17:03:47.796 INFO:tasks.workunit.client.0.smithi012.stdout:3/24: write d0/f4 [359688,71927] 0 2023-10-21T17:03:47.836 INFO:tasks.workunit.client.0.smithi012.stdout:3/25: dread d0/f4 [0,4194304] 0 2023-10-21T17:03:47.837 INFO:tasks.workunit.client.0.smithi012.stdout:3/26: read d0/f4 [4087682,9201] 0 2023-10-21T17:03:47.908 INFO:tasks.workunit.client.0.smithi012.stdout:3/27: dwrite d0/f7 [0,4194304] 0 2023-10-21T17:03:48.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/19: symlink d0/l6 0 2023-10-21T17:03:48.023 INFO:tasks.workunit.client.0.smithi012.stdout:7/24: link l1 l2 0 2023-10-21T17:03:48.023 INFO:tasks.workunit.client.0.smithi012.stdout:7/25: dwrite - no filename 2023-10-21T17:03:48.046 INFO:tasks.workunit.client.0.smithi012.stdout:8/20: write d0/f2 [3268590,122192] 0 2023-10-21T17:03:48.086 INFO:tasks.workunit.client.0.smithi012.stdout:0/41: rename f3 to d7/d8/d9/f12 0 2023-10-21T17:03:48.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/28: link l5 l9 0 2023-10-21T17:03:48.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/29: write f1 [357202,30758] 0 2023-10-21T17:03:48.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/30: creat fa x:0 0 0 2023-10-21T17:03:48.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/31: rmdir - no directory 2023-10-21T17:03:48.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/32: dwrite f7 [0,4194304] 0 2023-10-21T17:03:48.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/33: write f1 [215742,60861] 0 2023-10-21T17:03:48.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/34: creat fb x:0 0 0 2023-10-21T17:03:48.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/35: fsync f2 0 2023-10-21T17:03:48.188 INFO:tasks.workunit.client.0.smithi012.stdout:6/36: dread f1 [0,4194304] 0 2023-10-21T17:03:48.188 INFO:tasks.workunit.client.0.smithi012.stdout:6/37: chown f1 976596358 1 2023-10-21T17:03:48.188 INFO:tasks.workunit.client.0.smithi012.stdout:6/38: chown f6 244273 1 2023-10-21T17:03:48.358 INFO:tasks.workunit.client.0.smithi012.stdout:1/55: link f1 d5/ff 0 2023-10-21T17:03:48.911 INFO:tasks.workunit.client.0.smithi012.stdout:8/21: symlink d0/l7 0 2023-10-21T17:03:48.911 INFO:tasks.workunit.client.0.smithi012.stdout:8/22: creat d0/f8 x:0 0 0 2023-10-21T17:03:48.917 INFO:tasks.workunit.client.0.smithi012.stdout:8/23: fsync d0/f2 0 2023-10-21T17:03:48.929 INFO:tasks.workunit.client.0.smithi012.stdout:4/64: rename l3 to dc/ld 0 2023-10-21T17:03:48.946 INFO:tasks.workunit.client.0.smithi012.stdout:0/42: symlink d7/l13 0 2023-10-21T17:03:48.946 INFO:tasks.workunit.client.0.smithi012.stdout:0/43: write d7/d8/d9/fe [586556,23922] 0 2023-10-21T17:03:48.988 INFO:tasks.workunit.client.0.smithi012.stdout:1/56: creat d5/f10 x:0 0 0 2023-10-21T17:03:48.989 INFO:tasks.workunit.client.0.smithi012.stdout:1/57: creat d5/f11 x:0 0 0 2023-10-21T17:03:49.098 INFO:tasks.workunit.client.0.smithi012.stdout:1/58: dwrite f4 [0,4194304] 0 2023-10-21T17:03:49.320 INFO:tasks.workunit.client.0.smithi012.stdout:3/28: rmdir d0 39 2023-10-21T17:03:49.321 INFO:tasks.workunit.client.0.smithi012.stdout:3/29: write d0/f5 [3257126,113686] 0 2023-10-21T17:03:49.322 INFO:tasks.workunit.client.0.smithi012.stdout:3/30: truncate d0/f5 4217432 0 2023-10-21T17:03:49.322 INFO:tasks.workunit.client.0.smithi012.stdout:3/31: readlink d0/l3 0 2023-10-21T17:03:49.322 INFO:tasks.workunit.client.0.smithi012.stdout:3/32: write d0/f5 [3959089,101098] 0 2023-10-21T17:03:49.322 INFO:tasks.workunit.client.0.smithi012.stdout:3/33: chown d0/da 0 1 2023-10-21T17:03:49.323 INFO:tasks.workunit.client.0.smithi012.stdout:3/34: fsync d0/f7 0 2023-10-21T17:03:49.624 INFO:tasks.workunit.client.0.smithi012.stdout:8/24: mknod d0/c9 0 2023-10-21T17:03:49.883 INFO:tasks.workunit.client.0.smithi012.stdout:4/65: mknod dc/ce 0 2023-10-21T17:03:49.884 INFO:tasks.workunit.client.0.smithi012.stdout:2/41: sync 2023-10-21T17:03:49.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/10: sync 2023-10-21T17:03:49.912 INFO:tasks.workunit.client.0.smithi012.stdout:4/66: dread f7 [0,4194304] 0 2023-10-21T17:03:49.913 INFO:tasks.workunit.client.0.smithi012.stdout:4/67: readlink dc/ld 0 2023-10-21T17:03:50.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/39: unlink fb 0 2023-10-21T17:03:50.481 INFO:tasks.workunit.client.0.smithi012.stdout:5/19: sync 2023-10-21T17:03:50.481 INFO:tasks.workunit.client.0.smithi012.stdout:3/35: creat d0/da/fb x:0 0 0 2023-10-21T17:03:50.481 INFO:tasks.workunit.client.0.smithi012.stdout:8/25: mknod d0/ca 0 2023-10-21T17:03:50.482 INFO:tasks.workunit.client.0.smithi012.stdout:8/26: dread - d0/f4 zero size 2023-10-21T17:03:50.482 INFO:tasks.workunit.client.0.smithi012.stdout:8/27: creat d0/fb x:0 0 0 2023-10-21T17:03:50.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/28: dread - d0/f4 zero size 2023-10-21T17:03:50.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/29: readlink d0/l7 0 2023-10-21T17:03:50.620 INFO:tasks.workunit.client.0.smithi012.stdout:9/11: creat d0/f3 x:0 0 0 2023-10-21T17:03:50.766 INFO:tasks.workunit.client.0.smithi012.stdout:4/68: link f1 dc/ff 0 2023-10-21T17:03:50.810 INFO:tasks.workunit.client.0.smithi012.stdout:4/69: dread f1 [0,4194304] 0 2023-10-21T17:03:50.896 INFO:tasks.workunit.client.0.smithi012.stdout:6/40: rename f2 to fc 0 2023-10-21T17:03:50.897 INFO:tasks.workunit.client.0.smithi012.stdout:6/41: creat fd x:0 0 0 2023-10-21T17:03:51.267 INFO:tasks.workunit.client.0.smithi012.stdout:0/44: getdents d7 0 2023-10-21T17:03:51.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/20: creat d2/d6/f7 x:0 0 0 2023-10-21T17:03:51.326 INFO:tasks.workunit.client.0.smithi012.stdout:5/21: chown d2/l3 952343821 1 2023-10-21T17:03:51.421 INFO:tasks.workunit.client.0.smithi012.stdout:5/22: dwrite d2/f5 [0,4194304] 0 2023-10-21T17:03:51.421 INFO:tasks.workunit.client.0.smithi012.stdout:5/23: readlink l0 0 2023-10-21T17:03:51.449 INFO:tasks.workunit.client.0.smithi012.stdout:8/30: mknod d0/cc 0 2023-10-21T17:03:51.544 INFO:tasks.workunit.client.0.smithi012.stdout:7/26: sync 2023-10-21T17:03:51.544 INFO:tasks.workunit.client.0.smithi012.stdout:7/27: dread - no filename 2023-10-21T17:03:51.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/12: dwrite d0/f2 [4194304,4194304] 0 2023-10-21T17:03:51.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/13: dwrite d0/f3 [0,4194304] 0 2023-10-21T17:03:51.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/14: chown d0/f3 228501263 1 2023-10-21T17:03:51.790 INFO:tasks.workunit.client.0.smithi012.stdout:9/15: dread d0/f2 [4194304,4194304] 0 2023-10-21T17:03:51.834 INFO:tasks.workunit.client.0.smithi012.stdout:1/59: fsync d5/f10 0 2023-10-21T17:03:51.835 INFO:tasks.workunit.client.0.smithi012.stdout:4/70: creat dc/f10 x:0 0 0 2023-10-21T17:03:51.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/60: creat d5/f12 x:0 0 0 2023-10-21T17:03:51.865 INFO:tasks.workunit.client.0.smithi012.stdout:1/61: write d5/d8/fd [3129413,10582] 0 2023-10-21T17:03:52.146 INFO:tasks.workunit.client.0.smithi012.stdout:6/42: symlink le 0 2023-10-21T17:03:52.146 INFO:tasks.workunit.client.0.smithi012.stdout:6/43: stat f1 0 2023-10-21T17:03:52.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/44: creat ff x:0 0 0 2023-10-21T17:03:52.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/45: creat f10 x:0 0 0 2023-10-21T17:03:52.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/46: truncate f3 669893 0 2023-10-21T17:03:52.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/47: write fc [1764335,40918] 0 2023-10-21T17:03:52.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/48: dread - f10 zero size 2023-10-21T17:03:52.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/49: creat f11 x:0 0 0 2023-10-21T17:03:52.835 INFO:tasks.workunit.client.0.smithi012.stdout:3/36: getdents d0/da 0 2023-10-21T17:03:53.764 INFO:tasks.workunit.client.0.smithi012.stdout:5/24: mkdir d2/d6/d8 0 2023-10-21T17:03:53.764 INFO:tasks.workunit.client.0.smithi012.stdout:2/42: rmdir d1/d2 0 2023-10-21T17:03:53.764 INFO:tasks.workunit.client.0.smithi012.stdout:2/43: truncate f0 1170020 0 2023-10-21T17:03:53.788 INFO:tasks.workunit.client.0.smithi012.stdout:2/44: dread f0 [0,4194304] 0 2023-10-21T17:03:53.852 INFO:tasks.workunit.client.0.smithi012.stdout:5/25: dwrite d2/f5 [0,4194304] 0 2023-10-21T17:03:53.852 INFO:tasks.workunit.client.0.smithi012.stdout:7/28: mkdir d3 0 2023-10-21T17:03:53.943 INFO:tasks.workunit.client.0.smithi012.stdout:1/62: link d5/l6 d5/d8/l13 0 2023-10-21T17:03:53.944 INFO:tasks.workunit.client.0.smithi012.stdout:1/63: dread - d5/f10 zero size 2023-10-21T17:03:53.944 INFO:tasks.workunit.client.0.smithi012.stdout:1/64: readlink d5/l7 0 2023-10-21T17:03:53.949 INFO:tasks.workunit.client.0.smithi012.stdout:6/50: mknod c12 0 2023-10-21T17:03:53.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/37: mknod d0/cc 0 2023-10-21T17:03:53.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/38: chown d0/da/fb 57 1 2023-10-21T17:03:53.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/39: write d0/f5 [2743508,95076] 0 2023-10-21T17:03:53.977 INFO:tasks.workunit.client.0.smithi012.stdout:1/65: dread f1 [4194304,4194304] 0 2023-10-21T17:03:53.977 INFO:tasks.workunit.client.0.smithi012.stdout:1/66: read - d5/f12 zero size 2023-10-21T17:03:54.332 INFO:tasks.workunit.client.0.smithi012.stdout:4/71: fsync dc/f10 0 2023-10-21T17:03:54.478 INFO:tasks.workunit.client.0.smithi012.stdout:0/45: sync 2023-10-21T17:03:54.478 INFO:tasks.workunit.client.0.smithi012.stdout:0/46: creat d7/d8/f14 x:0 0 0 2023-10-21T17:03:54.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/31: getdents d0 0 2023-10-21T17:03:54.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/32: read - d0/fb zero size 2023-10-21T17:03:54.576 INFO:tasks.workunit.client.0.smithi012.stdout:8/33: write d0/f8 [845249,63213] 0 2023-10-21T17:03:54.576 INFO:tasks.workunit.client.0.smithi012.stdout:8/34: chown d0/l7 65 1 2023-10-21T17:03:54.673 INFO:tasks.workunit.client.0.smithi012.stdout:8/35: dwrite d0/fb [0,4194304] 0 2023-10-21T17:03:54.674 INFO:tasks.workunit.client.0.smithi012.stdout:8/36: chown d0/f4 81373686 1 2023-10-21T17:03:54.674 INFO:tasks.workunit.client.0.smithi012.stdout:8/37: stat d0/fb 0 2023-10-21T17:03:54.849 INFO:tasks.workunit.client.0.smithi012.stdout:5/26: symlink d2/d6/d8/l9 0 2023-10-21T17:03:54.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/45: creat d1/f3 x:0 0 0 2023-10-21T17:03:54.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/46: chown f0 3397140 1 2023-10-21T17:03:54.876 INFO:tasks.workunit.client.0.smithi012.stdout:5/27: read d2/f4 [1935214,17907] 0 2023-10-21T17:03:54.877 INFO:tasks.workunit.client.0.smithi012.stdout:5/28: chown d2/l3 1327223 1 2023-10-21T17:03:54.877 INFO:tasks.workunit.client.0.smithi012.stdout:5/29: creat d2/fa x:0 0 0 2023-10-21T17:03:55.036 INFO:tasks.workunit.client.0.smithi012.stdout:7/29: mknod d3/c4 0 2023-10-21T17:03:55.037 INFO:tasks.workunit.client.0.smithi012.stdout:3/40: creat d0/fd x:0 0 0 2023-10-21T17:03:55.119 INFO:tasks.workunit.client.0.smithi012.stdout:0/47: mknod d7/c15 0 2023-10-21T17:03:55.119 INFO:tasks.workunit.client.0.smithi012.stdout:0/48: creat d7/d8/d9/f16 x:0 0 0 2023-10-21T17:03:55.468 INFO:tasks.workunit.client.0.smithi012.stdout:2/47: mkdir d1/d4 0 2023-10-21T17:03:55.640 INFO:tasks.workunit.client.0.smithi012.stdout:5/30: symlink d2/lb 0 2023-10-21T17:03:55.640 INFO:tasks.workunit.client.0.smithi012.stdout:5/31: truncate d2/d6/f7 113744 0 2023-10-21T17:03:55.780 INFO:tasks.workunit.client.0.smithi012.stdout:9/16: truncate d0/f2 2206743 0 2023-10-21T17:03:55.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/51: truncate f8 586950 0 2023-10-21T17:03:55.782 INFO:tasks.workunit.client.0.smithi012.stdout:6/52: write ff [193151,128799] 0 2023-10-21T17:03:55.810 INFO:tasks.workunit.client.0.smithi012.stdout:9/17: dread d0/f3 [0,4194304] 0 2023-10-21T17:03:56.027 INFO:tasks.workunit.client.0.smithi012.stdout:7/30: unlink l1 0 2023-10-21T17:03:56.027 INFO:tasks.workunit.client.0.smithi012.stdout:7/31: dwrite - no filename 2023-10-21T17:03:56.028 INFO:tasks.workunit.client.0.smithi012.stdout:7/32: write - no filename 2023-10-21T17:03:56.028 INFO:tasks.workunit.client.0.smithi012.stdout:7/33: dwrite - no filename 2023-10-21T17:03:56.028 INFO:tasks.workunit.client.0.smithi012.stdout:7/34: truncate - no filename 2023-10-21T17:03:56.029 INFO:tasks.workunit.client.0.smithi012.stdout:7/35: read - no filename 2023-10-21T17:03:56.029 INFO:tasks.workunit.client.0.smithi012.stdout:7/36: dwrite - no filename 2023-10-21T17:03:56.029 INFO:tasks.workunit.client.0.smithi012.stdout:7/37: fdatasync - no filename 2023-10-21T17:03:56.171 INFO:tasks.workunit.client.0.smithi012.stdout:1/67: unlink d5/f12 0 2023-10-21T17:03:56.171 INFO:tasks.workunit.client.0.smithi012.stdout:1/68: readlink d5/l6 0 2023-10-21T17:03:56.172 INFO:tasks.workunit.client.0.smithi012.stdout:1/69: write d5/f11 [287408,96321] 0 2023-10-21T17:03:56.300 INFO:tasks.workunit.client.0.smithi012.stdout:4/72: rename f7 to dc/f11 0 2023-10-21T17:03:56.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/38: rename d0 to d0/dd 22 2023-10-21T17:03:56.383 INFO:tasks.workunit.client.0.smithi012.stdout:8/39: dwrite d0/fb [0,4194304] 0 2023-10-21T17:03:56.414 INFO:tasks.workunit.client.0.smithi012.stdout:8/40: dread d0/fb [0,4194304] 0 2023-10-21T17:03:56.414 INFO:tasks.workunit.client.0.smithi012.stdout:8/41: getdents d0 0 2023-10-21T17:03:56.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/49: link l4 d7/l17 0 2023-10-21T17:03:56.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/50: chown d7/l17 0 1 2023-10-21T17:03:56.734 INFO:tasks.workunit.client.0.smithi012.stdout:2/48: creat d1/d4/f5 x:0 0 0 2023-10-21T17:03:56.734 INFO:tasks.workunit.client.0.smithi012.stdout:2/49: readlink - no filename 2023-10-21T17:03:56.955 INFO:tasks.workunit.client.0.smithi012.stdout:5/32: link d2/f4 d2/d6/d8/fc 0 2023-10-21T17:03:56.955 INFO:tasks.workunit.client.0.smithi012.stdout:6/53: mkdir d13 0 2023-10-21T17:03:57.057 INFO:tasks.workunit.client.0.smithi012.stdout:9/18: dread d0/f2 [0,4194304] 0 2023-10-21T17:03:57.086 INFO:tasks.workunit.client.0.smithi012.stdout:9/19: write d0/f3 [1810762,59261] 0 2023-10-21T17:03:57.154 INFO:tasks.workunit.client.0.smithi012.stdout:3/41: rmdir d0 39 2023-10-21T17:03:57.154 INFO:tasks.workunit.client.0.smithi012.stdout:3/42: write d0/f6 [1456045,53276] 0 2023-10-21T17:03:57.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/38: symlink d3/l5 0 2023-10-21T17:03:57.348 INFO:tasks.workunit.client.0.smithi012.stdout:7/39: fsync - no filename 2023-10-21T17:03:57.538 INFO:tasks.workunit.client.0.smithi012.stdout:1/70: truncate d5/ff 473941 0 2023-10-21T17:03:57.538 INFO:tasks.workunit.client.0.smithi012.stdout:1/71: creat d5/f14 x:0 0 0 2023-10-21T17:03:57.885 INFO:tasks.workunit.client.0.smithi012.stdout:4/73: symlink dc/l12 0 2023-10-21T17:03:58.028 INFO:tasks.workunit.client.0.smithi012.stdout:8/42: creat d0/fe x:0 0 0 2023-10-21T17:03:58.735 INFO:tasks.workunit.client.0.smithi012.stdout:0/51: symlink d7/d8/d9/l18 0 2023-10-21T17:03:59.030 INFO:tasks.workunit.client.0.smithi012.stdout:6/54: creat d13/f14 x:0 0 0 2023-10-21T17:03:59.030 INFO:tasks.workunit.client.0.smithi012.stdout:6/55: dread - f10 zero size 2023-10-21T17:03:59.306 INFO:tasks.workunit.client.0.smithi012.stdout:9/20: mkdir d0/d4 0 2023-10-21T17:03:59.306 INFO:tasks.workunit.client.0.smithi012.stdout:5/33: rename d2/d6/d8 to d2/dd 0 2023-10-21T17:03:59.306 INFO:tasks.workunit.client.0.smithi012.stdout:5/34: readlink d2/dd/l9 0 2023-10-21T17:03:59.307 INFO:tasks.workunit.client.0.smithi012.stdout:3/43: creat d0/da/fe x:0 0 0 2023-10-21T17:03:59.307 INFO:tasks.workunit.client.0.smithi012.stdout:7/40: mkdir d3/d6 0 2023-10-21T17:04:00.297 INFO:tasks.workunit.client.0.smithi012.stdout:4/74: mknod dc/c13 0 2023-10-21T17:04:00.411 INFO:tasks.workunit.client.0.smithi012.stdout:8/43: mknod d0/cf 0 2023-10-21T17:04:00.411 INFO:tasks.workunit.client.0.smithi012.stdout:8/44: write d0/fe [247613,12959] 0 2023-10-21T17:04:00.412 INFO:tasks.workunit.client.0.smithi012.stdout:8/45: rename d0 to d0/d10 22 2023-10-21T17:04:00.412 INFO:tasks.workunit.client.0.smithi012.stdout:8/46: readlink d0/l6 0 2023-10-21T17:04:00.542 INFO:tasks.workunit.client.0.smithi012.stdout:0/52: getdents d7 0 2023-10-21T17:04:00.615 INFO:tasks.workunit.client.0.smithi012.stdout:0/53: dwrite d7/d8/d9/f16 [0,4194304] 0 2023-10-21T17:04:00.729 INFO:tasks.workunit.client.0.smithi012.stdout:2/50: unlink f0 0 2023-10-21T17:04:00.729 INFO:tasks.workunit.client.0.smithi012.stdout:2/51: chown d1/d4/f5 943 1 2023-10-21T17:04:00.729 INFO:tasks.workunit.client.0.smithi012.stdout:2/52: readlink - no filename 2023-10-21T17:04:00.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/56: mkdir d13/d15 0 2023-10-21T17:04:00.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/57: creat d13/f16 x:0 0 0 2023-10-21T17:04:01.218 INFO:tasks.workunit.client.0.smithi012.stdout:9/21: mkdir d0/d5 0 2023-10-21T17:04:01.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/22: dread d0/f2 [0,4194304] 0 2023-10-21T17:04:01.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/23: getdents d0/d4 0 2023-10-21T17:04:01.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/24: chown d0/f3 0 1 2023-10-21T17:04:01.253 INFO:tasks.workunit.client.0.smithi012.stdout:9/25: dread d0/f2 [0,4194304] 0 2023-10-21T17:04:01.283 INFO:tasks.workunit.client.0.smithi012.stdout:9/26: dread d0/f3 [0,4194304] 0 2023-10-21T17:04:01.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/27: dread d0/f2 [0,4194304] 0 2023-10-21T17:04:01.668 INFO:tasks.workunit.client.0.smithi012.stdout:4/75: mknod dc/c14 0 2023-10-21T17:04:01.694 INFO:tasks.workunit.client.0.smithi012.stdout:4/76: read f1 [2869272,104237] 0 2023-10-21T17:04:01.694 INFO:tasks.workunit.client.0.smithi012.stdout:4/77: chown dc/c13 3 1 2023-10-21T17:04:02.021 INFO:tasks.workunit.client.0.smithi012.stdout:0/54: creat d7/f19 x:0 0 0 2023-10-21T17:04:02.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/55: write f1 [3837765,16426] 0 2023-10-21T17:04:02.118 INFO:tasks.workunit.client.0.smithi012.stdout:2/53: symlink d1/l6 0 2023-10-21T17:04:02.119 INFO:tasks.workunit.client.0.smithi012.stdout:2/54: write d1/d4/f5 [437674,82254] 0 2023-10-21T17:04:02.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/55: dwrite d1/f3 [0,4194304] 0 2023-10-21T17:04:02.597 INFO:tasks.workunit.client.0.smithi012.stdout:1/72: sync 2023-10-21T17:04:02.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/73: stat d5/c9 0 2023-10-21T17:04:02.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/74: write d5/d8/fd [3805724,86452] 0 2023-10-21T17:04:02.674 INFO:tasks.workunit.client.0.smithi012.stdout:3/44: rmdir d0/da 39 2023-10-21T17:04:02.675 INFO:tasks.workunit.client.0.smithi012.stdout:3/45: chown d0/da/fb 48897 1 2023-10-21T17:04:02.815 INFO:tasks.workunit.client.0.smithi012.stdout:9/28: symlink d0/l6 0 2023-10-21T17:04:02.902 INFO:tasks.workunit.client.0.smithi012.stdout:9/29: dwrite d0/f3 [4194304,4194304] 0 2023-10-21T17:04:03.005 INFO:tasks.workunit.client.0.smithi012.stdout:7/41: getdents d3 0 2023-10-21T17:04:03.006 INFO:tasks.workunit.client.0.smithi012.stdout:7/42: dread - no filename 2023-10-21T17:04:03.006 INFO:tasks.workunit.client.0.smithi012.stdout:7/43: fdatasync - no filename 2023-10-21T17:04:03.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:04:03.104 INFO:tasks.workunit.client.0.smithi012.stdout:4/78: mkdir dc/d15 0 2023-10-21T17:04:03.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:04:03.213 INFO:tasks.workunit.client.0.smithi012.stdout:8/47: getdents d0 0 2023-10-21T17:04:03.283 INFO:tasks.workunit.client.0.smithi012.stdout:0/56: link l4 d7/l1a 0 2023-10-21T17:04:03.283 INFO:tasks.workunit.client.0.smithi012.stdout:0/57: stat f2 0 2023-10-21T17:04:03.284 INFO:tasks.workunit.client.0.smithi012.stdout:0/58: creat d7/f1b x:0 0 0 2023-10-21T17:04:03.543 INFO:tasks.workunit.client.0.smithi012.stdout:2/56: unlink d1/l6 0 2023-10-21T17:04:03.544 INFO:tasks.workunit.client.0.smithi012.stdout:2/57: creat d1/d4/f7 x:0 0 0 2023-10-21T17:04:03.572 INFO:tasks.workunit.client.0.smithi012.stdout:2/58: dread d1/f3 [0,4194304] 0 2023-10-21T17:04:03.600 INFO:tasks.workunit.client.0.smithi012.stdout:2/59: write d1/f3 [405646,116497] 0 2023-10-21T17:04:03.600 INFO:tasks.workunit.client.0.smithi012.stdout:2/60: read - d1/d4/f7 zero size 2023-10-21T17:04:03.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/46: mkdir d0/da/df 0 2023-10-21T17:04:04.014 INFO:tasks.workunit.client.0.smithi012.stdout:9/30: mknod d0/d4/c7 0 2023-10-21T17:04:04.014 INFO:tasks.workunit.client.0.smithi012.stdout:9/31: creat d0/f8 x:0 0 0 2023-10-21T17:04:04.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/79: mknod dc/c16 0 2023-10-21T17:04:04.696 INFO:tasks.workunit.client.0.smithi012.stdout:5/35: symlink d2/le 0 2023-10-21T17:04:04.799 INFO:tasks.workunit.client.0.smithi012.stdout:8/48: creat d0/f11 x:0 0 0 2023-10-21T17:04:05.046 INFO:tasks.workunit.client.0.smithi012.stdout:0/59: mknod d7/c1c 0 2023-10-21T17:04:05.047 INFO:tasks.workunit.client.0.smithi012.stdout:0/60: creat d7/f1d x:0 0 0 2023-10-21T17:04:05.054 INFO:tasks.workunit.client.0.smithi012.stdout:0/61: write d7/d8/d9/fe [8070,89711] 0 2023-10-21T17:04:05.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/62: dwrite d7/f19 [0,4194304] 0 2023-10-21T17:04:05.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/63: dread - d7/f1d zero size 2023-10-21T17:04:05.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/64: chown d7/d8/d9/f16 292543 1 2023-10-21T17:04:05.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/65: fsync f2 0 2023-10-21T17:04:05.868 INFO:tasks.workunit.client.0.smithi012.stdout:2/61: mkdir d1/d8 0 2023-10-21T17:04:05.868 INFO:tasks.workunit.client.0.smithi012.stdout:3/47: rmdir d0/da/df 0 2023-10-21T17:04:05.869 INFO:tasks.workunit.client.0.smithi012.stdout:1/75: rmdir d5/d8 39 2023-10-21T17:04:05.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/48: chown d0/f5 0 1 2023-10-21T17:04:05.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/49: chown d0 103608 1 2023-10-21T17:04:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/80: rename dc/ff to dc/f17 0 2023-10-21T17:04:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/81: chown l4 2034117 1 2023-10-21T17:04:06.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/36: symlink d2/d6/lf 0 2023-10-21T17:04:06.119 INFO:tasks.workunit.client.0.smithi012.stdout:5/37: stat d2/l3 0 2023-10-21T17:04:06.162 INFO:tasks.workunit.client.0.smithi012.stdout:6/58: sync 2023-10-21T17:04:06.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/44: sync 2023-10-21T17:04:06.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/45: read - no filename 2023-10-21T17:04:06.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/46: readlink d3/l5 0 2023-10-21T17:04:06.163 INFO:tasks.workunit.client.0.smithi012.stdout:7/47: write - no filename 2023-10-21T17:04:06.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/59: dwrite f7 [0,4194304] 0 2023-10-21T17:04:06.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/60: fdatasync fd 0 2023-10-21T17:04:06.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/61: chown f11 5 1 2023-10-21T17:04:06.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/62: readlink l0 0 2023-10-21T17:04:06.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/63: write f11 [254477,40030] 0 2023-10-21T17:04:06.647 INFO:tasks.workunit.client.0.smithi012.stdout:3/50: symlink d0/da/l10 0 2023-10-21T17:04:06.682 INFO:tasks.workunit.client.0.smithi012.stdout:3/51: dread d0/f4 [0,4194304] 0 2023-10-21T17:04:06.682 INFO:tasks.workunit.client.0.smithi012.stdout:3/52: chown d0/l8 13 1 2023-10-21T17:04:06.682 INFO:tasks.workunit.client.0.smithi012.stdout:3/53: chown d0/l3 215601 1 2023-10-21T17:04:06.877 INFO:tasks.workunit.client.0.smithi012.stdout:1/76: mkdir d5/d15 0 2023-10-21T17:04:07.129 INFO:tasks.workunit.client.0.smithi012.stdout:4/82: mkdir dc/d15/d18 0 2023-10-21T17:04:07.130 INFO:tasks.workunit.client.0.smithi012.stdout:4/83: fdatasync dc/f10 0 2023-10-21T17:04:07.203 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:37:33.186 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.216 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:37:33.301 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.219 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:37:33.304 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.220 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:37:33.304 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.221 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:37:33.306 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.225 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:37:33.208 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.292 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:37:33.376 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.294 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:37:33.378 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.416 INFO:tasks.workunit.client.0.smithi012.stdout:5/38: mkdir d2/d6/d10 0 2023-10-21T17:04:07.416 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:37:33.399 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:04:07.539 INFO:tasks.workunit.client.0.smithi012.stdout:7/48: creat d3/d6/f7 x:0 0 0 2023-10-21T17:04:07.646 INFO:tasks.workunit.client.0.smithi012.stdout:7/49: dwrite d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:07.646 INFO:tasks.workunit.client.0.smithi012.stdout:7/50: getdents d3 0 2023-10-21T17:04:07.735 INFO:tasks.workunit.client.0.smithi012.stdout:8/49: mkdir d0/d12 0 2023-10-21T17:04:08.063 INFO:tasks.workunit.client.0.smithi012.stdout:0/66: getdents d7/d8 0 2023-10-21T17:04:08.063 INFO:tasks.workunit.client.0.smithi012.stdout:6/64: mknod d13/c17 0 2023-10-21T17:04:08.095 INFO:tasks.workunit.client.0.smithi012.stdout:1/77: rename d5/l6 to d5/d8/l16 0 2023-10-21T17:04:08.095 INFO:tasks.workunit.client.0.smithi012.stdout:4/84: link dc/ce dc/c19 0 2023-10-21T17:04:08.119 INFO:tasks.workunit.client.0.smithi012.stdout:1/78: dread d5/d8/fd [0,4194304] 0 2023-10-21T17:04:08.119 INFO:tasks.workunit.client.0.smithi012.stdout:1/79: getdents d5/d15 0 2023-10-21T17:04:08.200 INFO:tasks.workunit.client.0.smithi012.stdout:1/80: dwrite f4 [0,4194304] 0 2023-10-21T17:04:08.236 INFO:tasks.workunit.client.0.smithi012.stdout:1/81: dwrite f4 [0,4194304] 0 2023-10-21T17:04:08.236 INFO:tasks.workunit.client.0.smithi012.stdout:1/82: truncate d5/ff 744233 0 2023-10-21T17:04:08.237 INFO:tasks.workunit.client.0.smithi012.stdout:1/83: readlink d5/l7 0 2023-10-21T17:04:08.238 INFO:tasks.workunit.client.0.smithi012.stdout:1/84: write d5/f11 [43651,128084] 0 2023-10-21T17:04:08.280 INFO:tasks.workunit.client.0.smithi012.stdout:5/39: truncate d2/d6/f7 241283 0 2023-10-21T17:04:08.281 INFO:tasks.workunit.client.0.smithi012.stdout:9/32: sync 2023-10-21T17:04:08.281 INFO:tasks.workunit.client.0.smithi012.stdout:7/51: mknod d3/c8 0 2023-10-21T17:04:08.281 INFO:tasks.workunit.client.0.smithi012.stdout:7/52: chown d3/d6/f7 1571817130 1 2023-10-21T17:04:08.356 INFO:tasks.workunit.client.0.smithi012.stdout:9/33: dwrite d0/f3 [4194304,4194304] 0 2023-10-21T17:04:08.356 INFO:tasks.workunit.client.0.smithi012.stdout:9/34: write d0/f8 [951163,33278] 0 2023-10-21T17:04:08.528 INFO:tasks.workunit.client.0.smithi012.stdout:0/67: link d7/f1d d7/d8/d9/f1e 0 2023-10-21T17:04:08.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/68: dread - d7/d8/d9/f1e zero size 2023-10-21T17:04:08.703 INFO:tasks.workunit.client.0.smithi012.stdout:6/65: creat d13/d15/f18 x:0 0 0 2023-10-21T17:04:08.703 INFO:tasks.workunit.client.0.smithi012.stdout:6/66: chown d13 13908279 1 2023-10-21T17:04:08.704 INFO:tasks.workunit.client.0.smithi012.stdout:6/67: write fa [705338,130835] 0 2023-10-21T17:04:08.704 INFO:tasks.workunit.client.0.smithi012.stdout:6/68: write f6 [27318,5062] 0 2023-10-21T17:04:08.704 INFO:tasks.workunit.client.0.smithi012.stdout:6/69: chown d13/c17 8087234 1 2023-10-21T17:04:08.870 INFO:tasks.workunit.client.0.smithi012.stdout:4/85: symlink dc/d15/d18/l1a 0 2023-10-21T17:04:08.870 INFO:tasks.workunit.client.0.smithi012.stdout:4/86: dread - dc/f10 zero size 2023-10-21T17:04:08.988 INFO:tasks.workunit.client.0.smithi012.stdout:1/85: creat d5/d15/f17 x:0 0 0 2023-10-21T17:04:09.087 INFO:tasks.workunit.client.0.smithi012.stdout:5/40: symlink d2/l11 0 2023-10-21T17:04:09.112 INFO:tasks.workunit.client.0.smithi012.stdout:5/41: dread d2/f5 [0,4194304] 0 2023-10-21T17:04:09.112 INFO:tasks.workunit.client.0.smithi012.stdout:5/42: write d2/dd/fc [4983401,1655] 0 2023-10-21T17:04:09.328 INFO:tasks.workunit.client.0.smithi012.stdout:3/54: creat d0/f11 x:0 0 0 2023-10-21T17:04:09.329 INFO:tasks.workunit.client.0.smithi012.stdout:9/35: mknod d0/d4/c9 0 2023-10-21T17:04:09.329 INFO:tasks.workunit.client.0.smithi012.stdout:3/55: rename d0 to d0/da/d12 22 2023-10-21T17:04:09.347 INFO:tasks.workunit.client.0.smithi012.stdout:9/36: dread d0/f2 [0,4194304] 0 2023-10-21T17:04:09.365 INFO:tasks.workunit.client.0.smithi012.stdout:9/37: dread d0/f8 [0,4194304] 0 2023-10-21T17:04:09.427 INFO:tasks.workunit.client.0.smithi012.stdout:3/56: dwrite d0/f5 [0,4194304] 0 2023-10-21T17:04:09.427 INFO:tasks.workunit.client.0.smithi012.stdout:3/57: chown d0/da/fb 72976 1 2023-10-21T17:04:09.488 INFO:tasks.workunit.client.0.smithi012.stdout:8/50: mknod d0/c13 0 2023-10-21T17:04:09.512 INFO:tasks.workunit.client.0.smithi012.stdout:3/58: dwrite d0/f6 [0,4194304] 0 2023-10-21T17:04:09.566 INFO:tasks.workunit.client.0.smithi012.stdout:0/69: mkdir d7/d8/d1f 0 2023-10-21T17:04:09.902 INFO:tasks.workunit.client.0.smithi012.stdout:2/62: sync 2023-10-21T17:04:09.902 INFO:tasks.workunit.client.0.smithi012.stdout:2/63: chown d1/d4/f5 14852529 1 2023-10-21T17:04:09.960 INFO:tasks.workunit.client.0.smithi012.stdout:2/64: dwrite d1/d4/f5 [0,4194304] 0 2023-10-21T17:04:09.960 INFO:tasks.workunit.client.0.smithi012.stdout:2/65: readlink - no filename 2023-10-21T17:04:10.377 INFO:tasks.workunit.client.0.smithi012.stdout:1/86: mkdir d5/d18 0 2023-10-21T17:04:10.378 INFO:tasks.workunit.client.0.smithi012.stdout:1/87: write d5/f10 [366050,97525] 0 2023-10-21T17:04:10.672 INFO:tasks.workunit.client.0.smithi012.stdout:9/38: creat d0/d5/fa x:0 0 0 2023-10-21T17:04:10.673 INFO:tasks.workunit.client.0.smithi012.stdout:9/39: write d0/d5/fa [16966,27433] 0 2023-10-21T17:04:10.732 INFO:tasks.workunit.client.0.smithi012.stdout:8/51: write d0/f2 [3091789,97303] 0 2023-10-21T17:04:10.879 INFO:tasks.workunit.client.0.smithi012.stdout:3/59: mknod d0/c13 0 2023-10-21T17:04:10.980 INFO:tasks.workunit.client.0.smithi012.stdout:3/60: dwrite d0/da/fe [0,4194304] 0 2023-10-21T17:04:11.039 INFO:tasks.workunit.client.0.smithi012.stdout:0/70: rename d7/f1b to d7/d8/d9/f20 0 2023-10-21T17:04:11.063 INFO:tasks.workunit.client.0.smithi012.stdout:0/71: dread f1 [0,4194304] 0 2023-10-21T17:04:11.141 INFO:tasks.workunit.client.0.smithi012.stdout:7/53: write d3/d6/f7 [4358532,46054] 0 2023-10-21T17:04:11.239 INFO:tasks.workunit.client.0.smithi012.stdout:7/54: dwrite d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:11.274 INFO:tasks.workunit.client.0.smithi012.stdout:7/55: dread d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:11.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/70: unlink l5 0 2023-10-21T17:04:11.626 INFO:tasks.workunit.client.0.smithi012.stdout:6/71: dwrite f10 [0,4194304] 0 2023-10-21T17:04:11.627 INFO:tasks.workunit.client.0.smithi012.stdout:6/72: stat l0 0 2023-10-21T17:04:11.714 INFO:tasks.workunit.client.0.smithi012.stdout:9/40: mkdir d0/d4/db 0 2023-10-21T17:04:11.724 INFO:tasks.workunit.client.0.smithi012.stdout:9/41: write d0/f8 [441707,103262] 0 2023-10-21T17:04:11.796 INFO:tasks.workunit.client.0.smithi012.stdout:8/52: stat d0/fe 0 2023-10-21T17:04:11.870 INFO:tasks.workunit.client.0.smithi012.stdout:8/53: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:04:12.073 INFO:tasks.workunit.client.0.smithi012.stdout:3/61: link d0/f11 d0/f14 0 2023-10-21T17:04:12.073 INFO:tasks.workunit.client.0.smithi012.stdout:3/62: creat d0/f15 x:0 0 0 2023-10-21T17:04:12.401 INFO:tasks.workunit.client.0.smithi012.stdout:1/88: rename d5/cc to d5/d18/c19 0 2023-10-21T17:04:12.517 INFO:tasks.workunit.client.0.smithi012.stdout:0/72: symlink d7/d8/d9/l21 0 2023-10-21T17:04:12.861 INFO:tasks.workunit.client.0.smithi012.stdout:7/56: readlink l2 0 2023-10-21T17:04:12.899 INFO:tasks.workunit.client.0.smithi012.stdout:7/57: dread d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:12.925 INFO:tasks.workunit.client.0.smithi012.stdout:7/58: dread d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:12.926 INFO:tasks.workunit.client.0.smithi012.stdout:7/59: chown d3/d6 3 1 2023-10-21T17:04:12.952 INFO:tasks.workunit.client.0.smithi012.stdout:7/60: dread d3/d6/f7 [0,4194304] 0 2023-10-21T17:04:12.978 INFO:tasks.workunit.client.0.smithi012.stdout:7/61: write d3/d6/f7 [633098,26159] 0 2023-10-21T17:04:13.161 INFO:tasks.workunit.client.0.smithi012.stdout:9/42: mknod d0/d4/cc 0 2023-10-21T17:04:13.401 INFO:tasks.workunit.client.0.smithi012.stdout:8/54: write d0/fb [2172082,50244] 0 2023-10-21T17:04:14.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/87: sync 2023-10-21T17:04:14.418 INFO:tasks.workunit.client.0.smithi012.stdout:4/88: dwrite f1 [0,4194304] 0 2023-10-21T17:04:14.445 INFO:tasks.workunit.client.0.smithi012.stdout:4/89: write f8 [5983284,115933] 0 2023-10-21T17:04:14.472 INFO:tasks.workunit.client.0.smithi012.stdout:4/90: dread dc/f11 [0,4194304] 0 2023-10-21T17:04:14.745 INFO:tasks.workunit.client.0.smithi012.stdout:1/89: mkdir d5/d18/d1a 0 2023-10-21T17:04:15.151 INFO:tasks.workunit.client.0.smithi012.stdout:7/62: unlink d3/d6/f7 0 2023-10-21T17:04:15.493 INFO:tasks.workunit.client.0.smithi012.stdout:8/55: dread d0/f8 [0,4194304] 0 2023-10-21T17:04:15.930 INFO:tasks.workunit.client.0.smithi012.stdout:1/90: mkdir d5/d15/d1b 0 2023-10-21T17:04:16.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/63: mknod d3/d6/c9 0 2023-10-21T17:04:16.632 INFO:tasks.workunit.client.0.smithi012.stdout:8/56: mknod d0/d12/c14 0 2023-10-21T17:04:16.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/64: dread - no filename 2023-10-21T17:04:16.795 INFO:tasks.workunit.client.0.smithi012.stdout:2/66: rename d1/f3 to d1/f9 0 2023-10-21T17:04:16.912 INFO:tasks.workunit.client.0.smithi012.stdout:1/91: creat d5/d15/d1b/f1c x:0 0 0 2023-10-21T17:04:17.401 INFO:tasks.workunit.client.0.smithi012.stdout:7/65: symlink d3/d6/la 0 2023-10-21T17:04:17.401 INFO:tasks.workunit.client.0.smithi012.stdout:7/66: fsync - no filename 2023-10-21T17:04:17.402 INFO:tasks.workunit.client.0.smithi012.stdout:5/43: unlink l0 0 2023-10-21T17:04:17.402 INFO:tasks.workunit.client.0.smithi012.stdout:2/67: mknod d1/d8/ca 0 2023-10-21T17:04:17.557 INFO:tasks.workunit.client.0.smithi012.stdout:0/73: link f1 d7/d8/f22 0 2023-10-21T17:04:17.558 INFO:tasks.workunit.client.0.smithi012.stdout:7/67: symlink d3/d6/lb 0 2023-10-21T17:04:17.558 INFO:tasks.workunit.client.0.smithi012.stdout:0/74: fsync d7/d8/ff 0 2023-10-21T17:04:17.580 INFO:tasks.workunit.client.0.smithi012.stdout:0/75: dread f2 [0,4194304] 0 2023-10-21T17:04:17.581 INFO:tasks.workunit.client.0.smithi012.stdout:0/76: readlink l4 0 2023-10-21T17:04:17.615 INFO:tasks.workunit.client.0.smithi012.stdout:0/77: write d7/f19 [1912644,113988] 0 2023-10-21T17:04:17.826 INFO:tasks.workunit.client.0.smithi012.stdout:2/68: creat d1/fb x:0 0 0 2023-10-21T17:04:18.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/68: mkdir d3/d6/dc 0 2023-10-21T17:04:18.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/69: chown d3/d6/c9 1112 1 2023-10-21T17:04:18.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/70: chown d3/l5 31 1 2023-10-21T17:04:18.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/78: truncate f1 1465242 0 2023-10-21T17:04:18.533 INFO:tasks.workunit.client.0.smithi012.stdout:0/79: mkdir d7/d8/d23 0 2023-10-21T17:04:18.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/71: creat d3/d6/dc/fd x:0 0 0 2023-10-21T17:04:18.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/72: dread - d3/d6/dc/fd zero size 2023-10-21T17:04:18.534 INFO:tasks.workunit.client.0.smithi012.stdout:7/73: read - d3/d6/dc/fd zero size 2023-10-21T17:04:18.534 INFO:tasks.workunit.client.0.smithi012.stdout:7/74: read - d3/d6/dc/fd zero size 2023-10-21T17:04:18.534 INFO:tasks.workunit.client.0.smithi012.stdout:7/75: chown d3/d6 60968470 1 2023-10-21T17:04:18.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/91: truncate f8 5270292 0 2023-10-21T17:04:19.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/63: sync 2023-10-21T17:04:19.061 INFO:tasks.workunit.client.0.smithi012.stdout:3/64: fsync d0/da/fe 0 2023-10-21T17:04:19.255 INFO:tasks.workunit.client.0.smithi012.stdout:6/73: rename f3 to d13/d15/f19 0 2023-10-21T17:04:19.255 INFO:tasks.workunit.client.0.smithi012.stdout:8/57: rename d0 to d0/d12/d15 22 2023-10-21T17:04:19.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/58: dread d0/f8 [0,4194304] 0 2023-10-21T17:04:19.567 INFO:tasks.workunit.client.0.smithi012.stdout:0/80: link d7/f10 d7/d8/f24 0 2023-10-21T17:04:19.568 INFO:tasks.workunit.client.0.smithi012.stdout:0/81: write d7/f10 [672375,79159] 0 2023-10-21T17:04:19.602 INFO:tasks.workunit.client.0.smithi012.stdout:0/82: fsync f1 0 2023-10-21T17:04:19.603 INFO:tasks.workunit.client.0.smithi012.stdout:0/83: truncate d7/f1d 143283 0 2023-10-21T17:04:19.603 INFO:tasks.workunit.client.0.smithi012.stdout:0/84: write d7/d8/d9/f20 [522024,9228] 0 2023-10-21T17:04:19.698 INFO:tasks.workunit.client.0.smithi012.stdout:0/85: dwrite d7/d8/d9/f20 [0,4194304] 0 2023-10-21T17:04:19.739 INFO:tasks.workunit.client.0.smithi012.stdout:4/92: symlink dc/d15/l1b 0 2023-10-21T17:04:19.821 INFO:tasks.workunit.client.0.smithi012.stdout:2/69: dwrite d1/f9 [0,4194304] 0 2023-10-21T17:04:19.851 INFO:tasks.workunit.client.0.smithi012.stdout:2/70: dread d1/f9 [0,4194304] 0 2023-10-21T17:04:19.900 INFO:tasks.workunit.client.0.smithi012.stdout:2/71: dread d1/d4/f5 [0,4194304] 0 2023-10-21T17:04:19.900 INFO:tasks.workunit.client.0.smithi012.stdout:2/72: fdatasync d1/f9 0 2023-10-21T17:04:19.981 INFO:tasks.workunit.client.0.smithi012.stdout:2/73: dwrite d1/f9 [0,4194304] 0 2023-10-21T17:04:20.072 INFO:tasks.workunit.client.0.smithi012.stdout:3/65: symlink d0/l16 0 2023-10-21T17:04:20.079 INFO:tasks.workunit.client.0.smithi012.stdout:6/74: creat d13/d15/f1a x:0 0 0 2023-10-21T17:04:20.080 INFO:tasks.workunit.client.0.smithi012.stdout:6/75: write d13/f14 [369206,126688] 0 2023-10-21T17:04:20.141 INFO:tasks.workunit.client.0.smithi012.stdout:3/66: dwrite d0/f14 [0,4194304] 0 2023-10-21T17:04:20.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/44: rename d2/le to d2/dd/l12 0 2023-10-21T17:04:20.193 INFO:tasks.workunit.client.0.smithi012.stdout:6/76: dwrite d13/f14 [0,4194304] 0 2023-10-21T17:04:20.222 INFO:tasks.workunit.client.0.smithi012.stdout:8/59: creat d0/f16 x:0 0 0 2023-10-21T17:04:20.535 INFO:tasks.workunit.client.0.smithi012.stdout:1/92: rmdir d5/d18 39 2023-10-21T17:04:20.987 INFO:tasks.workunit.client.0.smithi012.stdout:0/86: mkdir d7/d8/d1f/d25 0 2023-10-21T17:04:20.987 INFO:tasks.workunit.client.0.smithi012.stdout:7/76: getdents d3/d6 0 2023-10-21T17:04:21.087 INFO:tasks.workunit.client.0.smithi012.stdout:7/77: dwrite d3/d6/dc/fd [0,4194304] 0 2023-10-21T17:04:21.164 INFO:tasks.workunit.client.0.smithi012.stdout:4/93: mkdir dc/d15/d18/d1c 0 2023-10-21T17:04:21.164 INFO:tasks.workunit.client.0.smithi012.stdout:2/74: link d1/d8/ca d1/d4/cc 0 2023-10-21T17:04:21.166 INFO:tasks.workunit.client.0.smithi012.stdout:3/67: symlink d0/l17 0 2023-10-21T17:04:21.192 INFO:tasks.workunit.client.0.smithi012.stdout:2/75: dread d1/f9 [0,4194304] 0 2023-10-21T17:04:21.192 INFO:tasks.workunit.client.0.smithi012.stdout:2/76: readlink - no filename 2023-10-21T17:04:21.192 INFO:tasks.workunit.client.0.smithi012.stdout:2/77: fsync d1/d4/f5 0 2023-10-21T17:04:21.193 INFO:tasks.workunit.client.0.smithi012.stdout:2/78: write d1/fb [405660,62161] 0 2023-10-21T17:04:21.193 INFO:tasks.workunit.client.0.smithi012.stdout:2/79: truncate d1/d4/f7 349344 0 2023-10-21T17:04:21.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/77: dread fc [0,4194304] 0 2023-10-21T17:04:21.237 INFO:tasks.workunit.client.0.smithi012.stdout:8/60: chown d0/f4 18802909 1 2023-10-21T17:04:21.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/93: creat d5/d18/d1a/f1d x:0 0 0 2023-10-21T17:04:21.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/94: read - d5/f14 zero size 2023-10-21T17:04:21.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/95: dread - d5/d15/d1b/f1c zero size 2023-10-21T17:04:21.429 INFO:tasks.workunit.client.0.smithi012.stdout:9/43: sync 2023-10-21T17:04:21.442 INFO:tasks.workunit.client.0.smithi012.stdout:9/44: dread d0/d5/fa [0,4194304] 0 2023-10-21T17:04:21.730 INFO:tasks.workunit.client.0.smithi012.stdout:8/61: fsync d0/f16 0 2023-10-21T17:04:21.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/87: link d7/l17 d7/d8/d1f/l26 0 2023-10-21T17:04:21.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/88: write d7/d8/f11 [857897,2327] 0 2023-10-21T17:04:22.403 INFO:tasks.workunit.client.0.smithi012.stdout:4/94: symlink dc/d15/d18/d1c/l1d 0 2023-10-21T17:04:22.503 INFO:tasks.workunit.client.0.smithi012.stdout:3/68: rmdir d0/da 39 2023-10-21T17:04:22.721 INFO:tasks.workunit.client.0.smithi012.stdout:2/80: symlink d1/d4/ld 0 2023-10-21T17:04:22.722 INFO:tasks.workunit.client.0.smithi012.stdout:2/81: creat d1/fe x:0 0 0 2023-10-21T17:04:22.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/78: stat f6 0 2023-10-21T17:04:23.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/96: mknod d5/c1e 0 2023-10-21T17:04:23.712 INFO:tasks.workunit.client.0.smithi012.stdout:7/78: dwrite d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:04:23.743 INFO:tasks.workunit.client.0.smithi012.stdout:7/79: dread d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:04:23.744 INFO:tasks.workunit.client.0.smithi012.stdout:7/80: chown d3 12785 1 2023-10-21T17:04:23.813 INFO:tasks.workunit.client.0.smithi012.stdout:7/81: dwrite d3/d6/dc/fd [8388608,4194304] 0 2023-10-21T17:04:23.854 INFO:tasks.workunit.client.0.smithi012.stdout:7/82: dread d3/d6/dc/fd [0,4194304] 0 2023-10-21T17:04:24.150 INFO:tasks.workunit.client.0.smithi012.stdout:8/62: readlink d0/l6 0 2023-10-21T17:04:24.151 INFO:tasks.workunit.client.0.smithi012.stdout:5/45: write d2/d6/f7 [313815,75779] 0 2023-10-21T17:04:24.162 INFO:tasks.workunit.client.0.smithi012.stdout:5/46: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:04:24.162 INFO:tasks.workunit.client.0.smithi012.stdout:5/47: chown d2/d6/f7 19594 1 2023-10-21T17:04:24.274 INFO:tasks.workunit.client.0.smithi012.stdout:0/89: mkdir d7/d8/d23/d27 0 2023-10-21T17:04:24.409 INFO:tasks.workunit.client.0.smithi012.stdout:4/95: rename dc/d15/d18/d1c to dc/d1e 0 2023-10-21T17:04:24.409 INFO:tasks.workunit.client.0.smithi012.stdout:4/96: write f8 [3188923,76601] 0 2023-10-21T17:04:24.410 INFO:tasks.workunit.client.0.smithi012.stdout:4/97: chown dc/c19 13384 1 2023-10-21T17:04:24.410 INFO:tasks.workunit.client.0.smithi012.stdout:4/98: chown dc/c16 0 1 2023-10-21T17:04:24.481 INFO:tasks.workunit.client.0.smithi012.stdout:3/69: creat d0/da/f18 x:0 0 0 2023-10-21T17:04:24.481 INFO:tasks.workunit.client.0.smithi012.stdout:3/70: readlink d0/l17 0 2023-10-21T17:04:24.519 INFO:tasks.workunit.client.0.smithi012.stdout:3/71: write d0/f7 [4020111,94701] 0 2023-10-21T17:04:24.589 INFO:tasks.workunit.client.0.smithi012.stdout:3/72: dwrite d0/fd [0,4194304] 0 2023-10-21T17:04:24.625 INFO:tasks.workunit.client.0.smithi012.stdout:3/73: write d0/f5 [4111370,10604] 0 2023-10-21T17:04:24.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/82: link d1/d4/f5 d1/d8/ff 0 2023-10-21T17:04:24.746 INFO:tasks.workunit.client.0.smithi012.stdout:2/83: dwrite d1/fe [0,4194304] 0 2023-10-21T17:04:24.857 INFO:tasks.workunit.client.0.smithi012.stdout:1/97: getdents d5/d8 0 2023-10-21T17:04:24.858 INFO:tasks.workunit.client.0.smithi012.stdout:1/98: fdatasync d5/f14 0 2023-10-21T17:04:24.858 INFO:tasks.workunit.client.0.smithi012.stdout:1/99: fsync d5/f14 0 2023-10-21T17:04:25.061 INFO:tasks.workunit.client.0.smithi012.stdout:7/83: symlink d3/d6/le 0 2023-10-21T17:04:25.404 INFO:tasks.workunit.client.0.smithi012.stdout:8/63: creat d0/f17 x:0 0 0 2023-10-21T17:04:25.572 INFO:tasks.workunit.client.0.smithi012.stdout:9/45: sync 2023-10-21T17:04:25.572 INFO:tasks.workunit.client.0.smithi012.stdout:9/46: fsync d0/d5/fa 0 2023-10-21T17:04:25.588 INFO:tasks.workunit.client.0.smithi012.stdout:5/48: symlink d2/d6/l13 0 2023-10-21T17:04:25.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/90: mkdir d7/d8/d1f/d28 0 2023-10-21T17:04:25.929 INFO:tasks.workunit.client.0.smithi012.stdout:4/99: creat dc/d15/f1f x:0 0 0 2023-10-21T17:04:26.427 INFO:tasks.workunit.client.0.smithi012.stdout:3/74: rmdir d0 39 2023-10-21T17:04:26.611 INFO:tasks.workunit.client.0.smithi012.stdout:2/84: creat d1/d8/f10 x:0 0 0 2023-10-21T17:04:26.611 INFO:tasks.workunit.client.0.smithi012.stdout:2/85: creat d1/d4/f11 x:0 0 0 2023-10-21T17:04:26.611 INFO:tasks.workunit.client.0.smithi012.stdout:2/86: fdatasync d1/d4/f11 0 2023-10-21T17:04:26.763 INFO:tasks.workunit.client.0.smithi012.stdout:6/79: rmdir d13/d15 39 2023-10-21T17:04:26.763 INFO:tasks.workunit.client.0.smithi012.stdout:6/80: chown d13/f16 7002 1 2023-10-21T17:04:26.764 INFO:tasks.workunit.client.0.smithi012.stdout:6/81: read - d13/f16 zero size 2023-10-21T17:04:27.023 INFO:tasks.workunit.client.0.smithi012.stdout:1/100: link d5/d8/fd d5/d18/d1a/f1f 0 2023-10-21T17:04:27.024 INFO:tasks.workunit.client.0.smithi012.stdout:1/101: truncate d5/d15/f17 729948 0 2023-10-21T17:04:27.368 INFO:tasks.workunit.client.0.smithi012.stdout:8/64: truncate d0/fb 2699863 0 2023-10-21T17:04:27.476 INFO:tasks.workunit.client.0.smithi012.stdout:9/47: symlink d0/d4/ld 0 2023-10-21T17:04:27.703 INFO:tasks.workunit.client.0.smithi012.stdout:5/49: mknod d2/d6/d10/c14 0 2023-10-21T17:04:27.703 INFO:tasks.workunit.client.0.smithi012.stdout:0/91: mknod d7/d8/d1f/d25/c29 0 2023-10-21T17:04:28.207 INFO:tasks.workunit.client.0.smithi012.stdout:3/75: mknod d0/da/c19 0 2023-10-21T17:04:28.276 INFO:tasks.workunit.client.0.smithi012.stdout:2/87: mkdir d1/d4/d12 0 2023-10-21T17:04:28.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/88: read - d1/d4/f11 zero size 2023-10-21T17:04:28.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/89: dread - d1/d8/f10 zero size 2023-10-21T17:04:28.290 INFO:tasks.workunit.client.0.smithi012.stdout:3/76: dwrite d0/fd [0,4194304] 0 2023-10-21T17:04:28.345 INFO:tasks.workunit.client.0.smithi012.stdout:2/90: dwrite d1/d4/f11 [0,4194304] 0 2023-10-21T17:04:28.414 INFO:tasks.workunit.client.0.smithi012.stdout:2/91: dwrite d1/d4/f11 [0,4194304] 0 2023-10-21T17:04:28.568 INFO:tasks.workunit.client.0.smithi012.stdout:1/102: link d5/f14 d5/d18/f20 0 2023-10-21T17:04:28.568 INFO:tasks.workunit.client.0.smithi012.stdout:1/103: read - d5/d18/d1a/f1d zero size 2023-10-21T17:04:28.607 INFO:tasks.workunit.client.0.smithi012.stdout:1/104: dread f4 [0,4194304] 0 2023-10-21T17:04:28.685 INFO:tasks.workunit.client.0.smithi012.stdout:7/84: getdents d3/d6/dc 0 2023-10-21T17:04:28.685 INFO:tasks.workunit.client.0.smithi012.stdout:7/85: chown d3/c4 1 1 2023-10-21T17:04:29.337 INFO:tasks.workunit.client.0.smithi012.stdout:9/48: rename d0/d5/fa to d0/fe 0 2023-10-21T17:04:29.426 INFO:tasks.workunit.client.0.smithi012.stdout:9/49: dwrite d0/fe [0,4194304] 0 2023-10-21T17:04:29.426 INFO:tasks.workunit.client.0.smithi012.stdout:9/50: chown d0/d4/ld 1680251228 1 2023-10-21T17:04:29.611 INFO:tasks.workunit.client.0.smithi012.stdout:0/92: truncate d7/d8/f22 142623 0 2023-10-21T17:04:30.190 INFO:tasks.workunit.client.0.smithi012.stdout:3/77: truncate d0/f14 42903 0 2023-10-21T17:04:30.298 INFO:tasks.workunit.client.0.smithi012.stdout:4/100: dwrite dc/f17 [0,4194304] 0 2023-10-21T17:04:30.332 INFO:tasks.workunit.client.0.smithi012.stdout:4/101: dread dc/f11 [0,4194304] 0 2023-10-21T17:04:30.465 INFO:tasks.workunit.client.0.smithi012.stdout:1/105: mkdir d5/d18/d21 0 2023-10-21T17:04:30.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/106: dwrite d5/f11 [0,4194304] 0 2023-10-21T17:04:30.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/107: fdatasync d5/d18/d1a/f1d 0 2023-10-21T17:04:30.615 INFO:tasks.workunit.client.0.smithi012.stdout:7/86: mkdir d3/d6/dc/df 0 2023-10-21T17:04:30.615 INFO:tasks.workunit.client.0.smithi012.stdout:7/87: fdatasync d3/d6/dc/fd 0 2023-10-21T17:04:30.615 INFO:tasks.workunit.client.0.smithi012.stdout:7/88: readlink l2 0 2023-10-21T17:04:30.697 INFO:tasks.workunit.client.0.smithi012.stdout:5/50: rename d2/d6/d10 to d2/dd/d15 0 2023-10-21T17:04:30.794 INFO:tasks.workunit.client.0.smithi012.stdout:5/51: dwrite d2/dd/fc [0,4194304] 0 2023-10-21T17:04:30.878 INFO:tasks.workunit.client.0.smithi012.stdout:5/52: dwrite d2/f4 [4194304,4194304] 0 2023-10-21T17:04:30.933 INFO:tasks.workunit.client.0.smithi012.stdout:5/53: dwrite d2/d6/f7 [0,4194304] 0 2023-10-21T17:04:31.058 INFO:tasks.workunit.client.0.smithi012.stdout:9/51: mkdir d0/df 0 2023-10-21T17:04:31.344 INFO:tasks.workunit.client.0.smithi012.stdout:0/93: unlink d7/cc 0 2023-10-21T17:04:31.344 INFO:tasks.workunit.client.0.smithi012.stdout:0/94: truncate d7/d8/ff 915732 0 2023-10-21T17:04:31.344 INFO:tasks.workunit.client.0.smithi012.stdout:0/95: chown d7/l13 315626 1 2023-10-21T17:04:31.686 INFO:tasks.workunit.client.0.smithi012.stdout:9/52: fsync d0/fe 0 2023-10-21T17:04:31.687 INFO:tasks.workunit.client.0.smithi012.stdout:8/65: sync 2023-10-21T17:04:31.704 INFO:tasks.workunit.client.0.smithi012.stdout:9/53: dread d0/f8 [0,4194304] 0 2023-10-21T17:04:31.705 INFO:tasks.workunit.client.0.smithi012.stdout:9/54: read d0/f2 [53938,8712] 0 2023-10-21T17:04:31.705 INFO:tasks.workunit.client.0.smithi012.stdout:9/55: chown d0/d4/db 126106 1 2023-10-21T17:04:31.705 INFO:tasks.workunit.client.0.smithi012.stdout:9/56: write d0/f8 [78599,22065] 0 2023-10-21T17:04:31.780 INFO:tasks.workunit.client.0.smithi012.stdout:9/57: dwrite d0/fe [0,4194304] 0 2023-10-21T17:04:31.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/82: dwrite d13/d15/f19 [0,4194304] 0 2023-10-21T17:04:31.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/83: dread - d13/d15/f18 zero size 2023-10-21T17:04:31.825 INFO:tasks.workunit.client.0.smithi012.stdout:9/58: dread d0/f3 [4194304,4194304] 0 2023-10-21T17:04:31.825 INFO:tasks.workunit.client.0.smithi012.stdout:9/59: write d0/f3 [458062,19782] 0 2023-10-21T17:04:31.874 INFO:tasks.workunit.client.0.smithi012.stdout:9/60: dread d0/fe [0,4194304] 0 2023-10-21T17:04:31.875 INFO:tasks.workunit.client.0.smithi012.stdout:9/61: write d0/f8 [1244398,27993] 0 2023-10-21T17:04:32.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/102: rename dc/ld to dc/l20 0 2023-10-21T17:04:32.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/103: chown f1 0 1 2023-10-21T17:04:32.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/92: link d1/d8/f10 d1/d8/f13 0 2023-10-21T17:04:32.522 INFO:tasks.workunit.client.0.smithi012.stdout:7/89: getdents d3/d6 0 2023-10-21T17:04:32.557 INFO:tasks.workunit.client.0.smithi012.stdout:1/108: rename d5/c9 to d5/d8/c22 0 2023-10-21T17:04:32.558 INFO:tasks.workunit.client.0.smithi012.stdout:5/54: creat d2/dd/d15/f16 x:0 0 0 2023-10-21T17:04:32.560 INFO:tasks.workunit.client.0.smithi012.stdout:2/93: write d1/fe [2697391,41793] 0 2023-10-21T17:04:32.594 INFO:tasks.workunit.client.0.smithi012.stdout:0/96: creat d7/d8/d23/f2a x:0 0 0 2023-10-21T17:04:32.649 INFO:tasks.workunit.client.0.smithi012.stdout:5/55: dwrite d2/dd/fc [4194304,4194304] 0 2023-10-21T17:04:32.866 INFO:tasks.workunit.client.0.smithi012.stdout:6/84: mknod d13/d15/c1b 0 2023-10-21T17:04:33.188 INFO:tasks.workunit.client.0.smithi012.stdout:9/62: unlink d0/d4/c9 0 2023-10-21T17:04:33.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/63: dread d0/f2 [0,4194304] 0 2023-10-21T17:04:33.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/64: truncate d0/f8 1787343 0 2023-10-21T17:04:33.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:04:33.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:04:33.320 INFO:tasks.workunit.client.0.smithi012.stdout:4/104: mknod dc/d1e/c21 0 2023-10-21T17:04:33.320 INFO:tasks.workunit.client.0.smithi012.stdout:4/105: chown fb 221363 1 2023-10-21T17:04:33.539 INFO:tasks.workunit.client.0.smithi012.stdout:1/109: symlink d5/d18/d1a/l23 0 2023-10-21T17:04:34.421 INFO:tasks.workunit.client.0.smithi012.stdout:0/97: symlink d7/d8/d1f/l2b 0 2023-10-21T17:04:34.421 INFO:tasks.workunit.client.0.smithi012.stdout:0/98: write d7/d8/d9/f12 [836558,15510] 0 2023-10-21T17:04:34.421 INFO:tasks.workunit.client.0.smithi012.stdout:0/99: write f6 [590696,4783] 0 2023-10-21T17:04:34.664 INFO:tasks.workunit.client.0.smithi012.stdout:5/56: symlink d2/dd/l17 0 2023-10-21T17:04:34.704 INFO:tasks.workunit.client.0.smithi012.stdout:5/57: write d2/dd/fc [3173315,6583] 0 2023-10-21T17:04:34.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/58: write d2/d6/f7 [3601090,95256] 0 2023-10-21T17:04:34.731 INFO:tasks.workunit.client.0.smithi012.stdout:5/59: fsync d2/f5 0 2023-10-21T17:04:34.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/85: creat d13/d15/f1c x:0 0 0 2023-10-21T17:04:34.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/86: chown d13/d15/c1b 838 1 2023-10-21T17:04:34.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/78: sync 2023-10-21T17:04:34.824 INFO:tasks.workunit.client.0.smithi012.stdout:3/79: dread d0/f7 [0,4194304] 0 2023-10-21T17:04:34.958 INFO:tasks.workunit.client.0.smithi012.stdout:9/65: mknod d0/d4/db/c10 0 2023-10-21T17:04:35.022 INFO:tasks.workunit.client.0.smithi012.stdout:9/66: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:04:35.022 INFO:tasks.workunit.client.0.smithi012.stdout:9/67: readlink d0/l6 0 2023-10-21T17:04:35.031 INFO:tasks.workunit.client.0.smithi012.stdout:4/106: mknod dc/d15/c22 0 2023-10-21T17:04:35.211 INFO:tasks.workunit.client.0.smithi012.stdout:1/110: truncate f1 45155 0 2023-10-21T17:04:35.499 INFO:tasks.workunit.client.0.smithi012.stdout:0/100: mknod d7/d8/d1f/d25/c2c 0 2023-10-21T17:04:35.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/87: write d13/d15/f19 [4265182,54332] 0 2023-10-21T17:04:35.833 INFO:tasks.workunit.client.0.smithi012.stdout:8/66: dwrite d0/fb [0,4194304] 0 2023-10-21T17:04:36.375 INFO:tasks.workunit.client.0.smithi012.stdout:9/68: link d0/f3 d0/df/f11 0 2023-10-21T17:04:36.403 INFO:tasks.workunit.client.0.smithi012.stdout:9/69: dread d0/fe [0,4194304] 0 2023-10-21T17:04:36.525 INFO:tasks.workunit.client.0.smithi012.stdout:4/107: truncate fb 1019041 0 2023-10-21T17:04:36.660 INFO:tasks.workunit.client.0.smithi012.stdout:1/111: symlink d5/d18/d21/l24 0 2023-10-21T17:04:36.750 INFO:tasks.workunit.client.0.smithi012.stdout:1/112: dwrite d5/d8/fb [4194304,4194304] 0 2023-10-21T17:04:36.921 INFO:tasks.workunit.client.0.smithi012.stdout:6/88: mkdir d13/d15/d1d 0 2023-10-21T17:04:37.158 INFO:tasks.workunit.client.0.smithi012.stdout:7/90: rename d3/l5 to d3/d6/dc/df/l10 0 2023-10-21T17:04:37.234 INFO:tasks.workunit.client.0.smithi012.stdout:7/91: dwrite d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:04:37.259 INFO:tasks.workunit.client.0.smithi012.stdout:7/92: write d3/d6/dc/fd [9501869,90326] 0 2023-10-21T17:04:37.285 INFO:tasks.workunit.client.0.smithi012.stdout:7/93: read d3/d6/dc/fd [7539761,74125] 0 2023-10-21T17:04:37.357 INFO:tasks.workunit.client.0.smithi012.stdout:9/70: mkdir d0/d4/db/d12 0 2023-10-21T17:04:37.439 INFO:tasks.workunit.client.0.smithi012.stdout:9/71: dwrite d0/f3 [4194304,4194304] 0 2023-10-21T17:04:37.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/72: chown d0/f2 1631288475 1 2023-10-21T17:04:37.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/73: fdatasync d0/f8 0 2023-10-21T17:04:37.496 INFO:tasks.workunit.client.0.smithi012.stdout:4/108: rmdir dc/d1e 39 2023-10-21T17:04:37.507 INFO:tasks.workunit.client.0.smithi012.stdout:9/74: dwrite d0/df/f11 [4194304,4194304] 0 2023-10-21T17:04:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:6/89: readlink l0 0 2023-10-21T17:04:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:6/90: dread - d13/f16 zero size 2023-10-21T17:04:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:6/91: fsync d13/d15/f1a 0 2023-10-21T17:04:37.812 INFO:tasks.workunit.client.0.smithi012.stdout:6/92: stat d13/f14 0 2023-10-21T17:04:37.821 INFO:tasks.workunit.client.0.smithi012.stdout:8/67: rmdir d0 39 2023-10-21T17:04:37.997 INFO:tasks.workunit.client.0.smithi012.stdout:0/101: rename d7/d8/d9/f16 to d7/d8/d23/d27/f2d 0 2023-10-21T17:04:37.997 INFO:tasks.workunit.client.0.smithi012.stdout:0/102: truncate d7/d8/f24 774872 0 2023-10-21T17:04:38.085 INFO:tasks.workunit.client.0.smithi012.stdout:0/103: dwrite d7/f10 [0,4194304] 0 2023-10-21T17:04:38.787 INFO:tasks.workunit.client.0.smithi012.stdout:4/109: link dc/c14 dc/d15/d18/c23 0 2023-10-21T17:04:38.788 INFO:tasks.workunit.client.0.smithi012.stdout:4/110: dread - dc/f10 zero size 2023-10-21T17:04:38.788 INFO:tasks.workunit.client.0.smithi012.stdout:4/111: readlink dc/l12 0 2023-10-21T17:04:38.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/75: rmdir d0/d4/db 39 2023-10-21T17:04:38.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/76: rename d0 to d0/d4/db/d12/d13 22 2023-10-21T17:04:39.013 INFO:tasks.workunit.client.0.smithi012.stdout:6/93: write f10 [5041913,45868] 0 2023-10-21T17:04:39.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/68: symlink d0/d12/l18 0 2023-10-21T17:04:39.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/69: stat d0/f2 0 2023-10-21T17:04:39.112 INFO:tasks.workunit.client.0.smithi012.stdout:6/94: dwrite fc [0,4194304] 0 2023-10-21T17:04:39.112 INFO:tasks.workunit.client.0.smithi012.stdout:6/95: write d13/f16 [786698,29683] 0 2023-10-21T17:04:39.756 INFO:tasks.workunit.client.0.smithi012.stdout:4/112: link dc/d1e/l1d dc/d15/l24 0 2023-10-21T17:04:39.881 INFO:tasks.workunit.client.0.smithi012.stdout:9/77: creat d0/f14 x:0 0 0 2023-10-21T17:04:40.030 INFO:tasks.workunit.client.0.smithi012.stdout:8/70: creat d0/f19 x:0 0 0 2023-10-21T17:04:40.053 INFO:tasks.workunit.client.0.smithi012.stdout:8/71: write d0/fb [3934734,111799] 0 2023-10-21T17:04:40.101 INFO:tasks.workunit.client.0.smithi012.stdout:8/72: write d0/f11 [1812414,42133] 0 2023-10-21T17:04:40.102 INFO:tasks.workunit.client.0.smithi012.stdout:8/73: write d0/f17 [1025076,84010] 0 2023-10-21T17:04:40.162 INFO:tasks.workunit.client.0.smithi012.stdout:5/60: rmdir d2 39 2023-10-21T17:04:40.162 INFO:tasks.workunit.client.0.smithi012.stdout:6/96: mknod d13/d15/d1d/c1e 0 2023-10-21T17:04:40.189 INFO:tasks.workunit.client.0.smithi012.stdout:6/97: write d13/d15/f19 [3013250,55737] 0 2023-10-21T17:04:40.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/113: creat dc/f25 x:0 0 0 2023-10-21T17:04:40.637 INFO:tasks.workunit.client.0.smithi012.stdout:2/94: sync 2023-10-21T17:04:40.637 INFO:tasks.workunit.client.0.smithi012.stdout:3/80: sync 2023-10-21T17:04:40.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/81: read d0/f7 [2769315,83124] 0 2023-10-21T17:04:40.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/82: truncate d0/f15 375821 0 2023-10-21T17:04:40.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/83: chown d0/f14 13565679 1 2023-10-21T17:04:40.897 INFO:tasks.workunit.client.0.smithi012.stdout:8/74: chown d0/l3 121 1 2023-10-21T17:04:41.926 INFO:tasks.workunit.client.0.smithi012.stdout:2/95: dread d1/d4/f7 [0,4194304] 0 2023-10-21T17:04:41.993 INFO:tasks.workunit.client.0.smithi012.stdout:3/84: rmdir d0 39 2023-10-21T17:04:42.081 INFO:tasks.workunit.client.0.smithi012.stdout:1/113: rmdir d5/d8 39 2023-10-21T17:04:42.081 INFO:tasks.workunit.client.0.smithi012.stdout:7/94: sync 2023-10-21T17:04:42.082 INFO:tasks.workunit.client.0.smithi012.stdout:7/95: chown d3/d6/lb 3016 1 2023-10-21T17:04:42.082 INFO:tasks.workunit.client.0.smithi012.stdout:1/114: write d5/d18/f20 [127862,32716] 0 2023-10-21T17:04:42.323 INFO:tasks.workunit.client.0.smithi012.stdout:2/96: mkdir d1/d14 0 2023-10-21T17:04:42.324 INFO:tasks.workunit.client.0.smithi012.stdout:2/97: chown d1/d4/f5 44510954 1 2023-10-21T17:04:42.383 INFO:tasks.workunit.client.0.smithi012.stdout:3/85: mkdir d0/d1a 0 2023-10-21T17:04:42.384 INFO:tasks.workunit.client.0.smithi012.stdout:7/96: creat d3/d6/dc/df/f11 x:0 0 0 2023-10-21T17:04:42.404 INFO:tasks.workunit.client.0.smithi012.stdout:1/115: rename d5/d8/l13 to d5/d15/d1b/l25 0 2023-10-21T17:04:42.421 INFO:tasks.workunit.client.0.smithi012.stdout:1/116: read d5/d8/fb [2397139,61012] 0 2023-10-21T17:04:42.558 INFO:tasks.workunit.client.0.smithi012.stdout:8/75: mkdir d0/d1a 0 2023-10-21T17:04:42.672 INFO:tasks.workunit.client.0.smithi012.stdout:8/76: dwrite d0/f2 [0,4194304] 0 2023-10-21T17:04:42.680 INFO:tasks.workunit.client.0.smithi012.stdout:2/98: rmdir d1/d4/d12 0 2023-10-21T17:04:43.075 INFO:tasks.workunit.client.0.smithi012.stdout:7/97: symlink d3/d6/l12 0 2023-10-21T17:04:43.075 INFO:tasks.workunit.client.0.smithi012.stdout:3/86: creat d0/f1b x:0 0 0 2023-10-21T17:04:43.075 INFO:tasks.workunit.client.0.smithi012.stdout:7/98: write d3/d6/dc/df/f11 [649130,38551] 0 2023-10-21T17:04:43.076 INFO:tasks.workunit.client.0.smithi012.stdout:7/99: fsync d3/d6/dc/fd 0 2023-10-21T17:04:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:8/77: creat d0/d12/f1b x:0 0 0 2023-10-21T17:04:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/99: symlink d1/d8/l15 0 2023-10-21T17:04:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/100: chown d1/f9 145153002 1 2023-10-21T17:04:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:8/78: write d0/f11 [793836,9977] 0 2023-10-21T17:04:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/101: chown d1/d8 20482037 1 2023-10-21T17:04:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/102: dread - d1/d8/f13 zero size 2023-10-21T17:04:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/103: stat d1 0 2023-10-21T17:04:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/104: truncate d1/fb 919816 0 2023-10-21T17:04:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:8/79: write d0/fb [1905066,82345] 0 2023-10-21T17:04:43.366 INFO:tasks.workunit.client.0.smithi012.stdout:0/104: rmdir d7/d8 39 2023-10-21T17:04:43.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/114: dread fb [0,4194304] 0 2023-10-21T17:04:43.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/115: write dc/f11 [2485205,79640] 0 2023-10-21T17:04:43.451 INFO:tasks.workunit.client.0.smithi012.stdout:5/61: creat d2/f18 x:0 0 0 2023-10-21T17:04:43.669 INFO:tasks.workunit.client.0.smithi012.stdout:9/78: truncate d0/f3 4433331 0 2023-10-21T17:04:43.670 INFO:tasks.workunit.client.0.smithi012.stdout:9/79: stat d0/df/f11 0 2023-10-21T17:04:44.066 INFO:tasks.workunit.client.0.smithi012.stdout:3/87: mkdir d0/d1c 0 2023-10-21T17:04:44.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/100: mknod d3/d6/c13 0 2023-10-21T17:04:44.067 INFO:tasks.workunit.client.0.smithi012.stdout:3/88: write d0/da/f18 [1032672,77878] 0 2023-10-21T17:04:44.095 INFO:tasks.workunit.client.0.smithi012.stdout:3/89: dread d0/da/fe [0,4194304] 0 2023-10-21T17:04:44.095 INFO:tasks.workunit.client.0.smithi012.stdout:3/90: readlink d0/l17 0 2023-10-21T17:04:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:8/80: chown d0/l7 1566268 1 2023-10-21T17:04:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:6/98: sync 2023-10-21T17:04:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:8/81: dread d0/f11 [0,4194304] 0 2023-10-21T17:04:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:6/99: dwrite d13/f14 [0,4194304] 0 2023-10-21T17:04:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:6/100: creat d13/d15/f1f x:0 0 0 2023-10-21T17:04:44.487 INFO:tasks.workunit.client.0.smithi012.stdout:2/105: mkdir d1/d14/d16 0 2023-10-21T17:04:44.488 INFO:tasks.workunit.client.0.smithi012.stdout:2/106: dread - d1/d8/f13 zero size 2023-10-21T17:04:44.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/105: creat d7/d8/d1f/f2e x:0 0 0 2023-10-21T17:04:44.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/106: read - d7/d8/d1f/f2e zero size 2023-10-21T17:04:44.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/107: readlink l4 0 2023-10-21T17:04:44.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/108: chown d7/d8/d23/f2a 6251 1 2023-10-21T17:04:44.509 INFO:tasks.workunit.client.0.smithi012.stdout:4/116: symlink dc/d1e/l26 0 2023-10-21T17:04:44.574 INFO:tasks.workunit.client.0.smithi012.stdout:5/62: mknod d2/d6/c19 0 2023-10-21T17:04:44.604 INFO:tasks.workunit.client.0.smithi012.stdout:5/63: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:04:44.607 INFO:tasks.workunit.client.0.smithi012.stdout:4/117: dwrite f1 [0,4194304] 0 2023-10-21T17:04:44.635 INFO:tasks.workunit.client.0.smithi012.stdout:4/118: read dc/f17 [3719847,54289] 0 2023-10-21T17:04:44.636 INFO:tasks.workunit.client.0.smithi012.stdout:4/119: stat f1 0 2023-10-21T17:04:44.636 INFO:tasks.workunit.client.0.smithi012.stdout:4/120: creat dc/f27 x:0 0 0 2023-10-21T17:04:44.636 INFO:tasks.workunit.client.0.smithi012.stdout:4/121: truncate dc/f10 389496 0 2023-10-21T17:04:44.985 INFO:tasks.workunit.client.0.smithi012.stdout:9/80: mkdir d0/d15 0 2023-10-21T17:04:44.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/117: truncate d5/ff 636816 0 2023-10-21T17:04:45.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/101: link l2 d3/d6/dc/df/l14 0 2023-10-21T17:04:45.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/102: stat d3/d6/dc 0 2023-10-21T17:04:45.067 INFO:tasks.workunit.client.0.smithi012.stdout:1/118: dwrite d5/d18/d1a/f1d [0,4194304] 0 2023-10-21T17:04:45.121 INFO:tasks.workunit.client.0.smithi012.stdout:1/119: dwrite d5/f11 [0,4194304] 0 2023-10-21T17:04:45.121 INFO:tasks.workunit.client.0.smithi012.stdout:1/120: dread - d5/d15/d1b/f1c zero size 2023-10-21T17:04:45.140 INFO:tasks.workunit.client.0.smithi012.stdout:1/121: dread d5/f14 [0,4194304] 0 2023-10-21T17:04:45.140 INFO:tasks.workunit.client.0.smithi012.stdout:1/122: chown d5/d8/ca 533387699 1 2023-10-21T17:04:45.343 INFO:tasks.workunit.client.0.smithi012.stdout:6/101: dwrite f8 [0,4194304] 0 2023-10-21T17:04:45.405 INFO:tasks.workunit.client.0.smithi012.stdout:2/107: mkdir d1/d14/d17 0 2023-10-21T17:04:45.405 INFO:tasks.workunit.client.0.smithi012.stdout:2/108: write d1/fe [1277784,5326] 0 2023-10-21T17:04:45.703 INFO:tasks.workunit.client.0.smithi012.stdout:0/109: rename d7/c15 to d7/d8/d1f/d25/c2f 0 2023-10-21T17:04:45.704 INFO:tasks.workunit.client.0.smithi012.stdout:7/103: rename d3/d6/dc to d3/d6/dc/df/d15 22 2023-10-21T17:04:45.704 INFO:tasks.workunit.client.0.smithi012.stdout:5/64: mkdir d2/d1a 0 2023-10-21T17:04:45.704 INFO:tasks.workunit.client.0.smithi012.stdout:5/65: write d2/d6/f7 [906030,54350] 0 2023-10-21T17:04:45.720 INFO:tasks.workunit.client.0.smithi012.stdout:7/104: dread d3/d6/dc/df/f11 [0,4194304] 0 2023-10-21T17:04:45.796 INFO:tasks.workunit.client.0.smithi012.stdout:5/66: dwrite d2/dd/fc [4194304,4194304] 0 2023-10-21T17:04:45.796 INFO:tasks.workunit.client.0.smithi012.stdout:5/67: stat d2 0 2023-10-21T17:04:46.472 INFO:tasks.workunit.client.0.smithi012.stdout:9/81: symlink d0/df/l16 0 2023-10-21T17:04:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:8/82: rmdir d0/d12 39 2023-10-21T17:04:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:8/83: write d0/f11 [1126605,77532] 0 2023-10-21T17:04:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:8/84: truncate d0/d12/f1b 146657 0 2023-10-21T17:04:46.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/91: write d0/f11 [432236,116012] 0 2023-10-21T17:04:46.633 INFO:tasks.workunit.client.0.smithi012.stdout:3/92: write d0/fd [3935988,52761] 0 2023-10-21T17:04:46.657 INFO:tasks.workunit.client.0.smithi012.stdout:3/93: dread d0/f6 [0,4194304] 0 2023-10-21T17:04:46.657 INFO:tasks.workunit.client.0.smithi012.stdout:3/94: fdatasync d0/f4 0 2023-10-21T17:04:46.683 INFO:tasks.workunit.client.0.smithi012.stdout:3/95: dread d0/f7 [0,4194304] 0 2023-10-21T17:04:47.030 INFO:tasks.workunit.client.0.smithi012.stdout:1/123: dread d5/d15/f17 [0,4194304] 0 2023-10-21T17:04:47.032 INFO:tasks.workunit.client.0.smithi012.stdout:1/124: read d5/f14 [5164,48720] 0 2023-10-21T17:04:47.368 INFO:tasks.workunit.client.0.smithi012.stdout:6/102: truncate d13/d15/f19 2403074 0 2023-10-21T17:04:47.368 INFO:tasks.workunit.client.0.smithi012.stdout:6/103: fsync fc 0 2023-10-21T17:04:48.533 INFO:tasks.workunit.client.0.smithi012.stdout:0/110: mkdir d7/d8/d23/d30 0 2023-10-21T17:04:48.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/111: write d7/f19 [4119356,100379] 0 2023-10-21T17:04:48.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/112: chown d7/f10 7030 1 2023-10-21T17:04:48.535 INFO:tasks.workunit.client.0.smithi012.stdout:0/113: write d7/d8/d23/f2a [1026517,70324] 0 2023-10-21T17:04:48.943 INFO:tasks.workunit.client.0.smithi012.stdout:7/105: mkdir d3/d16 0 2023-10-21T17:04:48.944 INFO:tasks.workunit.client.0.smithi012.stdout:5/68: symlink d2/dd/d15/l1b 0 2023-10-21T17:04:48.944 INFO:tasks.workunit.client.0.smithi012.stdout:7/106: chown d3/d6 9 1 2023-10-21T17:04:49.549 INFO:tasks.workunit.client.0.smithi012.stdout:3/96: symlink d0/d1c/l1d 0 2023-10-21T17:04:49.549 INFO:tasks.workunit.client.0.smithi012.stdout:3/97: truncate d0/f1b 837794 0 2023-10-21T17:04:49.555 INFO:tasks.workunit.client.0.smithi012.stdout:3/98: fdatasync d0/f14 0 2023-10-21T17:04:49.661 INFO:tasks.workunit.client.0.smithi012.stdout:1/125: dread d5/ff [0,4194304] 0 2023-10-21T17:04:49.871 INFO:tasks.workunit.client.0.smithi012.stdout:6/104: creat d13/d15/d1d/f20 x:0 0 0 2023-10-21T17:04:49.872 INFO:tasks.workunit.client.0.smithi012.stdout:6/105: write d13/d15/f18 [310778,68290] 0 2023-10-21T17:04:50.510 INFO:tasks.workunit.client.0.smithi012.stdout:5/69: link d2/dd/d15/f16 d2/dd/f1c 0 2023-10-21T17:04:50.510 INFO:tasks.workunit.client.0.smithi012.stdout:5/70: dread - d2/dd/d15/f16 zero size 2023-10-21T17:04:50.878 INFO:tasks.workunit.client.0.smithi012.stdout:3/99: creat d0/d1c/f1e x:0 0 0 2023-10-21T17:04:50.926 INFO:tasks.workunit.client.0.smithi012.stdout:3/100: dread d0/f4 [0,4194304] 0 2023-10-21T17:04:50.926 INFO:tasks.workunit.client.0.smithi012.stdout:3/101: creat d0/da/f1f x:0 0 0 2023-10-21T17:04:50.927 INFO:tasks.workunit.client.0.smithi012.stdout:3/102: write d0/f7 [925266,106596] 0 2023-10-21T17:04:50.978 INFO:tasks.workunit.client.0.smithi012.stdout:9/82: dwrite d0/df/f11 [0,4194304] 0 2023-10-21T17:04:51.647 INFO:tasks.workunit.client.0.smithi012.stdout:5/71: unlink d2/dd/f1c 0 2023-10-21T17:04:51.648 INFO:tasks.workunit.client.0.smithi012.stdout:5/72: fdatasync d2/dd/fc 0 2023-10-21T17:04:51.648 INFO:tasks.workunit.client.0.smithi012.stdout:0/114: write f5 [931541,87449] 0 2023-10-21T17:04:51.648 INFO:tasks.workunit.client.0.smithi012.stdout:0/115: chown d7/c1c 53 1 2023-10-21T17:04:51.958 INFO:tasks.workunit.client.0.smithi012.stdout:3/103: symlink d0/d1c/l20 0 2023-10-21T17:04:51.959 INFO:tasks.workunit.client.0.smithi012.stdout:3/104: chown d0/f1b 9875 1 2023-10-21T17:04:52.040 INFO:tasks.workunit.client.0.smithi012.stdout:9/83: truncate d0/f2 1222805 0 2023-10-21T17:04:52.160 INFO:tasks.workunit.client.0.smithi012.stdout:8/85: rename d0/l3 to d0/d1a/l1c 0 2023-10-21T17:04:52.160 INFO:tasks.workunit.client.0.smithi012.stdout:8/86: write d0/fe [617485,20782] 0 2023-10-21T17:04:52.371 INFO:tasks.workunit.client.0.smithi012.stdout:4/122: mkdir dc/d28 0 2023-10-21T17:04:52.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/126: mkdir d5/d26 0 2023-10-21T17:04:52.961 INFO:tasks.workunit.client.0.smithi012.stdout:7/107: truncate d3/d6/dc/df/f11 460540 0 2023-10-21T17:04:52.961 INFO:tasks.workunit.client.0.smithi012.stdout:5/73: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:04:52.962 INFO:tasks.workunit.client.0.smithi012.stdout:5/74: fdatasync d2/f5 0 2023-10-21T17:04:52.962 INFO:tasks.workunit.client.0.smithi012.stdout:5/75: stat d2/dd/fc 0 2023-10-21T17:04:53.103 INFO:tasks.workunit.client.0.smithi012.stdout:0/116: truncate d7/d8/f11 799566 0 2023-10-21T17:04:53.190 INFO:tasks.workunit.client.0.smithi012.stdout:3/105: mknod d0/d1c/c21 0 2023-10-21T17:04:53.191 INFO:tasks.workunit.client.0.smithi012.stdout:3/106: write d0/f4 [933325,108517] 0 2023-10-21T17:04:53.191 INFO:tasks.workunit.client.0.smithi012.stdout:3/107: chown d0/fd 2046196516 1 2023-10-21T17:04:53.192 INFO:tasks.workunit.client.0.smithi012.stdout:3/108: write d0/da/f1f [64631,61761] 0 2023-10-21T17:04:53.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/106: rename fc to d13/d15/f21 0 2023-10-21T17:04:53.822 INFO:tasks.workunit.client.0.smithi012.stdout:4/123: truncate dc/f11 582110 0 2023-10-21T17:04:53.991 INFO:tasks.workunit.client.0.smithi012.stdout:7/108: getdents d3 0 2023-10-21T17:04:54.013 INFO:tasks.workunit.client.0.smithi012.stdout:7/109: write d3/d6/dc/fd [1474209,101409] 0 2023-10-21T17:04:54.095 INFO:tasks.workunit.client.0.smithi012.stdout:7/110: dwrite d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:04:54.293 INFO:tasks.workunit.client.0.smithi012.stdout:5/76: rename d2/d1a to d2/d1d 0 2023-10-21T17:04:54.294 INFO:tasks.workunit.client.0.smithi012.stdout:8/87: getdents d0 0 2023-10-21T17:04:54.368 INFO:tasks.workunit.client.0.smithi012.stdout:8/88: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:04:54.445 INFO:tasks.workunit.client.0.smithi012.stdout:0/117: mkdir d7/d8/d23/d27/d31 0 2023-10-21T17:04:54.449 INFO:tasks.workunit.client.0.smithi012.stdout:2/109: sync 2023-10-21T17:04:54.449 INFO:tasks.workunit.client.0.smithi012.stdout:2/110: creat d1/d8/f18 x:0 0 0 2023-10-21T17:04:54.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/111: dwrite d1/d8/f18 [0,4194304] 0 2023-10-21T17:04:54.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/112: fsync d1/fb 0 2023-10-21T17:04:54.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/113: fsync d1/d8/ff 0 2023-10-21T17:04:54.545 INFO:tasks.workunit.client.0.smithi012.stdout:3/109: mknod d0/d1c/c22 0 2023-10-21T17:04:54.596 INFO:tasks.workunit.client.0.smithi012.stdout:2/114: dwrite d1/d8/f18 [0,4194304] 0 2023-10-21T17:04:54.730 INFO:tasks.workunit.client.0.smithi012.stdout:9/84: getdents d0/d4 0 2023-10-21T17:04:55.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/107: creat d13/f22 x:0 0 0 2023-10-21T17:04:55.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/108: creat d13/d15/f23 x:0 0 0 2023-10-21T17:04:55.039 INFO:tasks.workunit.client.0.smithi012.stdout:6/109: write d13/f16 [541599,95188] 0 2023-10-21T17:04:55.292 INFO:tasks.workunit.client.0.smithi012.stdout:4/124: link dc/d1e/l26 dc/d28/l29 0 2023-10-21T17:04:55.891 INFO:tasks.workunit.client.0.smithi012.stdout:5/77: write d2/dd/d15/f16 [575005,92587] 0 2023-10-21T17:04:55.891 INFO:tasks.workunit.client.0.smithi012.stdout:5/78: fdatasync d2/f18 0 2023-10-21T17:04:55.918 INFO:tasks.workunit.client.0.smithi012.stdout:5/79: dread d2/f4 [0,4194304] 0 2023-10-21T17:04:55.959 INFO:tasks.workunit.client.0.smithi012.stdout:2/115: mkdir d1/d8/d19 0 2023-10-21T17:04:55.959 INFO:tasks.workunit.client.0.smithi012.stdout:2/116: readlink d1/d4/ld 0 2023-10-21T17:04:55.960 INFO:tasks.workunit.client.0.smithi012.stdout:2/117: truncate d1/d8/f18 4347192 0 2023-10-21T17:04:55.971 INFO:tasks.workunit.client.0.smithi012.stdout:3/110: dread d0/f15 [0,4194304] 0 2023-10-21T17:04:55.995 INFO:tasks.workunit.client.0.smithi012.stdout:3/111: dread d0/fd [0,4194304] 0 2023-10-21T17:04:55.997 INFO:tasks.workunit.client.0.smithi012.stdout:9/85: mknod d0/d5/c17 0 2023-10-21T17:04:56.015 INFO:tasks.workunit.client.0.smithi012.stdout:1/127: rename d5/d18 to d5/d15/d1b/d27 0 2023-10-21T17:04:56.029 INFO:tasks.workunit.client.0.smithi012.stdout:3/112: dread d0/da/f18 [0,4194304] 0 2023-10-21T17:04:56.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/86: dwrite d0/f3 [0,4194304] 0 2023-10-21T17:04:56.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/87: readlink d0/d4/ld 0 2023-10-21T17:04:56.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/88: chown d0/f2 1 1 2023-10-21T17:04:56.341 INFO:tasks.workunit.client.0.smithi012.stdout:6/110: dread f1 [0,4194304] 0 2023-10-21T17:04:56.495 INFO:tasks.workunit.client.0.smithi012.stdout:4/125: mkdir dc/d15/d2a 0 2023-10-21T17:04:56.590 INFO:tasks.workunit.client.0.smithi012.stdout:4/126: dwrite f8 [4194304,4194304] 0 2023-10-21T17:04:56.591 INFO:tasks.workunit.client.0.smithi012.stdout:4/127: dread - dc/f25 zero size 2023-10-21T17:04:56.591 INFO:tasks.workunit.client.0.smithi012.stdout:4/128: chown dc/d1e 1 1 2023-10-21T17:04:56.799 INFO:tasks.workunit.client.0.smithi012.stdout:2/118: creat d1/f1a x:0 0 0 2023-10-21T17:04:57.066 INFO:tasks.workunit.client.0.smithi012.stdout:8/89: rename d0/d12/f1b to d0/d1a/f1d 0 2023-10-21T17:04:57.135 INFO:tasks.workunit.client.0.smithi012.stdout:3/113: link d0/cc d0/da/c23 0 2023-10-21T17:04:57.160 INFO:tasks.workunit.client.0.smithi012.stdout:3/114: write d0/da/fe [4090090,18845] 0 2023-10-21T17:04:57.160 INFO:tasks.workunit.client.0.smithi012.stdout:3/115: fdatasync d0/f7 0 2023-10-21T17:04:57.272 INFO:tasks.workunit.client.0.smithi012.stdout:3/116: dwrite d0/da/fe [0,4194304] 0 2023-10-21T17:04:57.272 INFO:tasks.workunit.client.0.smithi012.stdout:3/117: chown d0/da/f1f 0 1 2023-10-21T17:04:57.272 INFO:tasks.workunit.client.0.smithi012.stdout:3/118: stat d0/f7 0 2023-10-21T17:04:57.352 INFO:tasks.workunit.client.0.smithi012.stdout:9/89: link d0/d4/cc d0/d4/c18 0 2023-10-21T17:04:57.352 INFO:tasks.workunit.client.0.smithi012.stdout:9/90: chown d0/d4/db 571 1 2023-10-21T17:04:57.900 INFO:tasks.workunit.client.0.smithi012.stdout:6/111: mkdir d13/d15/d1d/d24 0 2023-10-21T17:04:57.938 INFO:tasks.workunit.client.0.smithi012.stdout:6/112: dread d13/d15/f21 [0,4194304] 0 2023-10-21T17:04:58.245 INFO:tasks.workunit.client.0.smithi012.stdout:4/129: unlink dc/d1e/l26 0 2023-10-21T17:04:58.495 INFO:tasks.workunit.client.0.smithi012.stdout:2/119: unlink d1/fb 0 2023-10-21T17:04:58.560 INFO:tasks.workunit.client.0.smithi012.stdout:7/111: dwrite d3/d6/dc/df/f11 [0,4194304] 0 2023-10-21T17:04:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:0/118: rename f1 to d7/d8/d23/d27/d31/f32 0 2023-10-21T17:04:59.696 INFO:tasks.workunit.client.0.smithi012.stdout:0/119: write d7/d8/d23/d27/f2d [2349963,717] 0 2023-10-21T17:04:59.696 INFO:tasks.workunit.client.0.smithi012.stdout:0/120: readlink l4 0 2023-10-21T17:04:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:0/121: dread d7/d8/f22 [0,4194304] 0 2023-10-21T17:04:59.716 INFO:tasks.workunit.client.0.smithi012.stdout:0/122: fsync d7/d8/ff 0 2023-10-21T17:04:59.733 INFO:tasks.workunit.client.0.smithi012.stdout:0/123: dread f6 [0,4194304] 0 2023-10-21T17:04:59.766 INFO:tasks.workunit.client.0.smithi012.stdout:0/124: write d7/f10 [2697778,38972] 0 2023-10-21T17:04:59.992 INFO:tasks.workunit.client.0.smithi012.stdout:9/91: symlink d0/d4/db/l19 0 2023-10-21T17:05:00.003 INFO:tasks.workunit.client.0.smithi012.stdout:1/128: write d5/d15/f17 [292573,77607] 0 2023-10-21T17:05:00.259 INFO:tasks.workunit.client.0.smithi012.stdout:4/130: mkdir dc/d1e/d2b 0 2023-10-21T17:05:00.433 INFO:tasks.workunit.client.0.smithi012.stdout:2/120: mkdir d1/d14/d1b 0 2023-10-21T17:05:00.434 INFO:tasks.workunit.client.0.smithi012.stdout:2/121: creat d1/f1c x:0 0 0 2023-10-21T17:05:00.906 INFO:tasks.workunit.client.0.smithi012.stdout:7/112: mknod d3/d6/dc/c17 0 2023-10-21T17:05:00.950 INFO:tasks.workunit.client.0.smithi012.stdout:7/113: dread d3/d6/dc/df/f11 [0,4194304] 0 2023-10-21T17:05:01.290 INFO:tasks.workunit.client.0.smithi012.stdout:8/90: symlink d0/l1e 0 2023-10-21T17:05:01.290 INFO:tasks.workunit.client.0.smithi012.stdout:8/91: readlink d0/l7 0 2023-10-21T17:05:01.381 INFO:tasks.workunit.client.0.smithi012.stdout:8/92: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:05:01.394 INFO:tasks.workunit.client.0.smithi012.stdout:8/93: dread d0/d1a/f1d [0,4194304] 0 2023-10-21T17:05:01.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/92: creat d0/d15/f1a x:0 0 0 2023-10-21T17:05:02.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/94: link d0/f2 d0/d1a/f1f 0 2023-10-21T17:05:02.716 INFO:tasks.workunit.client.0.smithi012.stdout:8/95: dwrite d0/f19 [0,4194304] 0 2023-10-21T17:05:02.717 INFO:tasks.workunit.client.0.smithi012.stdout:5/80: mkdir d2/dd/d1e 0 2023-10-21T17:05:02.717 INFO:tasks.workunit.client.0.smithi012.stdout:5/81: fsync d2/dd/fc 0 2023-10-21T17:05:03.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:05:03.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:05:03.431 INFO:tasks.workunit.client.0.smithi012.stdout:6/113: write f7 [5140580,125728] 0 2023-10-21T17:05:03.444 INFO:tasks.workunit.client.0.smithi012.stdout:6/114: dread d13/d15/f21 [0,4194304] 0 2023-10-21T17:05:03.488 INFO:tasks.workunit.client.0.smithi012.stdout:4/131: creat dc/d28/f2c x:0 0 0 2023-10-21T17:05:03.489 INFO:tasks.workunit.client.0.smithi012.stdout:4/132: chown fb 2 1 2023-10-21T17:05:03.609 INFO:tasks.workunit.client.0.smithi012.stdout:2/122: getdents d1/d4 0 2023-10-21T17:05:03.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/123: dwrite d1/d8/ff [0,4194304] 0 2023-10-21T17:05:03.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/124: truncate d1/f1a 513855 0 2023-10-21T17:05:05.027 INFO:tasks.workunit.client.0.smithi012.stdout:1/129: write f1 [373996,45579] 0 2023-10-21T17:05:05.135 INFO:tasks.workunit.client.0.smithi012.stdout:6/115: mknod d13/d15/c25 0 2023-10-21T17:05:05.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/133: rename dc/d1e/c21 to dc/d1e/c2d 0 2023-10-21T17:05:05.388 INFO:tasks.workunit.client.0.smithi012.stdout:4/134: dwrite dc/d28/f2c [0,4194304] 0 2023-10-21T17:05:05.487 INFO:tasks.workunit.client.0.smithi012.stdout:4/135: dwrite dc/f25 [0,4194304] 0 2023-10-21T17:05:05.516 INFO:tasks.workunit.client.0.smithi012.stdout:4/136: dread dc/f25 [0,4194304] 0 2023-10-21T17:05:05.517 INFO:tasks.workunit.client.0.smithi012.stdout:4/137: chown l2 142424 1 2023-10-21T17:05:05.517 INFO:tasks.workunit.client.0.smithi012.stdout:4/138: chown dc/d15/d2a 3130425 1 2023-10-21T17:05:05.656 INFO:tasks.workunit.client.0.smithi012.stdout:3/119: rmdir d0/d1c 39 2023-10-21T17:05:05.656 INFO:tasks.workunit.client.0.smithi012.stdout:3/120: chown d0/da/fb 254642860 1 2023-10-21T17:05:05.657 INFO:tasks.workunit.client.0.smithi012.stdout:9/93: creat d0/f1b x:0 0 0 2023-10-21T17:05:05.743 INFO:tasks.workunit.client.0.smithi012.stdout:3/121: dwrite d0/f7 [0,4194304] 0 2023-10-21T17:05:05.743 INFO:tasks.workunit.client.0.smithi012.stdout:3/122: chown d0/fd 5 1 2023-10-21T17:05:06.233 INFO:tasks.workunit.client.0.smithi012.stdout:4/139: mknod dc/d15/d2a/c2e 0 2023-10-21T17:05:06.406 INFO:tasks.workunit.client.0.smithi012.stdout:9/94: mkdir d0/d4/db/d12/d1c 0 2023-10-21T17:05:06.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/95: creat d0/df/f1d x:0 0 0 2023-10-21T17:05:06.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/116: truncate fd 674954 0 2023-10-21T17:05:06.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/117: creat d13/d15/f26 x:0 0 0 2023-10-21T17:05:06.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/118: chown d13/d15/f21 339811049 1 2023-10-21T17:05:06.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/119: creat d13/d15/f27 x:0 0 0 2023-10-21T17:05:06.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/120: truncate d13/d15/f26 188236 0 2023-10-21T17:05:06.833 INFO:tasks.workunit.client.0.smithi012.stdout:9/96: dwrite d0/f14 [0,4194304] 0 2023-10-21T17:05:06.917 INFO:tasks.workunit.client.0.smithi012.stdout:9/97: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:05:07.192 INFO:tasks.workunit.client.0.smithi012.stdout:6/121: mkdir d13/d15/d1d/d28 0 2023-10-21T17:05:07.593 INFO:tasks.workunit.client.0.smithi012.stdout:9/98: symlink d0/d5/l1e 0 2023-10-21T17:05:07.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/99: dread - d0/df/f1d zero size 2023-10-21T17:05:07.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/100: chown d0/f14 4182 1 2023-10-21T17:05:07.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/101: write d0/d15/f1a [1034440,48922] 0 2023-10-21T17:05:08.052 INFO:tasks.workunit.client.0.smithi012.stdout:6/122: fdatasync fa 0 2023-10-21T17:05:08.066 INFO:tasks.workunit.client.0.smithi012.stdout:6/123: dread f1 [0,4194304] 0 2023-10-21T17:05:08.066 INFO:tasks.workunit.client.0.smithi012.stdout:6/124: fsync d13/f16 0 2023-10-21T17:05:08.183 INFO:tasks.workunit.client.0.smithi012.stdout:2/125: dwrite d1/d4/f7 [0,4194304] 0 2023-10-21T17:05:08.184 INFO:tasks.workunit.client.0.smithi012.stdout:2/126: fdatasync d1/d8/f18 0 2023-10-21T17:05:08.184 INFO:tasks.workunit.client.0.smithi012.stdout:2/127: chown d1 371 1 2023-10-21T17:05:08.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/125: mkdir d13/d29 0 2023-10-21T17:05:08.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/126: write d13/d15/f23 [327436,53260] 0 2023-10-21T17:05:08.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/127: fsync d13/d15/d1d/f20 0 2023-10-21T17:05:08.957 INFO:tasks.workunit.client.0.smithi012.stdout:6/128: creat d13/d29/f2a x:0 0 0 2023-10-21T17:05:08.958 INFO:tasks.workunit.client.0.smithi012.stdout:6/129: write d13/d15/f1c [173695,107140] 0 2023-10-21T17:05:08.958 INFO:tasks.workunit.client.0.smithi012.stdout:6/130: fsync d13/d15/d1d/f20 0 2023-10-21T17:05:08.958 INFO:tasks.workunit.client.0.smithi012.stdout:6/131: write d13/f22 [625727,76383] 0 2023-10-21T17:05:08.958 INFO:tasks.workunit.client.0.smithi012.stdout:6/132: chown d13/d15/f1c 77298870 1 2023-10-21T17:05:09.152 INFO:tasks.workunit.client.0.smithi012.stdout:9/102: truncate d0/f14 917720 0 2023-10-21T17:05:09.172 INFO:tasks.workunit.client.0.smithi012.stdout:9/103: dread d0/d15/f1a [0,4194304] 0 2023-10-21T17:05:09.616 INFO:tasks.workunit.client.0.smithi012.stdout:2/128: unlink d1/d8/f18 0 2023-10-21T17:05:09.787 INFO:tasks.workunit.client.0.smithi012.stdout:6/133: unlink d13/d29/f2a 0 2023-10-21T17:05:09.788 INFO:tasks.workunit.client.0.smithi012.stdout:0/125: mknod d7/c33 0 2023-10-21T17:05:09.788 INFO:tasks.workunit.client.0.smithi012.stdout:6/134: truncate d13/d15/d1d/f20 233606 0 2023-10-21T17:05:09.823 INFO:tasks.workunit.client.0.smithi012.stdout:6/135: dread d13/f14 [0,4194304] 0 2023-10-21T17:05:10.100 INFO:tasks.workunit.client.0.smithi012.stdout:8/96: symlink d0/l20 0 2023-10-21T17:05:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:2/129: symlink d1/d14/d17/l1d 0 2023-10-21T17:05:10.755 INFO:tasks.workunit.client.0.smithi012.stdout:2/130: dread d1/f1a [0,4194304] 0 2023-10-21T17:05:10.768 INFO:tasks.workunit.client.0.smithi012.stdout:6/136: link f10 d13/d15/f2b 0 2023-10-21T17:05:10.768 INFO:tasks.workunit.client.0.smithi012.stdout:6/137: fdatasync f7 0 2023-10-21T17:05:10.768 INFO:tasks.workunit.client.0.smithi012.stdout:7/114: rename d3/d6/dc/df to d3/d18 0 2023-10-21T17:05:10.769 INFO:tasks.workunit.client.0.smithi012.stdout:8/97: symlink d0/d1a/l21 0 2023-10-21T17:05:10.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/115: dread d3/d18/f11 [0,4194304] 0 2023-10-21T17:05:11.098 INFO:tasks.workunit.client.0.smithi012.stdout:2/131: link d1/d14/d17/l1d d1/d14/l1e 0 2023-10-21T17:05:11.285 INFO:tasks.workunit.client.0.smithi012.stdout:1/130: rename d5/d8/ca to d5/d15/d1b/d27/c28 0 2023-10-21T17:05:11.286 INFO:tasks.workunit.client.0.smithi012.stdout:3/123: rename d0 to d0/d24 22 2023-10-21T17:05:11.307 INFO:tasks.workunit.client.0.smithi012.stdout:8/98: creat d0/d12/f22 x:0 0 0 2023-10-21T17:05:11.308 INFO:tasks.workunit.client.0.smithi012.stdout:7/116: mkdir d3/d6/dc/d19 0 2023-10-21T17:05:11.334 INFO:tasks.workunit.client.0.smithi012.stdout:7/117: write d3/d18/f11 [1676906,88676] 0 2023-10-21T17:05:11.335 INFO:tasks.workunit.client.0.smithi012.stdout:7/118: readlink l2 0 2023-10-21T17:05:11.335 INFO:tasks.workunit.client.0.smithi012.stdout:7/119: readlink d3/d6/lb 0 2023-10-21T17:05:11.340 INFO:tasks.workunit.client.0.smithi012.stdout:7/120: fsync d3/d18/f11 0 2023-10-21T17:05:11.365 INFO:tasks.workunit.client.0.smithi012.stdout:1/131: dwrite d5/f10 [0,4194304] 0 2023-10-21T17:05:11.366 INFO:tasks.workunit.client.0.smithi012.stdout:1/132: truncate d5/d15/f17 1024475 0 2023-10-21T17:05:11.366 INFO:tasks.workunit.client.0.smithi012.stdout:1/133: fdatasync d5/d8/fd 0 2023-10-21T17:05:11.366 INFO:tasks.workunit.client.0.smithi012.stdout:1/134: chown d5/d8 1226133 1 2023-10-21T17:05:11.366 INFO:tasks.workunit.client.0.smithi012.stdout:1/135: write f1 [653017,128595] 0 2023-10-21T17:05:11.367 INFO:tasks.workunit.client.0.smithi012.stdout:1/136: chown d5/d15 276899192 1 2023-10-21T17:05:11.400 INFO:tasks.workunit.client.0.smithi012.stdout:5/82: sync 2023-10-21T17:05:11.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/132: creat d1/d14/d17/f1f x:0 0 0 2023-10-21T17:05:11.557 INFO:tasks.workunit.client.0.smithi012.stdout:6/138: unlink c4 0 2023-10-21T17:05:11.688 INFO:tasks.workunit.client.0.smithi012.stdout:4/140: rename dc/l12 to dc/d1e/l2f 0 2023-10-21T17:05:11.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/124: symlink d0/d1c/l25 0 2023-10-21T17:05:11.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/125: creat d0/da/f26 x:0 0 0 2023-10-21T17:05:11.753 INFO:tasks.workunit.client.0.smithi012.stdout:5/83: mknod d2/dd/d15/c1f 0 2023-10-21T17:05:12.239 INFO:tasks.workunit.client.0.smithi012.stdout:6/139: truncate d13/f14 1465352 0 2023-10-21T17:05:12.732 INFO:tasks.workunit.client.0.smithi012.stdout:8/99: write d0/f11 [5191739,37559] 0 2023-10-21T17:05:12.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/100: dread d0/d1a/f1f [0,4194304] 0 2023-10-21T17:05:12.761 INFO:tasks.workunit.client.0.smithi012.stdout:8/101: read d0/fb [1079649,109753] 0 2023-10-21T17:05:13.014 INFO:tasks.workunit.client.0.smithi012.stdout:7/121: dwrite d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:05:13.043 INFO:tasks.workunit.client.0.smithi012.stdout:7/122: dread d3/d6/dc/fd [4194304,4194304] 0 2023-10-21T17:05:13.043 INFO:tasks.workunit.client.0.smithi012.stdout:7/123: write d3/d18/f11 [3703963,39194] 0 2023-10-21T17:05:13.043 INFO:tasks.workunit.client.0.smithi012.stdout:7/124: chown d3/d6/dc/c17 2109742142 1 2023-10-21T17:05:13.043 INFO:tasks.workunit.client.0.smithi012.stdout:7/125: fdatasync d3/d6/dc/fd 0 2023-10-21T17:05:13.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/126: write d3/d6/dc/fd [10244241,16984] 0 2023-10-21T17:05:13.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/127: getdents d3/d16 0 2023-10-21T17:05:13.717 INFO:tasks.workunit.client.0.smithi012.stdout:5/84: mkdir d2/d1d/d20 0 2023-10-21T17:05:13.812 INFO:tasks.workunit.client.0.smithi012.stdout:5/85: dwrite d2/f4 [4194304,4194304] 0 2023-10-21T17:05:13.845 INFO:tasks.workunit.client.0.smithi012.stdout:5/86: dread d2/dd/fc [0,4194304] 0 2023-10-21T17:05:13.870 INFO:tasks.workunit.client.0.smithi012.stdout:5/87: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:05:13.871 INFO:tasks.workunit.client.0.smithi012.stdout:5/88: readlink d2/d6/l13 0 2023-10-21T17:05:13.895 INFO:tasks.workunit.client.0.smithi012.stdout:5/89: dread d2/dd/fc [0,4194304] 0 2023-10-21T17:05:13.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/102: creat d0/f23 x:0 0 0 2023-10-21T17:05:13.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/103: fsync d0/f16 0 2023-10-21T17:05:14.315 INFO:tasks.workunit.client.0.smithi012.stdout:7/128: creat d3/d16/f1a x:0 0 0 2023-10-21T17:05:14.512 INFO:tasks.workunit.client.0.smithi012.stdout:5/90: mknod d2/d1d/c21 0 2023-10-21T17:05:14.513 INFO:tasks.workunit.client.0.smithi012.stdout:5/91: fdatasync d2/dd/fc 0 2023-10-21T17:05:14.524 INFO:tasks.workunit.client.0.smithi012.stdout:6/140: truncate ff 1206834 0 2023-10-21T17:05:14.586 INFO:tasks.workunit.client.0.smithi012.stdout:4/141: dwrite dc/f11 [0,4194304] 0 2023-10-21T17:05:14.586 INFO:tasks.workunit.client.0.smithi012.stdout:4/142: chown dc/d1e 516094 1 2023-10-21T17:05:14.946 INFO:tasks.workunit.client.0.smithi012.stdout:8/104: creat d0/d1a/f24 x:0 0 0 2023-10-21T17:05:14.946 INFO:tasks.workunit.client.0.smithi012.stdout:5/92: mknod d2/dd/d15/c22 0 2023-10-21T17:05:15.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/105: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:05:15.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/106: chown d0/d12/l18 109 1 2023-10-21T17:05:15.140 INFO:tasks.workunit.client.0.smithi012.stdout:6/141: dread fd [0,4194304] 0 2023-10-21T17:05:15.243 INFO:tasks.workunit.client.0.smithi012.stdout:6/142: dwrite d13/d15/f27 [0,4194304] 0 2023-10-21T17:05:15.382 INFO:tasks.workunit.client.0.smithi012.stdout:4/143: mknod dc/c30 0 2023-10-21T17:05:15.490 INFO:tasks.workunit.client.0.smithi012.stdout:7/129: mknod d3/c1b 0 2023-10-21T17:05:16.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/144: readlink dc/d28/l29 0 2023-10-21T17:05:16.217 INFO:tasks.workunit.client.0.smithi012.stdout:7/130: mknod d3/d16/c1c 0 2023-10-21T17:05:16.217 INFO:tasks.workunit.client.0.smithi012.stdout:7/131: stat d3 0 2023-10-21T17:05:16.218 INFO:tasks.workunit.client.0.smithi012.stdout:7/132: truncate d3/d16/f1a 431190 0 2023-10-21T17:05:16.233 INFO:tasks.workunit.client.0.smithi012.stdout:9/104: rename d0/l6 to d0/df/l1f 0 2023-10-21T17:05:16.540 INFO:tasks.workunit.client.0.smithi012.stdout:8/107: symlink d0/l25 0 2023-10-21T17:05:16.541 INFO:tasks.workunit.client.0.smithi012.stdout:4/145: mkdir dc/d15/d2a/d31 0 2023-10-21T17:05:16.541 INFO:tasks.workunit.client.0.smithi012.stdout:8/108: readlink d0/d1a/l1c 0 2023-10-21T17:05:16.561 INFO:tasks.workunit.client.0.smithi012.stdout:0/126: rename d7/d8/d9/fe to d7/d8/d1f/d28/f34 0 2023-10-21T17:05:16.561 INFO:tasks.workunit.client.0.smithi012.stdout:0/127: fsync f2 0 2023-10-21T17:05:16.578 INFO:tasks.workunit.client.0.smithi012.stdout:0/128: dread f5 [0,4194304] 0 2023-10-21T17:05:16.578 INFO:tasks.workunit.client.0.smithi012.stdout:0/129: readlink d7/d8/d9/l21 0 2023-10-21T17:05:16.578 INFO:tasks.workunit.client.0.smithi012.stdout:0/130: write f6 [1211104,4728] 0 2023-10-21T17:05:16.915 INFO:tasks.workunit.client.0.smithi012.stdout:4/146: link dc/d28/f2c dc/d15/f32 0 2023-10-21T17:05:17.151 INFO:tasks.workunit.client.0.smithi012.stdout:8/109: creat d0/f26 x:0 0 0 2023-10-21T17:05:17.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/110: dwrite d0/fe [0,4194304] 0 2023-10-21T17:05:17.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/111: chown d0/d12/f22 9 1 2023-10-21T17:05:17.481 INFO:tasks.workunit.client.0.smithi012.stdout:5/93: sync 2023-10-21T17:05:17.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/133: sync 2023-10-21T17:05:17.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/134: dread - d1/d8/f13 zero size 2023-10-21T17:05:17.481 INFO:tasks.workunit.client.0.smithi012.stdout:5/94: creat d2/d6/f23 x:0 0 0 2023-10-21T17:05:17.633 INFO:tasks.workunit.client.0.smithi012.stdout:1/137: rename d5/d8 to d5/d26/d29 0 2023-10-21T17:05:17.727 INFO:tasks.workunit.client.0.smithi012.stdout:1/138: dwrite d5/f11 [0,4194304] 0 2023-10-21T17:05:17.916 INFO:tasks.workunit.client.0.smithi012.stdout:7/133: sync 2023-10-21T17:05:18.073 INFO:tasks.workunit.client.0.smithi012.stdout:4/147: mkdir dc/d1e/d33 0 2023-10-21T17:05:18.073 INFO:tasks.workunit.client.0.smithi012.stdout:4/148: chown dc/d1e/l1d 259129911 1 2023-10-21T17:05:18.074 INFO:tasks.workunit.client.0.smithi012.stdout:4/149: stat l2 0 2023-10-21T17:05:19.012 INFO:tasks.workunit.client.0.smithi012.stdout:2/135: mkdir d1/d14/d16/d20 0 2023-10-21T17:05:19.116 INFO:tasks.workunit.client.0.smithi012.stdout:2/136: dwrite d1/d8/ff [4194304,4194304] 0 2023-10-21T17:05:19.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/126: rename d0/da/c19 to d0/d1a/c27 0 2023-10-21T17:05:19.609 INFO:tasks.workunit.client.0.smithi012.stdout:1/139: symlink d5/d15/l2a 0 2023-10-21T17:05:19.625 INFO:tasks.workunit.client.0.smithi012.stdout:7/134: creat d3/f1d x:0 0 0 2023-10-21T17:05:19.625 INFO:tasks.workunit.client.0.smithi012.stdout:7/135: chown d3/d16/f1a 639 1 2023-10-21T17:05:19.627 INFO:tasks.workunit.client.0.smithi012.stdout:7/136: write d3/d16/f1a [166623,129037] 0 2023-10-21T17:05:19.726 INFO:tasks.workunit.client.0.smithi012.stdout:0/131: sync 2023-10-21T17:05:19.736 INFO:tasks.workunit.client.0.smithi012.stdout:0/132: dread f2 [0,4194304] 0 2023-10-21T17:05:19.737 INFO:tasks.workunit.client.0.smithi012.stdout:0/133: truncate d7/d8/ff 1372966 0 2023-10-21T17:05:19.756 INFO:tasks.workunit.client.0.smithi012.stdout:0/134: dread f5 [0,4194304] 0 2023-10-21T17:05:19.760 INFO:tasks.workunit.client.0.smithi012.stdout:0/135: write d7/d8/ff [1087495,81777] 0 2023-10-21T17:05:19.948 INFO:tasks.workunit.client.0.smithi012.stdout:2/137: mknod d1/d14/c21 0 2023-10-21T17:05:19.990 INFO:tasks.workunit.client.0.smithi012.stdout:2/138: read d1/d4/f5 [5039029,77928] 0 2023-10-21T17:05:19.991 INFO:tasks.workunit.client.0.smithi012.stdout:2/139: write d1/d8/f10 [632045,30536] 0 2023-10-21T17:05:20.446 INFO:tasks.workunit.client.0.smithi012.stdout:1/140: creat d5/d15/d1b/d27/d21/f2b x:0 0 0 2023-10-21T17:05:20.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/143: rename d13/d15/c25 to d13/d15/d1d/c2c 0 2023-10-21T17:05:20.447 INFO:tasks.workunit.client.0.smithi012.stdout:1/141: chown d5 0 1 2023-10-21T17:05:20.548 INFO:tasks.workunit.client.0.smithi012.stdout:1/142: dwrite d5/f10 [0,4194304] 0 2023-10-21T17:05:20.550 INFO:tasks.workunit.client.0.smithi012.stdout:1/143: write f4 [4186581,44413] 0 2023-10-21T17:05:20.557 INFO:tasks.workunit.client.0.smithi012.stdout:1/144: fsync f4 0 2023-10-21T17:05:20.557 INFO:tasks.workunit.client.0.smithi012.stdout:1/145: readlink d5/d15/l2a 0 2023-10-21T17:05:20.558 INFO:tasks.workunit.client.0.smithi012.stdout:1/146: chown d5/d15/d1b 30680 1 2023-10-21T17:05:20.558 INFO:tasks.workunit.client.0.smithi012.stdout:1/147: dread - d5/d15/d1b/d27/d21/f2b zero size 2023-10-21T17:05:20.568 INFO:tasks.workunit.client.0.smithi012.stdout:7/137: mkdir d3/d6/dc/d19/d1e 0 2023-10-21T17:05:20.661 INFO:tasks.workunit.client.0.smithi012.stdout:0/136: creat d7/f35 x:0 0 0 2023-10-21T17:05:20.661 INFO:tasks.workunit.client.0.smithi012.stdout:0/137: creat d7/f36 x:0 0 0 2023-10-21T17:05:20.662 INFO:tasks.workunit.client.0.smithi012.stdout:0/138: creat d7/d8/d9/f37 x:0 0 0 2023-10-21T17:05:20.730 INFO:tasks.workunit.client.0.smithi012.stdout:0/139: dwrite d7/d8/d9/f12 [0,4194304] 0 2023-10-21T17:05:20.880 INFO:tasks.workunit.client.0.smithi012.stdout:2/140: mkdir d1/d14/d16/d22 0 2023-10-21T17:05:20.881 INFO:tasks.workunit.client.0.smithi012.stdout:2/141: chown d1/d4/f7 42717577 1 2023-10-21T17:05:21.066 INFO:tasks.workunit.client.0.smithi012.stdout:9/105: rename d0/df/l16 to d0/d4/db/l20 0 2023-10-21T17:05:21.491 INFO:tasks.workunit.client.0.smithi012.stdout:5/95: rmdir d2/d6 39 2023-10-21T17:05:21.492 INFO:tasks.workunit.client.0.smithi012.stdout:1/148: mkdir d5/d15/d1b/d2c 0 2023-10-21T17:05:21.492 INFO:tasks.workunit.client.0.smithi012.stdout:7/138: unlink d3/d6/dc/fd 0 2023-10-21T17:05:21.493 INFO:tasks.workunit.client.0.smithi012.stdout:5/96: fdatasync d2/f4 0 2023-10-21T17:05:21.530 INFO:tasks.workunit.client.0.smithi012.stdout:7/139: dread d3/d18/f11 [0,4194304] 0 2023-10-21T17:05:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:6/144: rmdir d13/d15 39 2023-10-21T17:05:21.588 INFO:tasks.workunit.client.0.smithi012.stdout:1/149: dwrite d5/f10 [0,4194304] 0 2023-10-21T17:05:21.593 INFO:tasks.workunit.client.0.smithi012.stdout:6/145: dread fa [0,4194304] 0 2023-10-21T17:05:22.197 INFO:tasks.workunit.client.0.smithi012.stdout:4/150: sync 2023-10-21T17:05:22.226 INFO:tasks.workunit.client.0.smithi012.stdout:4/151: dread f1 [0,4194304] 0 2023-10-21T17:05:22.227 INFO:tasks.workunit.client.0.smithi012.stdout:4/152: chown dc/ce 27276062 1 2023-10-21T17:05:22.255 INFO:tasks.workunit.client.0.smithi012.stdout:4/153: dread dc/f11 [0,4194304] 0 2023-10-21T17:05:22.277 INFO:tasks.workunit.client.0.smithi012.stdout:0/140: mknod d7/d8/d1f/c38 0 2023-10-21T17:05:22.278 INFO:tasks.workunit.client.0.smithi012.stdout:0/141: truncate d7/d8/d1f/d28/f34 632588 0 2023-10-21T17:05:22.298 INFO:tasks.workunit.client.0.smithi012.stdout:0/142: dread f6 [0,4194304] 0 2023-10-21T17:05:22.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/142: symlink d1/d4/l23 0 2023-10-21T17:05:22.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/143: fdatasync d1/d4/f7 0 2023-10-21T17:05:22.352 INFO:tasks.workunit.client.0.smithi012.stdout:2/144: chown d1/d4 4119357 1 2023-10-21T17:05:22.352 INFO:tasks.workunit.client.0.smithi012.stdout:2/145: creat d1/d14/d17/f24 x:0 0 0 2023-10-21T17:05:22.352 INFO:tasks.workunit.client.0.smithi012.stdout:2/146: stat d1/f1c 0 2023-10-21T17:05:22.453 INFO:tasks.workunit.client.0.smithi012.stdout:2/147: dwrite d1/d14/d17/f1f [0,4194304] 0 2023-10-21T17:05:22.454 INFO:tasks.workunit.client.0.smithi012.stdout:2/148: chown d1/d4/f11 0 1 2023-10-21T17:05:22.492 INFO:tasks.workunit.client.0.smithi012.stdout:9/106: creat d0/d4/db/d12/f21 x:0 0 0 2023-10-21T17:05:22.492 INFO:tasks.workunit.client.0.smithi012.stdout:9/107: creat d0/d5/f22 x:0 0 0 2023-10-21T17:05:22.519 INFO:tasks.workunit.client.0.smithi012.stdout:9/108: dread d0/fe [0,4194304] 0 2023-10-21T17:05:22.519 INFO:tasks.workunit.client.0.smithi012.stdout:9/109: fsync d0/f2 0 2023-10-21T17:05:22.519 INFO:tasks.workunit.client.0.smithi012.stdout:9/110: stat d0/d15/f1a 0 2023-10-21T17:05:22.520 INFO:tasks.workunit.client.0.smithi012.stdout:9/111: creat d0/d15/f23 x:0 0 0 2023-10-21T17:05:22.520 INFO:tasks.workunit.client.0.smithi012.stdout:9/112: write d0/d4/db/d12/f21 [776057,87502] 0 2023-10-21T17:05:22.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/149: dwrite d1/d4/f7 [0,4194304] 0 2023-10-21T17:05:22.733 INFO:tasks.workunit.client.0.smithi012.stdout:7/140: unlink d3/d6/l12 0 2023-10-21T17:05:22.877 INFO:tasks.workunit.client.0.smithi012.stdout:1/150: link d5/c1e d5/c2d 0 2023-10-21T17:05:23.573 INFO:tasks.workunit.client.0.smithi012.stdout:0/143: mkdir d7/d8/d23/d27/d39 0 2023-10-21T17:05:23.605 INFO:tasks.workunit.client.0.smithi012.stdout:0/144: write d7/d8/d9/f12 [1855608,86383] 0 2023-10-21T17:05:23.867 INFO:tasks.workunit.client.0.smithi012.stdout:0/145: dwrite f6 [0,4194304] 0 2023-10-21T17:05:23.867 INFO:tasks.workunit.client.0.smithi012.stdout:0/146: chown d7/l13 917673245 1 2023-10-21T17:05:24.300 INFO:tasks.workunit.client.0.smithi012.stdout:9/113: link d0/d4/db/c10 d0/d5/c24 0 2023-10-21T17:05:24.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/112: rename d0/d1a/f1f to d0/f27 0 2023-10-21T17:05:24.654 INFO:tasks.workunit.client.0.smithi012.stdout:2/150: mkdir d1/d8/d25 0 2023-10-21T17:05:24.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/151: dread d1/d8/ff [4194304,4194304] 0 2023-10-21T17:05:24.679 INFO:tasks.workunit.client.0.smithi012.stdout:2/152: readlink d1/d4/l23 0 2023-10-21T17:05:24.755 INFO:tasks.workunit.client.0.smithi012.stdout:7/141: mknod d3/d6/c1f 0 2023-10-21T17:05:24.756 INFO:tasks.workunit.client.0.smithi012.stdout:7/142: dread - d3/f1d zero size 2023-10-21T17:05:24.961 INFO:tasks.workunit.client.0.smithi012.stdout:1/151: mknod d5/d15/d1b/c2e 0 2023-10-21T17:05:25.006 INFO:tasks.workunit.client.0.smithi012.stdout:1/152: dread d5/d26/d29/fb [4194304,4194304] 0 2023-10-21T17:05:25.288 INFO:tasks.workunit.client.0.smithi012.stdout:5/97: unlink d2/f5 0 2023-10-21T17:05:25.448 INFO:tasks.workunit.client.0.smithi012.stdout:0/147: symlink d7/d8/d1f/d28/l3a 0 2023-10-21T17:05:25.448 INFO:tasks.workunit.client.0.smithi012.stdout:0/148: truncate f2 1823335 0 2023-10-21T17:05:25.448 INFO:tasks.workunit.client.0.smithi012.stdout:0/149: chown f6 189775 1 2023-10-21T17:05:25.449 INFO:tasks.workunit.client.0.smithi012.stdout:0/150: read f2 [1060657,27930] 0 2023-10-21T17:05:26.031 INFO:tasks.workunit.client.0.smithi012.stdout:3/127: rename d0/d1a to d0/da/d28 0 2023-10-21T17:05:26.135 INFO:tasks.workunit.client.0.smithi012.stdout:6/146: dwrite d13/d15/f19 [0,4194304] 0 2023-10-21T17:05:26.270 INFO:tasks.workunit.client.0.smithi012.stdout:8/113: mknod d0/d1a/c28 0 2023-10-21T17:05:26.308 INFO:tasks.workunit.client.0.smithi012.stdout:4/154: write dc/f10 [1052917,108932] 0 2023-10-21T17:05:26.309 INFO:tasks.workunit.client.0.smithi012.stdout:4/155: dread - dc/f27 zero size 2023-10-21T17:05:26.340 INFO:tasks.workunit.client.0.smithi012.stdout:8/114: dwrite d0/f16 [0,4194304] 0 2023-10-21T17:05:26.734 INFO:tasks.workunit.client.0.smithi012.stdout:2/153: symlink d1/d14/l26 0 2023-10-21T17:05:26.958 INFO:tasks.workunit.client.0.smithi012.stdout:7/143: rmdir d3 39 2023-10-21T17:05:27.449 INFO:tasks.workunit.client.0.smithi012.stdout:5/98: rename d2/fa to d2/dd/d1e/f24 0 2023-10-21T17:05:27.449 INFO:tasks.workunit.client.0.smithi012.stdout:5/99: read d2/d6/f7 [4149749,125896] 0 2023-10-21T17:05:27.450 INFO:tasks.workunit.client.0.smithi012.stdout:5/100: truncate d2/dd/d1e/f24 930215 0 2023-10-21T17:05:27.536 INFO:tasks.workunit.client.0.smithi012.stdout:5/101: dwrite d2/f18 [0,4194304] 0 2023-10-21T17:05:27.536 INFO:tasks.workunit.client.0.smithi012.stdout:5/102: write d2/d6/f23 [1001705,58591] 0 2023-10-21T17:05:27.668 INFO:tasks.workunit.client.0.smithi012.stdout:6/147: symlink d13/d29/l2d 0 2023-10-21T17:05:27.845 INFO:tasks.workunit.client.0.smithi012.stdout:4/156: symlink dc/d15/d18/l34 0 2023-10-21T17:05:28.426 INFO:tasks.workunit.client.0.smithi012.stdout:2/154: creat d1/d14/d16/f27 x:0 0 0 2023-10-21T17:05:28.426 INFO:tasks.workunit.client.0.smithi012.stdout:2/155: creat d1/d8/f28 x:0 0 0 2023-10-21T17:05:28.466 INFO:tasks.workunit.client.0.smithi012.stdout:2/156: read d1/d4/f7 [3895370,17362] 0 2023-10-21T17:05:28.467 INFO:tasks.workunit.client.0.smithi012.stdout:2/157: stat d1/d8/ff 0 2023-10-21T17:05:28.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/144: stat l2 0 2023-10-21T17:05:28.616 INFO:tasks.workunit.client.0.smithi012.stdout:1/153: getdents d5/d15/d1b/d27/d21 0 2023-10-21T17:05:29.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/103: write d2/dd/fc [8572935,88743] 0 2023-10-21T17:05:29.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/104: dwrite d2/f4 [4194304,4194304] 0 2023-10-21T17:05:29.630 INFO:tasks.workunit.client.0.smithi012.stdout:6/148: mknod d13/d15/d1d/d24/c2e 0 2023-10-21T17:05:29.765 INFO:tasks.workunit.client.0.smithi012.stdout:4/157: unlink dc/f27 0 2023-10-21T17:05:29.765 INFO:tasks.workunit.client.0.smithi012.stdout:4/158: fsync f8 0 2023-10-21T17:05:29.965 INFO:tasks.workunit.client.0.smithi012.stdout:8/115: mkdir d0/d29 0 2023-10-21T17:05:30.262 INFO:tasks.workunit.client.0.smithi012.stdout:2/158: link d1/d8/l15 d1/d4/l29 0 2023-10-21T17:05:30.322 INFO:tasks.workunit.client.0.smithi012.stdout:7/145: write d3/f1d [15334,91919] 0 2023-10-21T17:05:30.355 INFO:tasks.workunit.client.0.smithi012.stdout:3/128: dwrite d0/f7 [0,4194304] 0 2023-10-21T17:05:30.368 INFO:tasks.workunit.client.0.smithi012.stdout:3/129: dread d0/f15 [0,4194304] 0 2023-10-21T17:05:30.603 INFO:tasks.workunit.client.0.smithi012.stdout:1/154: creat d5/d26/f2f x:0 0 0 2023-10-21T17:05:30.777 INFO:tasks.workunit.client.0.smithi012.stdout:0/151: link f2 d7/d8/f3b 0 2023-10-21T17:05:30.778 INFO:tasks.workunit.client.0.smithi012.stdout:0/152: write d7/d8/d23/d27/f2d [4668487,96898] 0 2023-10-21T17:05:30.862 INFO:tasks.workunit.client.0.smithi012.stdout:5/105: getdents d2/d6 0 2023-10-21T17:05:31.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/159: symlink dc/d1e/d33/l35 0 2023-10-21T17:05:31.142 INFO:tasks.workunit.client.0.smithi012.stdout:4/160: write dc/f10 [972784,27331] 0 2023-10-21T17:05:31.238 INFO:tasks.workunit.client.0.smithi012.stdout:9/114: rmdir d0/d15 39 2023-10-21T17:05:31.238 INFO:tasks.workunit.client.0.smithi012.stdout:9/115: truncate d0/f14 1200885 0 2023-10-21T17:05:31.404 INFO:tasks.workunit.client.0.smithi012.stdout:8/116: symlink d0/d12/l2a 0 2023-10-21T17:05:31.404 INFO:tasks.workunit.client.0.smithi012.stdout:8/117: dread - d0/f26 zero size 2023-10-21T17:05:32.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/155: getdents d5/d15/d1b/d27 0 2023-10-21T17:05:32.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/156: fdatasync d5/d26/d29/fe 0 2023-10-21T17:05:32.952 INFO:tasks.workunit.client.0.smithi012.stdout:0/153: creat d7/d8/d23/d27/d31/f3c x:0 0 0 2023-10-21T17:05:32.953 INFO:tasks.workunit.client.0.smithi012.stdout:0/154: chown d7/d8/d1f/d25/c2f 686006 1 2023-10-21T17:05:32.954 INFO:tasks.workunit.client.0.smithi012.stdout:1/157: dwrite f4 [4194304,4194304] 0 2023-10-21T17:05:33.107 INFO:tasks.workunit.client.0.smithi012.stdout:5/106: creat d2/d6/f25 x:0 0 0 2023-10-21T17:05:33.493 INFO:tasks.workunit.client.0.smithi012.stdout:4/161: rmdir dc/d1e/d33 39 2023-10-21T17:05:33.493 INFO:tasks.workunit.client.0.smithi012.stdout:9/116: mkdir d0/d4/db/d12/d25 0 2023-10-21T17:05:33.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/162: write dc/f11 [45310,29541] 0 2023-10-21T17:05:33.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:05:33.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:05:33.589 INFO:tasks.workunit.client.0.smithi012.stdout:9/117: dwrite d0/df/f1d [0,4194304] 0 2023-10-21T17:05:33.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/155: dread f6 [0,4194304] 0 2023-10-21T17:05:33.918 INFO:tasks.workunit.client.0.smithi012.stdout:5/107: unlink d2/dd/d15/c1f 0 2023-10-21T17:05:33.919 INFO:tasks.workunit.client.0.smithi012.stdout:1/158: mkdir d5/d30 0 2023-10-21T17:05:34.291 INFO:tasks.workunit.client.0.smithi012.stdout:6/149: rename d13/d15/f1c to d13/d15/d1d/d24/f2f 0 2023-10-21T17:05:34.292 INFO:tasks.workunit.client.0.smithi012.stdout:7/146: rename d3 to d3/d6/dc/d20 22 2023-10-21T17:05:34.292 INFO:tasks.workunit.client.0.smithi012.stdout:7/147: fsync d3/d18/f11 0 2023-10-21T17:05:34.292 INFO:tasks.workunit.client.0.smithi012.stdout:7/148: stat d3/d18/f11 0 2023-10-21T17:05:34.293 INFO:tasks.workunit.client.0.smithi012.stdout:6/150: creat d13/d15/d1d/f30 x:0 0 0 2023-10-21T17:05:34.333 INFO:tasks.workunit.client.0.smithi012.stdout:6/151: read d13/d15/f21 [728727,106076] 0 2023-10-21T17:05:34.654 INFO:tasks.workunit.client.0.smithi012.stdout:9/118: dread d0/f14 [0,4194304] 0 2023-10-21T17:05:34.784 INFO:tasks.workunit.client.0.smithi012.stdout:8/118: unlink d0/c9 0 2023-10-21T17:05:34.877 INFO:tasks.workunit.client.0.smithi012.stdout:8/119: dwrite d0/f17 [0,4194304] 0 2023-10-21T17:05:34.878 INFO:tasks.workunit.client.0.smithi012.stdout:8/120: creat d0/d12/f2b x:0 0 0 2023-10-21T17:05:34.878 INFO:tasks.workunit.client.0.smithi012.stdout:8/121: chown d0/c13 59 1 2023-10-21T17:05:34.879 INFO:tasks.workunit.client.0.smithi012.stdout:8/122: dread - d0/f23 zero size 2023-10-21T17:05:35.107 INFO:tasks.workunit.client.0.smithi012.stdout:5/108: creat d2/dd/d1e/f26 x:0 0 0 2023-10-21T17:05:35.108 INFO:tasks.workunit.client.0.smithi012.stdout:5/109: fsync d2/f4 0 2023-10-21T17:05:35.108 INFO:tasks.workunit.client.0.smithi012.stdout:5/110: chown d2/dd/d1e/f26 42432145 1 2023-10-21T17:05:35.108 INFO:tasks.workunit.client.0.smithi012.stdout:5/111: dread - d2/d6/f25 zero size 2023-10-21T17:05:35.113 INFO:tasks.workunit.client.0.smithi012.stdout:5/112: read d2/dd/d15/f16 [220537,102102] 0 2023-10-21T17:05:35.232 INFO:tasks.workunit.client.0.smithi012.stdout:1/159: creat d5/d15/d1b/d27/d21/f31 x:0 0 0 2023-10-21T17:05:35.524 INFO:tasks.workunit.client.0.smithi012.stdout:0/156: rename d7/d8/d1f/d25 to d7/d8/d23/d27/d31/d3d 0 2023-10-21T17:05:35.571 INFO:tasks.workunit.client.0.smithi012.stdout:7/149: symlink d3/d6/dc/d19/l21 0 2023-10-21T17:05:35.626 INFO:tasks.workunit.client.0.smithi012.stdout:7/150: dwrite d3/f1d [0,4194304] 0 2023-10-21T17:05:36.151 INFO:tasks.workunit.client.0.smithi012.stdout:3/130: dwrite d0/f14 [0,4194304] 0 2023-10-21T17:05:36.151 INFO:tasks.workunit.client.0.smithi012.stdout:3/131: truncate d0/da/f26 859760 0 2023-10-21T17:05:36.151 INFO:tasks.workunit.client.0.smithi012.stdout:3/132: readlink d0/d1c/l20 0 2023-10-21T17:05:36.159 INFO:tasks.workunit.client.0.smithi012.stdout:8/123: mknod d0/d1a/c2c 0 2023-10-21T17:05:36.267 INFO:tasks.workunit.client.0.smithi012.stdout:5/113: creat d2/f27 x:0 0 0 2023-10-21T17:05:36.268 INFO:tasks.workunit.client.0.smithi012.stdout:5/114: chown d2/dd/l9 6200 1 2023-10-21T17:05:36.344 INFO:tasks.workunit.client.0.smithi012.stdout:5/115: dwrite d2/f18 [0,4194304] 0 2023-10-21T17:05:36.344 INFO:tasks.workunit.client.0.smithi012.stdout:5/116: write d2/d6/f7 [4038639,23294] 0 2023-10-21T17:05:36.344 INFO:tasks.workunit.client.0.smithi012.stdout:5/117: creat d2/dd/d1e/f28 x:0 0 0 2023-10-21T17:05:36.363 INFO:tasks.workunit.client.0.smithi012.stdout:1/160: unlink d5/d26/d29/fb 0 2023-10-21T17:05:36.512 INFO:tasks.workunit.client.0.smithi012.stdout:9/119: rename d0/d4/ld to d0/d4/db/d12/d25/l26 0 2023-10-21T17:05:36.602 INFO:tasks.workunit.client.0.smithi012.stdout:0/157: getdents d7/d8/d23/d27 0 2023-10-21T17:05:36.859 INFO:tasks.workunit.client.0.smithi012.stdout:7/151: creat d3/d6/dc/d19/f22 x:0 0 0 2023-10-21T17:05:37.321 INFO:tasks.workunit.client.0.smithi012.stdout:8/124: symlink d0/d29/l2d 0 2023-10-21T17:05:37.321 INFO:tasks.workunit.client.0.smithi012.stdout:8/125: fdatasync d0/f27 0 2023-10-21T17:05:37.390 INFO:tasks.workunit.client.0.smithi012.stdout:8/126: dwrite d0/fb [4194304,4194304] 0 2023-10-21T17:05:37.705 INFO:tasks.workunit.client.0.smithi012.stdout:2/159: sync 2023-10-21T17:05:37.705 INFO:tasks.workunit.client.0.smithi012.stdout:4/163: sync 2023-10-21T17:05:37.742 INFO:tasks.workunit.client.0.smithi012.stdout:2/160: dwrite d1/d14/d16/f27 [0,4194304] 0 2023-10-21T17:05:37.742 INFO:tasks.workunit.client.0.smithi012.stdout:2/161: write d1/d8/f10 [1113120,15495] 0 2023-10-21T17:05:38.146 INFO:tasks.workunit.client.0.smithi012.stdout:5/118: mkdir d2/d1d/d29 0 2023-10-21T17:05:38.146 INFO:tasks.workunit.client.0.smithi012.stdout:5/119: chown d2/d1d/d29 246113165 1 2023-10-21T17:05:38.169 INFO:tasks.workunit.client.0.smithi012.stdout:5/120: dread d2/f4 [0,4194304] 0 2023-10-21T17:05:38.663 INFO:tasks.workunit.client.0.smithi012.stdout:6/152: write fd [1413102,7934] 0 2023-10-21T17:05:38.664 INFO:tasks.workunit.client.0.smithi012.stdout:6/153: write d13/d15/f1f [967572,8697] 0 2023-10-21T17:05:38.693 INFO:tasks.workunit.client.0.smithi012.stdout:0/158: dread d7/d8/d1f/d28/f34 [0,4194304] 0 2023-10-21T17:05:38.795 INFO:tasks.workunit.client.0.smithi012.stdout:0/159: dwrite d7/d8/d23/d27/f2d [0,4194304] 0 2023-10-21T17:05:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/160: dread - d7/f36 zero size 2023-10-21T17:05:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/161: dread - d7/d8/d23/d27/d31/f3c zero size 2023-10-21T17:05:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/162: creat d7/d8/d23/d27/d31/f3e x:0 0 0 2023-10-21T17:05:38.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/133: rename d0/f6 to d0/da/d28/f29 0 2023-10-21T17:05:38.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/134: chown d0/c13 28 1 2023-10-21T17:05:38.797 INFO:tasks.workunit.client.0.smithi012.stdout:0/163: read d7/d8/f3b [237805,50243] 0 2023-10-21T17:05:38.798 INFO:tasks.workunit.client.0.smithi012.stdout:0/164: fsync d7/d8/d23/d27/d31/f32 0 2023-10-21T17:05:38.898 INFO:tasks.workunit.client.0.smithi012.stdout:3/135: dwrite d0/da/fb [0,4194304] 0 2023-10-21T17:05:38.990 INFO:tasks.workunit.client.0.smithi012.stdout:7/152: mknod d3/d6/dc/d19/d1e/c23 0 2023-10-21T17:05:39.197 INFO:tasks.workunit.client.0.smithi012.stdout:8/127: symlink d0/d29/l2e 0 2023-10-21T17:05:39.706 INFO:tasks.workunit.client.0.smithi012.stdout:2/162: creat d1/f2a x:0 0 0 2023-10-21T17:05:40.107 INFO:tasks.workunit.client.0.smithi012.stdout:1/161: rename d5/d15 to d5/d32 0 2023-10-21T17:05:40.107 INFO:tasks.workunit.client.0.smithi012.stdout:1/162: dread - d5/d26/f2f zero size 2023-10-21T17:05:40.443 INFO:tasks.workunit.client.0.smithi012.stdout:6/154: mknod d13/d15/d1d/d28/c31 0 2023-10-21T17:05:40.467 INFO:tasks.workunit.client.0.smithi012.stdout:6/155: dread d13/d15/f1f [0,4194304] 0 2023-10-21T17:05:40.569 INFO:tasks.workunit.client.0.smithi012.stdout:6/156: dwrite d13/d15/f18 [0,4194304] 0 2023-10-21T17:05:40.742 INFO:tasks.workunit.client.0.smithi012.stdout:0/165: unlink d7/d8/f11 0 2023-10-21T17:05:41.251 INFO:tasks.workunit.client.0.smithi012.stdout:7/153: rename d3/d6/dc/d19/d1e/c23 to d3/d6/dc/c24 0 2023-10-21T17:05:41.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/154: chown d3/d16/f1a 2 1 2023-10-21T17:05:41.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/155: write d3/d6/dc/d19/f22 [188567,3554] 0 2023-10-21T17:05:41.616 INFO:tasks.workunit.client.0.smithi012.stdout:2/163: creat d1/d4/f2b x:0 0 0 2023-10-21T17:05:41.619 INFO:tasks.workunit.client.0.smithi012.stdout:2/164: read d1/f1a [273440,93280] 0 2023-10-21T17:05:41.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/163: write f4 [8688930,21889] 0 2023-10-21T17:05:41.830 INFO:tasks.workunit.client.0.smithi012.stdout:6/157: creat d13/d15/d1d/d28/f32 x:0 0 0 2023-10-21T17:05:41.842 INFO:tasks.workunit.client.0.smithi012.stdout:6/158: write fa [732739,68599] 0 2023-10-21T17:05:42.263 INFO:tasks.workunit.client.0.smithi012.stdout:7/156: unlink d3/d6/dc/c17 0 2023-10-21T17:05:42.263 INFO:tasks.workunit.client.0.smithi012.stdout:8/128: mknod d0/c2f 0 2023-10-21T17:05:42.264 INFO:tasks.workunit.client.0.smithi012.stdout:8/129: chown d0/d12/l2a 198939408 1 2023-10-21T17:05:42.296 INFO:tasks.workunit.client.0.smithi012.stdout:8/130: write d0/f16 [1321753,62644] 0 2023-10-21T17:05:42.327 INFO:tasks.workunit.client.0.smithi012.stdout:8/131: dread d0/fe [0,4194304] 0 2023-10-21T17:05:42.327 INFO:tasks.workunit.client.0.smithi012.stdout:8/132: truncate d0/f4 245954 0 2023-10-21T17:05:42.339 INFO:tasks.workunit.client.0.smithi012.stdout:4/164: sync 2023-10-21T17:05:42.340 INFO:tasks.workunit.client.0.smithi012.stdout:9/120: sync 2023-10-21T17:05:42.409 INFO:tasks.workunit.client.0.smithi012.stdout:9/121: dwrite d0/d5/f22 [0,4194304] 0 2023-10-21T17:05:42.448 INFO:tasks.workunit.client.0.smithi012.stdout:9/122: write d0/d5/f22 [1804416,5525] 0 2023-10-21T17:05:42.549 INFO:tasks.workunit.client.0.smithi012.stdout:2/165: symlink d1/l2c 0 2023-10-21T17:05:42.549 INFO:tasks.workunit.client.0.smithi012.stdout:2/166: creat d1/d8/f2d x:0 0 0 2023-10-21T17:05:42.550 INFO:tasks.workunit.client.0.smithi012.stdout:2/167: chown d1/d14/d16/f27 2188388 1 2023-10-21T17:05:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:7/157: creat d3/d6/f25 x:0 0 0 2023-10-21T17:05:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/133: mknod d0/d1a/c30 0 2023-10-21T17:05:42.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/165: truncate fb 1870048 0 2023-10-21T17:05:42.846 INFO:tasks.workunit.client.0.smithi012.stdout:4/166: dread dc/f11 [0,4194304] 0 2023-10-21T17:05:42.869 INFO:tasks.workunit.client.0.smithi012.stdout:1/164: dread d5/f10 [0,4194304] 0 2023-10-21T17:05:42.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/166: rename d7/l1a to d7/d8/d23/d27/d31/d3d/l3f 0 2023-10-21T17:05:42.944 INFO:tasks.workunit.client.0.smithi012.stdout:0/167: chown d7/d8/d1f/d28/l3a 46963 1 2023-10-21T17:05:43.362 INFO:tasks.workunit.client.0.smithi012.stdout:3/136: dwrite d0/da/fe [0,4194304] 0 2023-10-21T17:05:43.362 INFO:tasks.workunit.client.0.smithi012.stdout:3/137: chown d0/f14 37007 1 2023-10-21T17:05:43.442 INFO:tasks.workunit.client.0.smithi012.stdout:3/138: dwrite d0/d1c/f1e [0,4194304] 0 2023-10-21T17:05:43.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/139: dwrite d0/f7 [0,4194304] 0 2023-10-21T17:05:43.779 INFO:tasks.workunit.client.0.smithi012.stdout:9/123: link d0/d4/c18 d0/d5/c27 0 2023-10-21T17:05:43.915 INFO:tasks.workunit.client.0.smithi012.stdout:2/168: link d1/d14/d17/f1f d1/d14/d16/d20/f2e 0 2023-10-21T17:05:44.107 INFO:tasks.workunit.client.0.smithi012.stdout:8/134: unlink d0/d12/l2a 0 2023-10-21T17:05:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:7/158: creat d3/d18/f26 x:0 0 0 2023-10-21T17:05:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/159: chown d3/d18/f11 13128879 1 2023-10-21T17:05:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/160: write d3/d16/f1a [1164047,101213] 0 2023-10-21T17:05:45.259 INFO:tasks.workunit.client.0.smithi012.stdout:5/121: unlink d2/l3 0 2023-10-21T17:05:45.259 INFO:tasks.workunit.client.0.smithi012.stdout:5/122: truncate d2/d6/f23 1726067 0 2023-10-21T17:05:45.259 INFO:tasks.workunit.client.0.smithi012.stdout:5/123: truncate d2/d6/f23 2515457 0 2023-10-21T17:05:45.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/124: dwrite d2/d6/f23 [0,4194304] 0 2023-10-21T17:05:45.350 INFO:tasks.workunit.client.0.smithi012.stdout:0/168: mkdir d7/d8/d23/d27/d40 0 2023-10-21T17:05:45.544 INFO:tasks.workunit.client.0.smithi012.stdout:1/165: rmdir d5/d32 39 2023-10-21T17:05:46.439 INFO:tasks.workunit.client.0.smithi012.stdout:9/124: rmdir d0/d4/db/d12/d1c 0 2023-10-21T17:05:46.500 INFO:tasks.workunit.client.0.smithi012.stdout:9/125: dwrite d0/d15/f1a [0,4194304] 0 2023-10-21T17:05:46.701 INFO:tasks.workunit.client.0.smithi012.stdout:2/169: symlink d1/d14/d16/d22/l2f 0 2023-10-21T17:05:46.772 INFO:tasks.workunit.client.0.smithi012.stdout:2/170: dwrite d1/d8/ff [4194304,4194304] 0 2023-10-21T17:05:46.983 INFO:tasks.workunit.client.0.smithi012.stdout:6/159: truncate d13/d15/f1f 747466 0 2023-10-21T17:05:46.984 INFO:tasks.workunit.client.0.smithi012.stdout:7/161: truncate d3/d18/f11 3020314 0 2023-10-21T17:05:46.985 INFO:tasks.workunit.client.0.smithi012.stdout:7/162: chown d3/d18/f26 10 1 2023-10-21T17:05:46.985 INFO:tasks.workunit.client.0.smithi012.stdout:7/163: creat d3/d18/f27 x:0 0 0 2023-10-21T17:05:46.985 INFO:tasks.workunit.client.0.smithi012.stdout:7/164: fsync d3/f1d 0 2023-10-21T17:05:46.985 INFO:tasks.workunit.client.0.smithi012.stdout:7/165: fsync d3/d6/dc/d19/f22 0 2023-10-21T17:05:46.986 INFO:tasks.workunit.client.0.smithi012.stdout:7/166: dread - d3/d18/f26 zero size 2023-10-21T17:05:47.365 INFO:tasks.workunit.client.0.smithi012.stdout:5/125: symlink d2/d1d/d29/l2a 0 2023-10-21T17:05:47.480 INFO:tasks.workunit.client.0.smithi012.stdout:0/169: symlink d7/d8/d23/d30/l41 0 2023-10-21T17:05:47.645 INFO:tasks.workunit.client.0.smithi012.stdout:1/166: mknod d5/d32/d1b/d27/c33 0 2023-10-21T17:05:47.646 INFO:tasks.workunit.client.0.smithi012.stdout:1/167: write d5/d32/d1b/d27/d21/f31 [465479,25944] 0 2023-10-21T17:05:47.972 INFO:tasks.workunit.client.0.smithi012.stdout:9/126: symlink d0/d5/l28 0 2023-10-21T17:05:47.972 INFO:tasks.workunit.client.0.smithi012.stdout:9/127: fsync d0/f8 0 2023-10-21T17:05:47.972 INFO:tasks.workunit.client.0.smithi012.stdout:9/128: stat d0/d15/f23 0 2023-10-21T17:05:48.503 INFO:tasks.workunit.client.0.smithi012.stdout:6/160: truncate d13/d15/f2b 3099438 0 2023-10-21T17:05:49.240 INFO:tasks.workunit.client.0.smithi012.stdout:7/167: mkdir d3/d6/dc/d19/d28 0 2023-10-21T17:05:49.240 INFO:tasks.workunit.client.0.smithi012.stdout:5/126: truncate d2/f18 1347609 0 2023-10-21T17:05:49.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/129: symlink d0/l29 0 2023-10-21T17:05:49.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/130: fdatasync d0/fe 0 2023-10-21T17:05:49.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/131: chown d0/d4/db/d12 158 1 2023-10-21T17:05:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:3/140: unlink d0/c9 0 2023-10-21T17:05:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:6/161: chown l9 1 1 2023-10-21T17:05:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:3/141: fsync d0/f5 0 2023-10-21T17:05:50.114 INFO:tasks.workunit.client.0.smithi012.stdout:3/142: dwrite d0/da/fb [0,4194304] 0 2023-10-21T17:05:50.181 INFO:tasks.workunit.client.0.smithi012.stdout:3/143: dwrite d0/da/f1f [0,4194304] 0 2023-10-21T17:05:50.210 INFO:tasks.workunit.client.0.smithi012.stdout:3/144: dread d0/f7 [0,4194304] 0 2023-10-21T17:05:50.210 INFO:tasks.workunit.client.0.smithi012.stdout:3/145: fdatasync d0/da/f18 0 2023-10-21T17:05:50.290 INFO:tasks.workunit.client.0.smithi012.stdout:3/146: dwrite d0/da/d28/f29 [0,4194304] 0 2023-10-21T17:05:50.291 INFO:tasks.workunit.client.0.smithi012.stdout:3/147: write d0/da/fb [4237590,98538] 0 2023-10-21T17:05:50.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/127: rename d2/dd/d15/f16 to d2/d1d/d20/f2b 0 2023-10-21T17:05:50.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/128: write d2/f27 [692179,27449] 0 2023-10-21T17:05:50.350 INFO:tasks.workunit.client.0.smithi012.stdout:3/148: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:05:50.426 INFO:tasks.workunit.client.0.smithi012.stdout:9/132: mkdir d0/d4/db/d12/d2a 0 2023-10-21T17:05:50.426 INFO:tasks.workunit.client.0.smithi012.stdout:9/133: fdatasync d0/f1b 0 2023-10-21T17:05:50.427 INFO:tasks.workunit.client.0.smithi012.stdout:9/134: truncate d0/f2 1683172 0 2023-10-21T17:05:50.492 INFO:tasks.workunit.client.0.smithi012.stdout:8/135: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:05:50.492 INFO:tasks.workunit.client.0.smithi012.stdout:8/136: stat d0/d1a 0 2023-10-21T17:05:50.492 INFO:tasks.workunit.client.0.smithi012.stdout:8/137: creat d0/d12/f31 x:0 0 0 2023-10-21T17:05:50.687 INFO:tasks.workunit.client.0.smithi012.stdout:4/167: sync 2023-10-21T17:05:51.126 INFO:tasks.workunit.client.0.smithi012.stdout:5/129: mkdir d2/d2c 0 2023-10-21T17:05:51.454 INFO:tasks.workunit.client.0.smithi012.stdout:9/135: mknod d0/d4/c2b 0 2023-10-21T17:05:51.845 INFO:tasks.workunit.client.0.smithi012.stdout:4/168: mkdir dc/d15/d2a/d31/d36 0 2023-10-21T17:05:51.846 INFO:tasks.workunit.client.0.smithi012.stdout:4/169: stat dc/f10 0 2023-10-21T17:05:51.867 INFO:tasks.workunit.client.0.smithi012.stdout:4/170: dread dc/f10 [0,4194304] 0 2023-10-21T17:05:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:5/130: symlink d2/d1d/d20/l2d 0 2023-10-21T17:05:52.106 INFO:tasks.workunit.client.0.smithi012.stdout:6/162: write f10 [2217427,45297] 0 2023-10-21T17:05:52.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/136: mknod d0/d4/db/c2c 0 2023-10-21T17:05:52.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/137: getdents d0/d4/db/d12/d2a 0 2023-10-21T17:05:52.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/138: write d0/f2 [2297267,5863] 0 2023-10-21T17:05:52.251 INFO:tasks.workunit.client.0.smithi012.stdout:9/139: dwrite d0/d15/f1a [0,4194304] 0 2023-10-21T17:05:52.398 INFO:tasks.workunit.client.0.smithi012.stdout:4/171: symlink dc/d15/l37 0 2023-10-21T17:05:52.513 INFO:tasks.workunit.client.0.smithi012.stdout:2/171: creat d1/f30 x:0 0 0 2023-10-21T17:05:52.514 INFO:tasks.workunit.client.0.smithi012.stdout:2/172: write d1/f1c [269805,82895] 0 2023-10-21T17:05:52.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/140: symlink d0/d4/db/l2d 0 2023-10-21T17:05:53.451 INFO:tasks.workunit.client.0.smithi012.stdout:8/138: creat d0/f32 x:0 0 0 2023-10-21T17:05:53.452 INFO:tasks.workunit.client.0.smithi012.stdout:8/139: creat d0/d1a/f33 x:0 0 0 2023-10-21T17:05:53.617 INFO:tasks.workunit.client.0.smithi012.stdout:9/141: truncate d0/df/f1d 2006964 0 2023-10-21T17:05:53.728 INFO:tasks.workunit.client.0.smithi012.stdout:9/142: dwrite d0/f14 [0,4194304] 0 2023-10-21T17:05:53.728 INFO:tasks.workunit.client.0.smithi012.stdout:9/143: dread - d0/d15/f23 zero size 2023-10-21T17:05:54.262 INFO:tasks.workunit.client.0.smithi012.stdout:2/173: mknod d1/d14/c31 0 2023-10-21T17:05:54.262 INFO:tasks.workunit.client.0.smithi012.stdout:2/174: fdatasync d1/d4/f7 0 2023-10-21T17:05:54.263 INFO:tasks.workunit.client.0.smithi012.stdout:2/175: write d1/fe [1666876,126238] 0 2023-10-21T17:05:54.355 INFO:tasks.workunit.client.0.smithi012.stdout:2/176: dwrite d1/d14/d16/d20/f2e [0,4194304] 0 2023-10-21T17:05:54.355 INFO:tasks.workunit.client.0.smithi012.stdout:2/177: truncate d1/f1c 510602 0 2023-10-21T17:05:54.359 INFO:tasks.workunit.client.0.smithi012.stdout:5/131: getdents d2/dd/d15 0 2023-10-21T17:05:54.386 INFO:tasks.workunit.client.0.smithi012.stdout:2/178: dread d1/d14/d17/f1f [0,4194304] 0 2023-10-21T17:05:54.786 INFO:tasks.workunit.client.0.smithi012.stdout:8/140: mknod d0/c34 0 2023-10-21T17:05:55.080 INFO:tasks.workunit.client.0.smithi012.stdout:2/179: mknod d1/d8/d19/c32 0 2023-10-21T17:05:55.171 INFO:tasks.workunit.client.0.smithi012.stdout:8/141: creat d0/f35 x:0 0 0 2023-10-21T17:05:55.171 INFO:tasks.workunit.client.0.smithi012.stdout:8/142: fsync d0/d1a/f1d 0 2023-10-21T17:05:55.487 INFO:tasks.workunit.client.0.smithi012.stdout:2/180: link d1/d14/c21 d1/d14/d1b/c33 0 2023-10-21T17:05:55.487 INFO:tasks.workunit.client.0.smithi012.stdout:2/181: chown d1/f1a 0 1 2023-10-21T17:05:56.077 INFO:tasks.workunit.client.0.smithi012.stdout:3/149: truncate d0/f4 3980326 0 2023-10-21T17:05:56.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/182: mkdir d1/d8/d19/d34 0 2023-10-21T17:05:56.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/143: getdents d0/d12 0 2023-10-21T17:05:56.459 INFO:tasks.workunit.client.0.smithi012.stdout:8/144: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:05:56.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/145: stat d0/f23 0 2023-10-21T17:05:56.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/146: stat d0/l20 0 2023-10-21T17:05:56.575 INFO:tasks.workunit.client.0.smithi012.stdout:3/150: mknod d0/da/d28/c2a 0 2023-10-21T17:05:56.760 INFO:tasks.workunit.client.0.smithi012.stdout:0/170: symlink d7/l42 0 2023-10-21T17:05:56.966 INFO:tasks.workunit.client.0.smithi012.stdout:2/183: mkdir d1/d8/d35 0 2023-10-21T17:05:57.046 INFO:tasks.workunit.client.0.smithi012.stdout:8/147: rmdir d0/d12 39 2023-10-21T17:05:57.047 INFO:tasks.workunit.client.0.smithi012.stdout:8/148: fdatasync d0/f2 0 2023-10-21T17:05:57.108 INFO:tasks.workunit.client.0.smithi012.stdout:4/172: write fb [2586298,109407] 0 2023-10-21T17:05:57.416 INFO:tasks.workunit.client.0.smithi012.stdout:8/149: getdents d0/d29 0 2023-10-21T17:05:57.552 INFO:tasks.workunit.client.0.smithi012.stdout:4/173: unlink dc/d15/f1f 0 2023-10-21T17:05:57.805 INFO:tasks.workunit.client.0.smithi012.stdout:8/150: creat d0/f36 x:0 0 0 2023-10-21T17:05:57.806 INFO:tasks.workunit.client.0.smithi012.stdout:8/151: stat d0/d12 0 2023-10-21T17:05:58.021 INFO:tasks.workunit.client.0.smithi012.stdout:4/174: creat dc/d1e/d2b/f38 x:0 0 0 2023-10-21T17:05:58.022 INFO:tasks.workunit.client.0.smithi012.stdout:0/171: mknod d7/d8/d23/c43 0 2023-10-21T17:05:58.022 INFO:tasks.workunit.client.0.smithi012.stdout:0/172: dread - d7/f36 zero size 2023-10-21T17:05:58.022 INFO:tasks.workunit.client.0.smithi012.stdout:4/175: write dc/d1e/d2b/f38 [170217,101250] 0 2023-10-21T17:05:58.110 INFO:tasks.workunit.client.0.smithi012.stdout:0/173: dwrite d7/d8/d23/f2a [0,4194304] 0 2023-10-21T17:05:58.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/184: getdents d1/d14 0 2023-10-21T17:05:58.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/185: write d1/f9 [4204011,107466] 0 2023-10-21T17:05:58.310 INFO:tasks.workunit.client.0.smithi012.stdout:6/163: link d13/d15/f18 d13/d15/f33 0 2023-10-21T17:05:58.952 INFO:tasks.workunit.client.0.smithi012.stdout:4/176: symlink dc/d15/d18/l39 0 2023-10-21T17:05:59.224 INFO:tasks.workunit.client.0.smithi012.stdout:1/168: sync 2023-10-21T17:05:59.224 INFO:tasks.workunit.client.0.smithi012.stdout:1/169: chown d5/d26/f2f 835269114 1 2023-10-21T17:05:59.297 INFO:tasks.workunit.client.0.smithi012.stdout:0/174: creat d7/d8/d23/d27/f44 x:0 0 0 2023-10-21T17:05:59.297 INFO:tasks.workunit.client.0.smithi012.stdout:0/175: chown l4 0 1 2023-10-21T17:05:59.380 INFO:tasks.workunit.client.0.smithi012.stdout:2/186: dread d1/d8/f13 [0,4194304] 0 2023-10-21T17:05:59.561 INFO:tasks.workunit.client.0.smithi012.stdout:9/144: creat d0/d4/f2e x:0 0 0 2023-10-21T17:06:00.041 INFO:tasks.workunit.client.0.smithi012.stdout:8/152: getdents d0/d1a 0 2023-10-21T17:06:00.041 INFO:tasks.workunit.client.0.smithi012.stdout:8/153: chown d0/d1a/c2c 1205877 1 2023-10-21T17:06:00.044 INFO:tasks.workunit.client.0.smithi012.stdout:4/177: mknod dc/d1e/d2b/c3a 0 2023-10-21T17:06:00.045 INFO:tasks.workunit.client.0.smithi012.stdout:4/178: stat dc/f11 0 2023-10-21T17:06:00.314 INFO:tasks.workunit.client.0.smithi012.stdout:1/170: mknod d5/d32/d1b/d27/c34 0 2023-10-21T17:06:00.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/187: creat d1/d14/d16/d22/f36 x:0 0 0 2023-10-21T17:06:00.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/168: rename d3/d18 to d3/d29 0 2023-10-21T17:06:00.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/169: write d3/f1d [4728533,36478] 0 2023-10-21T17:06:00.828 INFO:tasks.workunit.client.0.smithi012.stdout:9/145: mkdir d0/d4/db/d12/d25/d2f 0 2023-10-21T17:06:00.828 INFO:tasks.workunit.client.0.smithi012.stdout:9/146: chown d0/d15/f1a 48580 1 2023-10-21T17:06:01.289 INFO:tasks.workunit.client.0.smithi012.stdout:5/132: mknod d2/c2e 0 2023-10-21T17:06:01.338 INFO:tasks.workunit.client.0.smithi012.stdout:1/171: stat d5/d26/d29/c22 0 2023-10-21T17:06:01.339 INFO:tasks.workunit.client.0.smithi012.stdout:1/172: chown d5/d26/d29/fd 28 1 2023-10-21T17:06:01.498 INFO:tasks.workunit.client.0.smithi012.stdout:2/188: rmdir d1/d14/d16/d20 39 2023-10-21T17:06:01.815 INFO:tasks.workunit.client.0.smithi012.stdout:7/170: link d3/d6/dc/c24 d3/d6/dc/d19/d1e/c2a 0 2023-10-21T17:06:01.912 INFO:tasks.workunit.client.0.smithi012.stdout:9/147: unlink d0/df/f1d 0 2023-10-21T17:06:01.912 INFO:tasks.workunit.client.0.smithi012.stdout:9/148: readlink d0/l29 0 2023-10-21T17:06:01.912 INFO:tasks.workunit.client.0.smithi012.stdout:9/149: fsync d0/d5/f22 0 2023-10-21T17:06:02.132 INFO:tasks.workunit.client.0.smithi012.stdout:5/133: symlink d2/d1d/d29/l2f 0 2023-10-21T17:06:02.220 INFO:tasks.workunit.client.0.smithi012.stdout:1/173: mkdir d5/d32/d1b/d35 0 2023-10-21T17:06:02.365 INFO:tasks.workunit.client.0.smithi012.stdout:2/189: truncate d1/d14/d17/f1f 3251510 0 2023-10-21T17:06:02.379 INFO:tasks.workunit.client.0.smithi012.stdout:2/190: dread d1/f1a [0,4194304] 0 2023-10-21T17:06:02.471 INFO:tasks.workunit.client.0.smithi012.stdout:7/171: mknod d3/d6/dc/c2b 0 2023-10-21T17:06:02.558 INFO:tasks.workunit.client.0.smithi012.stdout:9/150: creat d0/d15/f30 x:0 0 0 2023-10-21T17:06:02.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/151: creat d0/d4/db/d12/f31 x:0 0 0 2023-10-21T17:06:02.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/152: dread - d0/d15/f23 zero size 2023-10-21T17:06:02.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/153: creat d0/d5/f32 x:0 0 0 2023-10-21T17:06:02.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/154: chown d0/d5/c27 26 1 2023-10-21T17:06:02.673 INFO:tasks.workunit.client.0.smithi012.stdout:5/134: mknod d2/c30 0 2023-10-21T17:06:02.751 INFO:tasks.workunit.client.0.smithi012.stdout:6/164: write f1 [630809,51110] 0 2023-10-21T17:06:03.346 INFO:tasks.workunit.client.0.smithi012.stdout:7/172: mknod d3/d6/dc/d19/d28/c2c 0 2023-10-21T17:06:03.346 INFO:tasks.workunit.client.0.smithi012.stdout:7/173: chown d3/d6/lb 17594 1 2023-10-21T17:06:03.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/174: chown d3/d6/lb 12 1 2023-10-21T17:06:03.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/175: chown d3/d6 537690199 1 2023-10-21T17:06:03.517 INFO:tasks.workunit.client.0.smithi012.stdout:9/155: unlink d0/f3 0 2023-10-21T17:06:03.609 INFO:tasks.workunit.client.0.smithi012.stdout:9/156: dwrite d0/d4/db/d12/f31 [0,4194304] 0 2023-10-21T17:06:03.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/176: dwrite d7/d8/d1f/d28/f34 [0,4194304] 0 2023-10-21T17:06:03.629 INFO:tasks.workunit.client.0.smithi012.stdout:0/177: write f5 [2598060,48286] 0 2023-10-21T17:06:03.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:06:03.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:06:03.786 INFO:tasks.workunit.client.0.smithi012.stdout:6/165: unlink d13/f22 0 2023-10-21T17:06:04.060 INFO:tasks.workunit.client.0.smithi012.stdout:7/176: symlink d3/d6/dc/d19/d28/l2d 0 2023-10-21T17:06:04.064 INFO:tasks.workunit.client.0.smithi012.stdout:7/177: read d3/d16/f1a [597491,19335] 0 2023-10-21T17:06:04.140 INFO:tasks.workunit.client.0.smithi012.stdout:7/178: dwrite d3/d29/f26 [0,4194304] 0 2023-10-21T17:06:04.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/157: mknod d0/d4/db/c33 0 2023-10-21T17:06:04.941 INFO:tasks.workunit.client.0.smithi012.stdout:0/178: creat d7/d8/d23/d27/d40/f45 x:0 0 0 2023-10-21T17:06:04.942 INFO:tasks.workunit.client.0.smithi012.stdout:6/166: mkdir d13/d29/d34 0 2023-10-21T17:06:04.942 INFO:tasks.workunit.client.0.smithi012.stdout:3/151: sync 2023-10-21T17:06:04.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/179: truncate d7/d8/d23/d27/d31/f3c 154357 0 2023-10-21T17:06:04.943 INFO:tasks.workunit.client.0.smithi012.stdout:3/152: readlink d0/d1c/l20 0 2023-10-21T17:06:04.944 INFO:tasks.workunit.client.0.smithi012.stdout:3/153: chown d0/f15 353 1 2023-10-21T17:06:04.952 INFO:tasks.workunit.client.0.smithi012.stdout:3/154: write d0/da/f18 [116554,68863] 0 2023-10-21T17:06:05.021 INFO:tasks.workunit.client.0.smithi012.stdout:3/155: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:06:05.058 INFO:tasks.workunit.client.0.smithi012.stdout:3/156: dread d0/d1c/f1e [0,4194304] 0 2023-10-21T17:06:05.260 INFO:tasks.workunit.client.0.smithi012.stdout:7/179: dread d3/d29/f11 [0,4194304] 0 2023-10-21T17:06:05.615 INFO:tasks.workunit.client.0.smithi012.stdout:0/180: creat d7/d8/d23/f46 x:0 0 0 2023-10-21T17:06:05.617 INFO:tasks.workunit.client.0.smithi012.stdout:0/181: write d7/d8/d23/d27/f44 [830724,114904] 0 2023-10-21T17:06:05.646 INFO:tasks.workunit.client.0.smithi012.stdout:6/167: dread d13/d15/f27 [0,4194304] 0 2023-10-21T17:06:05.819 INFO:tasks.workunit.client.0.smithi012.stdout:7/180: creat d3/d29/f2e x:0 0 0 2023-10-21T17:06:06.114 INFO:tasks.workunit.client.0.smithi012.stdout:0/182: symlink d7/d8/d23/l47 0 2023-10-21T17:06:06.207 INFO:tasks.workunit.client.0.smithi012.stdout:0/183: dwrite d7/d8/f3b [0,4194304] 0 2023-10-21T17:06:06.209 INFO:tasks.workunit.client.0.smithi012.stdout:0/184: readlink d7/d8/d23/d27/d31/d3d/l3f 0 2023-10-21T17:06:06.284 INFO:tasks.workunit.client.0.smithi012.stdout:6/168: mkdir d13/d35 0 2023-10-21T17:06:06.435 INFO:tasks.workunit.client.0.smithi012.stdout:7/181: link d3/d6/le d3/d6/dc/d19/d1e/l2f 0 2023-10-21T17:06:06.456 INFO:tasks.workunit.client.0.smithi012.stdout:7/182: dread d3/d16/f1a [0,4194304] 0 2023-10-21T17:06:06.652 INFO:tasks.workunit.client.0.smithi012.stdout:0/185: mkdir d7/d8/d9/d48 0 2023-10-21T17:06:06.737 INFO:tasks.workunit.client.0.smithi012.stdout:0/186: dwrite d7/d8/f3b [0,4194304] 0 2023-10-21T17:06:06.738 INFO:tasks.workunit.client.0.smithi012.stdout:0/187: write d7/d8/ff [1963365,68564] 0 2023-10-21T17:06:06.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/157: creat d0/f2b x:0 0 0 2023-10-21T17:06:06.870 INFO:tasks.workunit.client.0.smithi012.stdout:6/169: creat d13/f36 x:0 0 0 2023-10-21T17:06:06.897 INFO:tasks.workunit.client.0.smithi012.stdout:3/158: dread d0/da/f18 [0,4194304] 0 2023-10-21T17:06:06.922 INFO:tasks.workunit.client.0.smithi012.stdout:7/183: getdents d3 0 2023-10-21T17:06:07.140 INFO:tasks.workunit.client.0.smithi012.stdout:0/188: rmdir d7/d8/d23/d27/d39 0 2023-10-21T17:06:07.141 INFO:tasks.workunit.client.0.smithi012.stdout:0/189: write d7/d8/d9/f12 [4431211,97427] 0 2023-10-21T17:06:07.141 INFO:tasks.workunit.client.0.smithi012.stdout:0/190: creat d7/d8/d9/f49 x:0 0 0 2023-10-21T17:06:07.142 INFO:tasks.workunit.client.0.smithi012.stdout:0/191: creat d7/d8/d1f/f4a x:0 0 0 2023-10-21T17:06:07.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/192: dwrite d7/d8/d9/f20 [0,4194304] 0 2023-10-21T17:06:07.260 INFO:tasks.workunit.client.0.smithi012.stdout:0/193: dread f5 [0,4194304] 0 2023-10-21T17:06:07.261 INFO:tasks.workunit.client.0.smithi012.stdout:0/194: chown d7/f19 36 1 2023-10-21T17:06:07.574 INFO:tasks.workunit.client.0.smithi012.stdout:8/154: rename d0/f23 to d0/d12/f37 0 2023-10-21T17:06:07.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/174: rename d5/d32/d1b to d5/d32/d1b/d2c/d36 22 2023-10-21T17:06:07.575 INFO:tasks.workunit.client.0.smithi012.stdout:1/175: read d5/d26/d29/fd [2990343,130122] 0 2023-10-21T17:06:07.578 INFO:tasks.workunit.client.0.smithi012.stdout:4/179: creat dc/f3b x:0 0 0 2023-10-21T17:06:07.578 INFO:tasks.workunit.client.0.smithi012.stdout:6/170: mkdir d13/d29/d37 0 2023-10-21T17:06:07.579 INFO:tasks.workunit.client.0.smithi012.stdout:4/180: chown fb 47720515 1 2023-10-21T17:06:07.579 INFO:tasks.workunit.client.0.smithi012.stdout:4/181: chown dc/d1e/d33 406 1 2023-10-21T17:06:07.579 INFO:tasks.workunit.client.0.smithi012.stdout:6/171: fsync d13/d15/d1d/d24/f2f 0 2023-10-21T17:06:07.612 INFO:tasks.workunit.client.0.smithi012.stdout:1/176: read d5/d32/d1b/d27/d1a/f1f [7260823,30440] 0 2023-10-21T17:06:07.847 INFO:tasks.workunit.client.0.smithi012.stdout:9/158: rmdir d0/d4 39 2023-10-21T17:06:07.848 INFO:tasks.workunit.client.0.smithi012.stdout:3/159: creat d0/da/d28/f2c x:0 0 0 2023-10-21T17:06:07.922 INFO:tasks.workunit.client.0.smithi012.stdout:9/159: dwrite d0/f2 [0,4194304] 0 2023-10-21T17:06:08.166 INFO:tasks.workunit.client.0.smithi012.stdout:0/195: unlink d7/d8/d9/cb 0 2023-10-21T17:06:08.366 INFO:tasks.workunit.client.0.smithi012.stdout:2/191: rename d1/d4/ld to d1/d14/d1b/l37 0 2023-10-21T17:06:08.495 INFO:tasks.workunit.client.0.smithi012.stdout:8/155: symlink d0/d29/l38 0 2023-10-21T17:06:08.824 INFO:tasks.workunit.client.0.smithi012.stdout:4/182: unlink dc/d15/d18/l34 0 2023-10-21T17:06:08.911 INFO:tasks.workunit.client.0.smithi012.stdout:4/183: dwrite dc/f10 [0,4194304] 0 2023-10-21T17:06:08.911 INFO:tasks.workunit.client.0.smithi012.stdout:4/184: fdatasync dc/f10 0 2023-10-21T17:06:08.912 INFO:tasks.workunit.client.0.smithi012.stdout:4/185: fsync dc/f17 0 2023-10-21T17:06:08.912 INFO:tasks.workunit.client.0.smithi012.stdout:4/186: truncate dc/d1e/d2b/f38 683530 0 2023-10-21T17:06:09.377 INFO:tasks.workunit.client.0.smithi012.stdout:6/172: link d13/d15/f27 d13/d15/f38 0 2023-10-21T17:06:09.378 INFO:tasks.workunit.client.0.smithi012.stdout:6/173: chown d13/d15/d1d 43 1 2023-10-21T17:06:09.378 INFO:tasks.workunit.client.0.smithi012.stdout:6/174: creat d13/d15/d1d/d28/f39 x:0 0 0 2023-10-21T17:06:09.386 INFO:tasks.workunit.client.0.smithi012.stdout:1/177: creat d5/d32/d1b/d27/d21/f37 x:0 0 0 2023-10-21T17:06:09.386 INFO:tasks.workunit.client.0.smithi012.stdout:1/178: chown d5/d32/l2a 3452107 1 2023-10-21T17:06:09.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/160: dread d0/da/f26 [0,4194304] 0 2023-10-21T17:06:09.593 INFO:tasks.workunit.client.0.smithi012.stdout:3/161: write d0/f11 [4496223,30667] 0 2023-10-21T17:06:09.593 INFO:tasks.workunit.client.0.smithi012.stdout:3/162: chown d0/l3 1529 1 2023-10-21T17:06:11.047 INFO:tasks.workunit.client.0.smithi012.stdout:5/135: rename d2/d1d/d29/l2a to d2/d1d/l31 0 2023-10-21T17:06:11.376 INFO:tasks.workunit.client.0.smithi012.stdout:4/187: creat dc/d1e/f3c x:0 0 0 2023-10-21T17:06:12.106 INFO:tasks.workunit.client.0.smithi012.stdout:6/175: creat d13/d35/f3a x:0 0 0 2023-10-21T17:06:12.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/179: creat d5/d32/d1b/d27/f38 x:0 0 0 2023-10-21T17:06:12.353 INFO:tasks.workunit.client.0.smithi012.stdout:1/180: chown d5/l7 17 1 2023-10-21T17:06:12.655 INFO:tasks.workunit.client.0.smithi012.stdout:3/163: symlink d0/da/d28/l2d 0 2023-10-21T17:06:12.656 INFO:tasks.workunit.client.0.smithi012.stdout:3/164: stat d0/d1c/l1d 0 2023-10-21T17:06:12.791 INFO:tasks.workunit.client.0.smithi012.stdout:0/196: unlink f2 0 2023-10-21T17:06:12.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/184: rename d3/d29/f2e to d3/d6/dc/d19/f30 0 2023-10-21T17:06:12.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/185: dread - d3/d29/f27 zero size 2023-10-21T17:06:12.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/186: stat d3/d29/f27 0 2023-10-21T17:06:12.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/187: creat d3/d16/f31 x:0 0 0 2023-10-21T17:06:12.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/188: dwrite d3/d16/f31 [0,4194304] 0 2023-10-21T17:06:12.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/189: chown d3/d6/le 1 1 2023-10-21T17:06:13.048 INFO:tasks.workunit.client.0.smithi012.stdout:7/190: dwrite d3/d29/f27 [0,4194304] 0 2023-10-21T17:06:13.048 INFO:tasks.workunit.client.0.smithi012.stdout:7/191: creat d3/d16/f32 x:0 0 0 2023-10-21T17:06:13.082 INFO:tasks.workunit.client.0.smithi012.stdout:5/136: mknod d2/d2c/c32 0 2023-10-21T17:06:13.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/192: dwrite d3/d16/f31 [0,4194304] 0 2023-10-21T17:06:13.132 INFO:tasks.workunit.client.0.smithi012.stdout:7/193: creat d3/d6/dc/d19/f33 x:0 0 0 2023-10-21T17:06:13.132 INFO:tasks.workunit.client.0.smithi012.stdout:7/194: fdatasync d3/d29/f26 0 2023-10-21T17:06:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/195: dread d3/d6/dc/d19/f22 [0,4194304] 0 2023-10-21T17:06:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/196: getdents d3 0 2023-10-21T17:06:13.186 INFO:tasks.workunit.client.0.smithi012.stdout:7/197: dread d3/d29/f27 [0,4194304] 0 2023-10-21T17:06:13.313 INFO:tasks.workunit.client.0.smithi012.stdout:2/192: truncate d1/d14/d17/f1f 3195862 0 2023-10-21T17:06:13.314 INFO:tasks.workunit.client.0.smithi012.stdout:2/193: chown d1/d8 1533747 1 2023-10-21T17:06:13.314 INFO:tasks.workunit.client.0.smithi012.stdout:2/194: chown d1/d14/c21 6243 1 2023-10-21T17:06:13.451 INFO:tasks.workunit.client.0.smithi012.stdout:8/156: symlink d0/l39 0 2023-10-21T17:06:13.452 INFO:tasks.workunit.client.0.smithi012.stdout:8/157: readlink d0/d29/l2d 0 2023-10-21T17:06:13.596 INFO:tasks.workunit.client.0.smithi012.stdout:4/188: mknod dc/d15/d18/c3d 0 2023-10-21T17:06:13.691 INFO:tasks.workunit.client.0.smithi012.stdout:4/189: dwrite f8 [0,4194304] 0 2023-10-21T17:06:13.981 INFO:tasks.workunit.client.0.smithi012.stdout:6/176: mkdir d13/d29/d37/d3b 0 2023-10-21T17:06:13.981 INFO:tasks.workunit.client.0.smithi012.stdout:3/165: symlink d0/d1c/l2e 0 2023-10-21T17:06:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:0/197: mknod d7/d8/d23/d30/c4b 0 2023-10-21T17:06:14.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/198: dread f6 [0,4194304] 0 2023-10-21T17:06:14.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/199: dread - d7/d8/d23/d27/d31/f3e zero size 2023-10-21T17:06:14.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/200: write d7/d8/d9/f49 [167125,104914] 0 2023-10-21T17:06:14.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/181: rename d5/d32/d1b/f1c to d5/f39 0 2023-10-21T17:06:14.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/137: rmdir d2/dd/d15 39 2023-10-21T17:06:14.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/160: sync 2023-10-21T17:06:15.030 INFO:tasks.workunit.client.0.smithi012.stdout:7/198: mkdir d3/d6/dc/d19/d1e/d34 0 2023-10-21T17:06:15.262 INFO:tasks.workunit.client.0.smithi012.stdout:2/195: symlink d1/d14/l38 0 2023-10-21T17:06:15.477 INFO:tasks.workunit.client.0.smithi012.stdout:3/166: mknod d0/da/d28/c2f 0 2023-10-21T17:06:15.477 INFO:tasks.workunit.client.0.smithi012.stdout:3/167: fsync d0/f2b 0 2023-10-21T17:06:15.531 INFO:tasks.workunit.client.0.smithi012.stdout:0/201: mkdir d7/d8/d23/d27/d40/d4c 0 2023-10-21T17:06:16.679 INFO:tasks.workunit.client.0.smithi012.stdout:1/182: mkdir d5/d32/d1b/d35/d3a 0 2023-10-21T17:06:16.736 INFO:tasks.workunit.client.0.smithi012.stdout:5/138: truncate d2/f4 8177625 0 2023-10-21T17:06:16.830 INFO:tasks.workunit.client.0.smithi012.stdout:9/161: symlink d0/d4/db/d12/d25/l34 0 2023-10-21T17:06:16.830 INFO:tasks.workunit.client.0.smithi012.stdout:9/162: readlink d0/d4/db/l19 0 2023-10-21T17:06:16.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/163: write d0/f8 [2108040,44152] 0 2023-10-21T17:06:17.571 INFO:tasks.workunit.client.0.smithi012.stdout:0/202: creat d7/d8/d23/d27/d40/d4c/f4d x:0 0 0 2023-10-21T17:06:17.571 INFO:tasks.workunit.client.0.smithi012.stdout:1/183: creat d5/d26/d29/f3b x:0 0 0 2023-10-21T17:06:17.571 INFO:tasks.workunit.client.0.smithi012.stdout:1/184: read d5/ff [376921,41164] 0 2023-10-21T17:06:17.575 INFO:tasks.workunit.client.0.smithi012.stdout:9/164: unlink d0/d15/f1a 0 2023-10-21T17:06:17.590 INFO:tasks.workunit.client.0.smithi012.stdout:1/185: dread d5/d32/d1b/d27/d1a/f1d [0,4194304] 0 2023-10-21T17:06:17.591 INFO:tasks.workunit.client.0.smithi012.stdout:1/186: fsync d5/d32/d1b/d27/d1a/f1d 0 2023-10-21T17:06:17.591 INFO:tasks.workunit.client.0.smithi012.stdout:1/187: fsync d5/d26/f2f 0 2023-10-21T17:06:17.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/196: read d1/d14/d16/d20/f2e [2379555,42572] 0 2023-10-21T17:06:17.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/197: creat d1/d14/d16/d22/f39 x:0 0 0 2023-10-21T17:06:17.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/198: chown d1/d8/ff 503 1 2023-10-21T17:06:17.850 INFO:tasks.workunit.client.0.smithi012.stdout:2/199: truncate d1/d14/d17/f24 674834 0 2023-10-21T17:06:18.256 INFO:tasks.workunit.client.0.smithi012.stdout:9/165: creat d0/d4/db/d12/d25/d2f/f35 x:0 0 0 2023-10-21T17:06:18.256 INFO:tasks.workunit.client.0.smithi012.stdout:1/188: creat d5/d32/f3c x:0 0 0 2023-10-21T17:06:18.322 INFO:tasks.workunit.client.0.smithi012.stdout:9/166: dwrite d0/f2 [4194304,4194304] 0 2023-10-21T17:06:18.323 INFO:tasks.workunit.client.0.smithi012.stdout:9/167: dread - d0/d4/f2e zero size 2023-10-21T17:06:18.773 INFO:tasks.workunit.client.0.smithi012.stdout:2/200: mknod d1/d14/d1b/c3a 0 2023-10-21T17:06:18.774 INFO:tasks.workunit.client.0.smithi012.stdout:2/201: fsync d1/d4/f5 0 2023-10-21T17:06:18.774 INFO:tasks.workunit.client.0.smithi012.stdout:2/202: read d1/d14/d17/f1f [449757,86244] 0 2023-10-21T17:06:19.082 INFO:tasks.workunit.client.0.smithi012.stdout:9/168: mkdir d0/d4/db/d12/d2a/d36 0 2023-10-21T17:06:19.118 INFO:tasks.workunit.client.0.smithi012.stdout:9/169: dread d0/d4/db/d12/f31 [0,4194304] 0 2023-10-21T17:06:19.489 INFO:tasks.workunit.client.0.smithi012.stdout:9/170: creat d0/d4/db/d12/d25/f37 x:0 0 0 2023-10-21T17:06:20.087 INFO:tasks.workunit.client.0.smithi012.stdout:9/171: creat d0/d4/db/d12/d2a/d36/f38 x:0 0 0 2023-10-21T17:06:20.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/190: dwrite fb [0,4194304] 0 2023-10-21T17:06:20.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/191: dread - dc/f3b zero size 2023-10-21T17:06:20.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/192: chown dc/l20 1 1 2023-10-21T17:06:20.179 INFO:tasks.workunit.client.0.smithi012.stdout:4/193: dread dc/f10 [0,4194304] 0 2023-10-21T17:06:20.181 INFO:tasks.workunit.client.0.smithi012.stdout:3/168: symlink d0/l30 0 2023-10-21T17:06:20.271 INFO:tasks.workunit.client.0.smithi012.stdout:9/172: mkdir d0/d4/db/d12/d25/d39 0 2023-10-21T17:06:20.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/173: dread d0/f2 [4194304,4194304] 0 2023-10-21T17:06:20.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/174: chown d0/d15/f30 3435 1 2023-10-21T17:06:20.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/175: stat d0/df 0 2023-10-21T17:06:20.462 INFO:tasks.workunit.client.0.smithi012.stdout:5/139: write d2/f4 [1496031,109298] 0 2023-10-21T17:06:20.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/199: write d3/d29/f11 [638129,119033] 0 2023-10-21T17:06:20.740 INFO:tasks.workunit.client.0.smithi012.stdout:8/158: mknod d0/c3a 0 2023-10-21T17:06:20.740 INFO:tasks.workunit.client.0.smithi012.stdout:8/159: chown d0/d1a/l21 63638454 1 2023-10-21T17:06:20.850 INFO:tasks.workunit.client.0.smithi012.stdout:8/160: dwrite d0/f16 [0,4194304] 0 2023-10-21T17:06:20.937 INFO:tasks.workunit.client.0.smithi012.stdout:4/194: truncate dc/f25 438077 0 2023-10-21T17:06:21.030 INFO:tasks.workunit.client.0.smithi012.stdout:4/195: dwrite f1 [0,4194304] 0 2023-10-21T17:06:21.030 INFO:tasks.workunit.client.0.smithi012.stdout:4/196: creat dc/d1e/f3e x:0 0 0 2023-10-21T17:06:21.259 INFO:tasks.workunit.client.0.smithi012.stdout:9/176: creat d0/d4/db/d12/d2a/f3a x:0 0 0 2023-10-21T17:06:21.564 INFO:tasks.workunit.client.0.smithi012.stdout:5/140: mknod d2/d2c/c33 0 2023-10-21T17:06:21.564 INFO:tasks.workunit.client.0.smithi012.stdout:7/200: symlink d3/d6/dc/d19/d28/l35 0 2023-10-21T17:06:21.564 INFO:tasks.workunit.client.0.smithi012.stdout:5/141: write d2/dd/d1e/f28 [143624,77394] 0 2023-10-21T17:06:21.565 INFO:tasks.workunit.client.0.smithi012.stdout:5/142: truncate d2/dd/d1e/f26 888863 0 2023-10-21T17:06:21.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/161: mknod d0/d29/c3b 0 2023-10-21T17:06:21.686 INFO:tasks.workunit.client.0.smithi012.stdout:8/162: dread d0/f2 [0,4194304] 0 2023-10-21T17:06:21.734 INFO:tasks.workunit.client.0.smithi012.stdout:1/189: write d5/f10 [1197407,8959] 0 2023-10-21T17:06:22.097 INFO:tasks.workunit.client.0.smithi012.stdout:4/197: mknod dc/d1e/d2b/c3f 0 2023-10-21T17:06:22.098 INFO:tasks.workunit.client.0.smithi012.stdout:4/198: chown dc/l20 34630 1 2023-10-21T17:06:22.098 INFO:tasks.workunit.client.0.smithi012.stdout:4/199: fsync f1 0 2023-10-21T17:06:22.209 INFO:tasks.workunit.client.0.smithi012.stdout:9/177: mkdir d0/d4/db/d12/d25/d39/d3b 0 2023-10-21T17:06:22.215 INFO:tasks.workunit.client.0.smithi012.stdout:2/203: write d1/d8/f13 [996969,51185] 0 2023-10-21T17:06:22.360 INFO:tasks.workunit.client.0.smithi012.stdout:7/201: creat d3/d6/dc/f36 x:0 0 0 2023-10-21T17:06:22.361 INFO:tasks.workunit.client.0.smithi012.stdout:7/202: read - d3/d6/dc/d19/f30 zero size 2023-10-21T17:06:22.469 INFO:tasks.workunit.client.0.smithi012.stdout:5/143: dread d2/dd/d1e/f24 [0,4194304] 0 2023-10-21T17:06:22.557 INFO:tasks.workunit.client.0.smithi012.stdout:8/163: creat d0/d29/f3c x:0 0 0 2023-10-21T17:06:22.827 INFO:tasks.workunit.client.0.smithi012.stdout:1/190: unlink f4 0 2023-10-21T17:06:22.828 INFO:tasks.workunit.client.0.smithi012.stdout:1/191: chown d5/d32/d1b/d27/c34 10 1 2023-10-21T17:06:22.828 INFO:tasks.workunit.client.0.smithi012.stdout:1/192: chown d5/d32/d1b 56754053 1 2023-10-21T17:06:23.321 INFO:tasks.workunit.client.0.smithi012.stdout:4/200: symlink dc/d1e/d33/l40 0 2023-10-21T17:06:23.469 INFO:tasks.workunit.client.0.smithi012.stdout:2/204: creat d1/d14/d16/d20/f3b x:0 0 0 2023-10-21T17:06:24.166 INFO:tasks.workunit.client.0.smithi012.stdout:6/177: rename l9 to d13/d15/d1d/l3c 0 2023-10-21T17:06:24.184 INFO:tasks.workunit.client.0.smithi012.stdout:3/169: write d0/da/f26 [75271,18685] 0 2023-10-21T17:06:24.204 INFO:tasks.workunit.client.0.smithi012.stdout:5/144: dread d2/dd/d1e/f26 [0,4194304] 0 2023-10-21T17:06:24.235 INFO:tasks.workunit.client.0.smithi012.stdout:5/145: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:06:24.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/146: readlink d2/lb 0 2023-10-21T17:06:24.570 INFO:tasks.workunit.client.0.smithi012.stdout:8/164: read d0/f8 [3425017,128496] 0 2023-10-21T17:06:24.878 INFO:tasks.workunit.client.0.smithi012.stdout:1/193: creat d5/d32/d1b/d35/d3a/f3d x:0 0 0 2023-10-21T17:06:24.979 INFO:tasks.workunit.client.0.smithi012.stdout:2/205: mknod d1/d14/d1b/c3c 0 2023-10-21T17:06:25.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/178: dread f11 [0,4194304] 0 2023-10-21T17:06:25.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/179: chown d13/d15/f1a 867531738 1 2023-10-21T17:06:25.290 INFO:tasks.workunit.client.0.smithi012.stdout:0/203: rename d7/d8/d23/d30/l41 to d7/d8/d1f/l4e 0 2023-10-21T17:06:25.290 INFO:tasks.workunit.client.0.smithi012.stdout:0/204: creat d7/d8/d23/d27/d31/f4f x:0 0 0 2023-10-21T17:06:25.451 INFO:tasks.workunit.client.0.smithi012.stdout:3/170: symlink d0/l31 0 2023-10-21T17:06:25.895 INFO:tasks.workunit.client.0.smithi012.stdout:5/147: mknod d2/c34 0 2023-10-21T17:06:25.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/165: creat d0/d1a/f3d x:0 0 0 2023-10-21T17:06:25.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/166: fdatasync d0/f27 0 2023-10-21T17:06:25.970 INFO:tasks.workunit.client.0.smithi012.stdout:1/194: dread d5/d32/f17 [0,4194304] 0 2023-10-21T17:06:25.971 INFO:tasks.workunit.client.0.smithi012.stdout:1/195: write d5/d32/d1b/d27/d21/f37 [555219,17741] 0 2023-10-21T17:06:26.127 INFO:tasks.workunit.client.0.smithi012.stdout:4/201: symlink dc/d28/l41 0 2023-10-21T17:06:26.246 INFO:tasks.workunit.client.0.smithi012.stdout:2/206: unlink d1/d8/ca 0 2023-10-21T17:06:26.470 INFO:tasks.workunit.client.0.smithi012.stdout:6/180: symlink d13/d15/d1d/d28/l3d 0 2023-10-21T17:06:26.567 INFO:tasks.workunit.client.0.smithi012.stdout:7/203: mknod d3/d6/dc/d19/c37 0 2023-10-21T17:06:26.568 INFO:tasks.workunit.client.0.smithi012.stdout:7/204: fdatasync d3/d6/dc/f36 0 2023-10-21T17:06:26.568 INFO:tasks.workunit.client.0.smithi012.stdout:7/205: read - d3/d6/f25 zero size 2023-10-21T17:06:26.648 INFO:tasks.workunit.client.0.smithi012.stdout:7/206: dwrite d3/d6/dc/f36 [0,4194304] 0 2023-10-21T17:06:26.648 INFO:tasks.workunit.client.0.smithi012.stdout:7/207: read - d3/d6/dc/d19/f30 zero size 2023-10-21T17:06:26.856 INFO:tasks.workunit.client.0.smithi012.stdout:0/205: creat d7/d8/d1f/f50 x:0 0 0 2023-10-21T17:06:26.939 INFO:tasks.workunit.client.0.smithi012.stdout:0/206: dwrite d7/d8/d1f/d28/f34 [0,4194304] 0 2023-10-21T17:06:27.241 INFO:tasks.workunit.client.0.smithi012.stdout:5/148: mknod d2/d2c/c35 0 2023-10-21T17:06:27.398 INFO:tasks.workunit.client.0.smithi012.stdout:8/167: getdents d0/d12 0 2023-10-21T17:06:27.496 INFO:tasks.workunit.client.0.smithi012.stdout:4/202: write f8 [7799595,43358] 0 2023-10-21T17:06:27.565 INFO:tasks.workunit.client.0.smithi012.stdout:4/203: dwrite dc/f3b [0,4194304] 0 2023-10-21T17:06:28.248 INFO:tasks.workunit.client.0.smithi012.stdout:0/207: dread d7/d8/f22 [0,4194304] 0 2023-10-21T17:06:28.309 INFO:tasks.workunit.client.0.smithi012.stdout:3/171: getdents d0/da/d28 0 2023-10-21T17:06:28.505 INFO:tasks.workunit.client.0.smithi012.stdout:5/149: symlink d2/dd/d15/l36 0 2023-10-21T17:06:28.595 INFO:tasks.workunit.client.0.smithi012.stdout:8/168: mknod d0/d12/c3e 0 2023-10-21T17:06:29.221 INFO:tasks.workunit.client.0.smithi012.stdout:2/207: getdents d1/d4 0 2023-10-21T17:06:29.221 INFO:tasks.workunit.client.0.smithi012.stdout:2/208: fdatasync d1/d8/f10 0 2023-10-21T17:06:29.222 INFO:tasks.workunit.client.0.smithi012.stdout:2/209: creat d1/d8/f3d x:0 0 0 2023-10-21T17:06:29.521 INFO:tasks.workunit.client.0.smithi012.stdout:7/208: truncate d3/d29/f11 1504503 0 2023-10-21T17:06:29.521 INFO:tasks.workunit.client.0.smithi012.stdout:7/209: write d3/d6/dc/d19/f30 [911904,55481] 0 2023-10-21T17:06:29.604 INFO:tasks.workunit.client.0.smithi012.stdout:0/208: dread d7/d8/d9/f49 [0,4194304] 0 2023-10-21T17:06:29.604 INFO:tasks.workunit.client.0.smithi012.stdout:0/209: read - d7/d8/d1f/f4a zero size 2023-10-21T17:06:29.605 INFO:tasks.workunit.client.0.smithi012.stdout:0/210: write d7/d8/d1f/f4a [981647,33376] 0 2023-10-21T17:06:29.638 INFO:tasks.workunit.client.0.smithi012.stdout:0/211: dread d7/d8/d23/f2a [0,4194304] 0 2023-10-21T17:06:29.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/150: truncate d2/f4 7955327 0 2023-10-21T17:06:29.828 INFO:tasks.workunit.client.0.smithi012.stdout:5/151: dwrite d2/d1d/d20/f2b [0,4194304] 0 2023-10-21T17:06:30.011 INFO:tasks.workunit.client.0.smithi012.stdout:2/210: truncate d1/d14/d16/f27 1081031 0 2023-10-21T17:06:30.741 INFO:tasks.workunit.client.0.smithi012.stdout:7/210: symlink d3/d6/dc/d19/d1e/l38 0 2023-10-21T17:06:31.031 INFO:tasks.workunit.client.0.smithi012.stdout:6/181: rmdir d13/d15/d1d/d28 39 2023-10-21T17:06:31.202 INFO:tasks.workunit.client.0.smithi012.stdout:9/178: sync 2023-10-21T17:06:31.203 INFO:tasks.workunit.client.0.smithi012.stdout:9/179: truncate d0/d4/db/d12/d25/d2f/f35 323101 0 2023-10-21T17:06:31.204 INFO:tasks.workunit.client.0.smithi012.stdout:9/180: truncate d0/d4/db/d12/d2a/f3a 972883 0 2023-10-21T17:06:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:0/212: creat d7/d8/d1f/d28/f51 x:0 0 0 2023-10-21T17:06:31.293 INFO:tasks.workunit.client.0.smithi012.stdout:0/213: fsync d7/d8/f22 0 2023-10-21T17:06:31.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/152: unlink d2/dd/d1e/f28 0 2023-10-21T17:06:32.050 INFO:tasks.workunit.client.0.smithi012.stdout:5/153: dwrite d2/d1d/d20/f2b [0,4194304] 0 2023-10-21T17:06:32.166 INFO:tasks.workunit.client.0.smithi012.stdout:2/211: unlink d1/d8/l15 0 2023-10-21T17:06:32.324 INFO:tasks.workunit.client.0.smithi012.stdout:7/211: unlink d3/d29/l14 0 2023-10-21T17:06:32.692 INFO:tasks.workunit.client.0.smithi012.stdout:6/182: truncate d13/d15/f19 3767849 0 2023-10-21T17:06:32.925 INFO:tasks.workunit.client.0.smithi012.stdout:9/181: rename d0/d4/db/d12/d25/d2f/f35 to d0/d4/db/d12/d2a/d36/f3c 0 2023-10-21T17:06:32.925 INFO:tasks.workunit.client.0.smithi012.stdout:9/182: dread - d0/d15/f23 zero size 2023-10-21T17:06:33.276 INFO:tasks.workunit.client.0.smithi012.stdout:2/212: fdatasync d1/d4/f2b 0 2023-10-21T17:06:33.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/213: dread - d1/d4/f2b zero size 2023-10-21T17:06:33.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/214: creat d1/d14/d16/f3e x:0 0 0 2023-10-21T17:06:33.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/215: write d1/d14/d16/d20/f3b [186189,119356] 0 2023-10-21T17:06:33.278 INFO:tasks.workunit.client.0.smithi012.stdout:2/216: stat d1/d8/d35 0 2023-10-21T17:06:33.554 INFO:tasks.workunit.client.0.smithi012.stdout:4/204: write dc/f3b [4833591,1429] 0 2023-10-21T17:06:33.577 INFO:tasks.workunit.client.0.smithi012.stdout:4/205: dread dc/f11 [0,4194304] 0 2023-10-21T17:06:33.625 INFO:tasks.workunit.client.0.smithi012.stdout:3/172: rmdir d0 39 2023-10-21T17:06:33.822 INFO:tasks.workunit.client.0.smithi012.stdout:9/183: mknod d0/d4/db/d12/d25/d2f/c3d 0 2023-10-21T17:06:33.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:06:33.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:06:33.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/184: dwrite d0/fe [0,4194304] 0 2023-10-21T17:06:34.220 INFO:tasks.workunit.client.0.smithi012.stdout:7/212: dread d3/d29/f11 [0,4194304] 0 2023-10-21T17:06:34.305 INFO:tasks.workunit.client.0.smithi012.stdout:7/213: dwrite d3/d6/dc/d19/f33 [0,4194304] 0 2023-10-21T17:06:35.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/214: symlink d3/d6/dc/d19/l39 0 2023-10-21T17:06:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/196: rmdir d5/d26 39 2023-10-21T17:06:35.870 INFO:tasks.workunit.client.0.smithi012.stdout:1/197: dread d5/ff [0,4194304] 0 2023-10-21T17:06:36.219 INFO:tasks.workunit.client.0.smithi012.stdout:2/217: rename d1/d14/d1b to d1/d4/d3f 0 2023-10-21T17:06:36.220 INFO:tasks.workunit.client.0.smithi012.stdout:2/218: creat d1/d14/d17/f40 x:0 0 0 2023-10-21T17:06:36.504 INFO:tasks.workunit.client.0.smithi012.stdout:1/198: mknod d5/d26/d29/c3e 0 2023-10-21T17:06:36.504 INFO:tasks.workunit.client.0.smithi012.stdout:1/199: write d5/d32/d1b/d27/f38 [480737,33793] 0 2023-10-21T17:06:36.796 INFO:tasks.workunit.client.0.smithi012.stdout:2/219: mkdir d1/d4/d3f/d41 0 2023-10-21T17:06:37.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/220: creat d1/d8/d25/f42 x:0 0 0 2023-10-21T17:06:37.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/221: truncate d1/f2a 632943 0 2023-10-21T17:06:37.416 INFO:tasks.workunit.client.0.smithi012.stdout:8/169: symlink d0/l3f 0 2023-10-21T17:06:37.417 INFO:tasks.workunit.client.0.smithi012.stdout:8/170: readlink d0/l39 0 2023-10-21T17:06:37.729 INFO:tasks.workunit.client.0.smithi012.stdout:2/222: symlink d1/d8/d25/l43 0 2023-10-21T17:06:37.852 INFO:tasks.workunit.client.0.smithi012.stdout:2/223: dwrite d1/f9 [0,4194304] 0 2023-10-21T17:06:37.868 INFO:tasks.workunit.client.0.smithi012.stdout:2/224: dread d1/d8/f10 [0,4194304] 0 2023-10-21T17:06:37.868 INFO:tasks.workunit.client.0.smithi012.stdout:2/225: dread - d1/d8/d25/f42 zero size 2023-10-21T17:06:38.055 INFO:tasks.workunit.client.0.smithi012.stdout:3/173: mkdir d0/d32 0 2023-10-21T17:06:38.316 INFO:tasks.workunit.client.0.smithi012.stdout:6/183: unlink f11 0 2023-10-21T17:06:38.350 INFO:tasks.workunit.client.0.smithi012.stdout:6/184: dread d13/d15/f21 [0,4194304] 0 2023-10-21T17:06:38.350 INFO:tasks.workunit.client.0.smithi012.stdout:6/185: creat d13/d15/d1d/f3e x:0 0 0 2023-10-21T17:06:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:6/186: dread d13/d15/d1d/d24/f2f [0,4194304] 0 2023-10-21T17:06:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:6/187: stat l0 0 2023-10-21T17:06:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:6/188: truncate d13/d35/f3a 728866 0 2023-10-21T17:06:38.433 INFO:tasks.workunit.client.0.smithi012.stdout:6/189: dwrite d13/d15/d1d/d28/f32 [0,4194304] 0 2023-10-21T17:06:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/190: readlink l0 0 2023-10-21T17:06:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/191: write d13/d15/d1d/f3e [816533,75507] 0 2023-10-21T17:06:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/192: chown d13/d35 3599 1 2023-10-21T17:06:38.435 INFO:tasks.workunit.client.0.smithi012.stdout:6/193: write f6 [1336396,108793] 0 2023-10-21T17:06:38.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/226: symlink d1/d14/l44 0 2023-10-21T17:06:38.757 INFO:tasks.workunit.client.0.smithi012.stdout:9/185: rmdir d0/d4/db/d12/d2a/d36 39 2023-10-21T17:06:38.844 INFO:tasks.workunit.client.0.smithi012.stdout:3/174: symlink d0/da/d28/l33 0 2023-10-21T17:06:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:5/154: rmdir d2/dd/d15 39 2023-10-21T17:06:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:5/155: readlink d2/l11 0 2023-10-21T17:06:39.320 INFO:tasks.workunit.client.0.smithi012.stdout:6/194: rename d13/d15/f38 to d13/d15/d1d/d24/f3f 0 2023-10-21T17:06:39.370 INFO:tasks.workunit.client.0.smithi012.stdout:8/171: mkdir d0/d12/d40 0 2023-10-21T17:06:39.384 INFO:tasks.workunit.client.0.smithi012.stdout:6/195: dwrite d13/d15/f26 [0,4194304] 0 2023-10-21T17:06:39.385 INFO:tasks.workunit.client.0.smithi012.stdout:6/196: stat d13/f14 0 2023-10-21T17:06:39.625 INFO:tasks.workunit.client.0.smithi012.stdout:3/175: unlink d0/f1b 0 2023-10-21T17:06:39.963 INFO:tasks.workunit.client.0.smithi012.stdout:1/200: write d5/d32/d1b/d27/d1a/f1f [4627929,90471] 0 2023-10-21T17:06:40.067 INFO:tasks.workunit.client.0.smithi012.stdout:5/156: mknod d2/d6/c37 0 2023-10-21T17:06:40.074 INFO:tasks.workunit.client.0.smithi012.stdout:5/157: write d2/f27 [536990,99440] 0 2023-10-21T17:06:40.120 INFO:tasks.workunit.client.0.smithi012.stdout:5/158: dread d2/d6/f23 [0,4194304] 0 2023-10-21T17:06:40.244 INFO:tasks.workunit.client.0.smithi012.stdout:8/172: link d0/f26 d0/d1a/f41 0 2023-10-21T17:06:40.244 INFO:tasks.workunit.client.0.smithi012.stdout:0/214: mkdir d7/d52 0 2023-10-21T17:06:40.244 INFO:tasks.workunit.client.0.smithi012.stdout:8/173: truncate d0/f36 106643 0 2023-10-21T17:06:40.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/206: creat dc/f42 x:0 0 0 2023-10-21T17:06:40.769 INFO:tasks.workunit.client.0.smithi012.stdout:2/227: getdents d1/d14/d16/d20 0 2023-10-21T17:06:41.070 INFO:tasks.workunit.client.0.smithi012.stdout:9/186: rmdir d0/d15 39 2023-10-21T17:06:41.070 INFO:tasks.workunit.client.0.smithi012.stdout:9/187: truncate d0/d4/f2e 33769 0 2023-10-21T17:06:41.457 INFO:tasks.workunit.client.0.smithi012.stdout:3/176: creat d0/da/f34 x:0 0 0 2023-10-21T17:06:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:3/177: dwrite d0/d1c/f1e [0,4194304] 0 2023-10-21T17:06:41.556 INFO:tasks.workunit.client.0.smithi012.stdout:3/178: chown d0/fd 13172 1 2023-10-21T17:06:41.568 INFO:tasks.workunit.client.0.smithi012.stdout:3/179: dread d0/f15 [0,4194304] 0 2023-10-21T17:06:41.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/159: rename d2/dd/l9 to d2/d6/l38 0 2023-10-21T17:06:41.604 INFO:tasks.workunit.client.0.smithi012.stdout:5/160: write d2/d6/f23 [1041184,61383] 0 2023-10-21T17:06:41.958 INFO:tasks.workunit.client.0.smithi012.stdout:0/215: mkdir d7/d52/d53 0 2023-10-21T17:06:41.959 INFO:tasks.workunit.client.0.smithi012.stdout:0/216: dread - d7/d8/d23/d27/d40/d4c/f4d zero size 2023-10-21T17:06:41.959 INFO:tasks.workunit.client.0.smithi012.stdout:0/217: read - d7/d8/d23/d27/d40/d4c/f4d zero size 2023-10-21T17:06:42.976 INFO:tasks.workunit.client.0.smithi012.stdout:4/207: creat dc/d1e/d33/f43 x:0 0 0 2023-10-21T17:06:43.003 INFO:tasks.workunit.client.0.smithi012.stdout:4/208: dread dc/f11 [0,4194304] 0 2023-10-21T17:06:43.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/228: unlink d1/d8/d19/c32 0 2023-10-21T17:06:43.426 INFO:tasks.workunit.client.0.smithi012.stdout:7/215: sync 2023-10-21T17:06:43.723 INFO:tasks.workunit.client.0.smithi012.stdout:3/180: symlink d0/d32/l35 0 2023-10-21T17:06:44.013 INFO:tasks.workunit.client.0.smithi012.stdout:5/161: creat d2/d1d/d29/f39 x:0 0 0 2023-10-21T17:06:44.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/218: mknod d7/d8/d1f/c54 0 2023-10-21T17:06:44.520 INFO:tasks.workunit.client.0.smithi012.stdout:4/209: creat dc/d1e/f44 x:0 0 0 2023-10-21T17:06:44.640 INFO:tasks.workunit.client.0.smithi012.stdout:4/210: dwrite dc/d1e/d33/f43 [0,4194304] 0 2023-10-21T17:06:44.671 INFO:tasks.workunit.client.0.smithi012.stdout:4/211: dread f1 [0,4194304] 0 2023-10-21T17:06:45.017 INFO:tasks.workunit.client.0.smithi012.stdout:2/229: creat d1/d8/d19/d34/f45 x:0 0 0 2023-10-21T17:06:45.017 INFO:tasks.workunit.client.0.smithi012.stdout:1/201: truncate d5/d32/d1b/d27/f38 179401 0 2023-10-21T17:06:45.085 INFO:tasks.workunit.client.0.smithi012.stdout:1/202: dwrite d5/d26/f2f [0,4194304] 0 2023-10-21T17:06:45.085 INFO:tasks.workunit.client.0.smithi012.stdout:1/203: write f1 [1712245,111633] 0 2023-10-21T17:06:45.130 INFO:tasks.workunit.client.0.smithi012.stdout:7/216: symlink d3/d6/l3a 0 2023-10-21T17:06:45.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/217: dread d3/d29/f11 [0,4194304] 0 2023-10-21T17:06:45.198 INFO:tasks.workunit.client.0.smithi012.stdout:7/218: dread d3/f1d [0,4194304] 0 2023-10-21T17:06:45.218 INFO:tasks.workunit.client.0.smithi012.stdout:7/219: dread d3/d6/dc/d19/f22 [0,4194304] 0 2023-10-21T17:06:46.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/197: dwrite d13/d15/d1d/d24/f3f [0,4194304] 0 2023-10-21T17:06:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/198: dwrite f6 [0,4194304] 0 2023-10-21T17:06:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/199: fdatasync d13/d15/f21 0 2023-10-21T17:06:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/200: write d13/f14 [1556468,124543] 0 2023-10-21T17:06:46.787 INFO:tasks.workunit.client.0.smithi012.stdout:9/188: creat d0/f3e x:0 0 0 2023-10-21T17:06:46.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/204: creat d5/d32/d1b/d35/f3f x:0 0 0 2023-10-21T17:06:47.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/220: creat d3/d6/dc/d19/d28/f3b x:0 0 0 2023-10-21T17:06:47.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/221: creat d3/d6/dc/d19/d28/f3c x:0 0 0 2023-10-21T17:06:47.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/222: truncate d3/d6/dc/d19/d28/f3b 951382 0 2023-10-21T17:06:47.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/174: sync 2023-10-21T17:06:47.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/175: fsync d0/d1a/f3d 0 2023-10-21T17:06:48.250 INFO:tasks.workunit.client.0.smithi012.stdout:0/219: rename d7/d8 to d7/d55 0 2023-10-21T17:06:48.253 INFO:tasks.workunit.client.0.smithi012.stdout:0/220: read d7/d55/d9/f49 [84082,129192] 0 2023-10-21T17:06:48.253 INFO:tasks.workunit.client.0.smithi012.stdout:0/221: fsync d7/d55/d1f/f4a 0 2023-10-21T17:06:48.278 INFO:tasks.workunit.client.0.smithi012.stdout:0/222: read f5 [2054869,63829] 0 2023-10-21T17:06:48.306 INFO:tasks.workunit.client.0.smithi012.stdout:0/223: dread d7/d55/d1f/d28/f34 [0,4194304] 0 2023-10-21T17:06:48.533 INFO:tasks.workunit.client.0.smithi012.stdout:6/201: mkdir d13/d29/d40 0 2023-10-21T17:06:48.604 INFO:tasks.workunit.client.0.smithi012.stdout:6/202: dwrite d13/d15/f26 [0,4194304] 0 2023-10-21T17:06:48.815 INFO:tasks.workunit.client.0.smithi012.stdout:9/189: creat d0/d4/db/d12/d25/d39/d3b/f3f x:0 0 0 2023-10-21T17:06:48.905 INFO:tasks.workunit.client.0.smithi012.stdout:5/162: dwrite d2/f18 [0,4194304] 0 2023-10-21T17:06:49.340 INFO:tasks.workunit.client.0.smithi012.stdout:7/223: mknod d3/d29/c3d 0 2023-10-21T17:06:49.399 INFO:tasks.workunit.client.0.smithi012.stdout:0/224: mknod d7/d55/d23/d27/d40/d4c/c56 0 2023-10-21T17:06:49.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/190: rename d0/d5/c27 to d0/d5/c40 0 2023-10-21T17:06:49.449 INFO:tasks.workunit.client.0.smithi012.stdout:9/191: dread d0/d5/f22 [0,4194304] 0 2023-10-21T17:06:49.449 INFO:tasks.workunit.client.0.smithi012.stdout:9/192: chown d0/d5/f22 900 1 2023-10-21T17:06:49.450 INFO:tasks.workunit.client.0.smithi012.stdout:9/193: dread - d0/d4/db/d12/d2a/d36/f38 zero size 2023-10-21T17:06:49.451 INFO:tasks.workunit.client.0.smithi012.stdout:1/205: dwrite d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:06:49.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/224: symlink d3/d6/dc/d19/d1e/d34/l3e 0 2023-10-21T17:06:49.599 INFO:tasks.workunit.client.0.smithi012.stdout:7/225: dread d3/d16/f1a [0,4194304] 0 2023-10-21T17:06:49.640 INFO:tasks.workunit.client.0.smithi012.stdout:7/226: dread d3/d6/dc/f36 [0,4194304] 0 2023-10-21T17:06:49.738 INFO:tasks.workunit.client.0.smithi012.stdout:8/176: symlink d0/l42 0 2023-10-21T17:06:49.805 INFO:tasks.workunit.client.0.smithi012.stdout:0/225: creat d7/d55/d9/f57 x:0 0 0 2023-10-21T17:06:49.808 INFO:tasks.workunit.client.0.smithi012.stdout:4/212: write dc/d1e/d2b/f38 [406241,9983] 0 2023-10-21T17:06:49.808 INFO:tasks.workunit.client.0.smithi012.stdout:4/213: chown dc/d1e/l1d 1056 1 2023-10-21T17:06:49.842 INFO:tasks.workunit.client.0.smithi012.stdout:4/214: read dc/f17 [1131791,29470] 0 2023-10-21T17:06:49.843 INFO:tasks.workunit.client.0.smithi012.stdout:4/215: chown dc/d1e/d33/f43 112560 1 2023-10-21T17:06:49.926 INFO:tasks.workunit.client.0.smithi012.stdout:0/226: dwrite d7/d55/d1f/d28/f34 [0,4194304] 0 2023-10-21T17:06:49.927 INFO:tasks.workunit.client.0.smithi012.stdout:0/227: getdents d7/d55/d9/d48 0 2023-10-21T17:06:50.152 INFO:tasks.workunit.client.0.smithi012.stdout:9/194: readlink d0/df/l1f 0 2023-10-21T17:06:50.153 INFO:tasks.workunit.client.0.smithi012.stdout:9/195: fdatasync d0/d4/f2e 0 2023-10-21T17:06:50.244 INFO:tasks.workunit.client.0.smithi012.stdout:9/196: dwrite d0/d4/db/d12/d25/d39/d3b/f3f [0,4194304] 0 2023-10-21T17:06:50.444 INFO:tasks.workunit.client.0.smithi012.stdout:3/181: link d0/d1c/l25 d0/l36 0 2023-10-21T17:06:50.444 INFO:tasks.workunit.client.0.smithi012.stdout:3/182: creat d0/da/f37 x:0 0 0 2023-10-21T17:06:50.467 INFO:tasks.workunit.client.0.smithi012.stdout:3/183: dread d0/fd [0,4194304] 0 2023-10-21T17:06:50.511 INFO:tasks.workunit.client.0.smithi012.stdout:8/177: mknod d0/d12/d40/c43 0 2023-10-21T17:06:50.511 INFO:tasks.workunit.client.0.smithi012.stdout:8/178: stat d0/fe 0 2023-10-21T17:06:50.511 INFO:tasks.workunit.client.0.smithi012.stdout:8/179: stat d0/d29 0 2023-10-21T17:06:50.511 INFO:tasks.workunit.client.0.smithi012.stdout:8/180: truncate d0/d1a/f41 469282 0 2023-10-21T17:06:50.536 INFO:tasks.workunit.client.0.smithi012.stdout:8/181: write d0/fb [4986214,122326] 0 2023-10-21T17:06:50.818 INFO:tasks.workunit.client.0.smithi012.stdout:0/228: unlink d7/d55/d23/d27/d40/f45 0 2023-10-21T17:06:51.270 INFO:tasks.workunit.client.0.smithi012.stdout:3/184: creat d0/da/d28/f38 x:0 0 0 2023-10-21T17:06:51.303 INFO:tasks.workunit.client.0.smithi012.stdout:8/182: unlink d0/d29/l2e 0 2023-10-21T17:06:51.576 INFO:tasks.workunit.client.0.smithi012.stdout:0/229: symlink d7/d55/d23/d27/d40/d4c/l58 0 2023-10-21T17:06:52.018 INFO:tasks.workunit.client.0.smithi012.stdout:3/185: unlink d0/f11 0 2023-10-21T17:06:52.214 INFO:tasks.workunit.client.0.smithi012.stdout:0/230: write d7/d55/f3b [2792521,51448] 0 2023-10-21T17:06:52.384 INFO:tasks.workunit.client.0.smithi012.stdout:3/186: symlink d0/da/l39 0 2023-10-21T17:06:52.384 INFO:tasks.workunit.client.0.smithi012.stdout:3/187: chown d0/l8 2 1 2023-10-21T17:06:52.562 INFO:tasks.workunit.client.0.smithi012.stdout:3/188: symlink d0/d1c/l3a 0 2023-10-21T17:06:52.563 INFO:tasks.workunit.client.0.smithi012.stdout:3/189: write d0/da/f18 [88875,53303] 0 2023-10-21T17:06:53.016 INFO:tasks.workunit.client.0.smithi012.stdout:3/190: creat d0/f3b x:0 0 0 2023-10-21T17:06:53.524 INFO:tasks.workunit.client.0.smithi012.stdout:6/203: write d13/d35/f3a [1638109,453] 0 2023-10-21T17:06:53.524 INFO:tasks.workunit.client.0.smithi012.stdout:6/204: write d13/d15/f1a [52765,123971] 0 2023-10-21T17:06:53.740 INFO:tasks.workunit.client.0.smithi012.stdout:9/197: dwrite d0/d4/db/d12/d2a/f3a [0,4194304] 0 2023-10-21T17:06:53.740 INFO:tasks.workunit.client.0.smithi012.stdout:3/191: fsync d0/da/f37 0 2023-10-21T17:06:53.741 INFO:tasks.workunit.client.0.smithi012.stdout:5/163: unlink d2/f27 0 2023-10-21T17:06:53.843 INFO:tasks.workunit.client.0.smithi012.stdout:5/164: dwrite d2/f18 [0,4194304] 0 2023-10-21T17:06:54.108 INFO:tasks.workunit.client.0.smithi012.stdout:2/230: rename d1/d8/f13 to d1/d14/d17/f46 0 2023-10-21T17:06:54.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/183: write d0/f4 [796520,104175] 0 2023-10-21T17:06:54.114 INFO:tasks.workunit.client.0.smithi012.stdout:2/231: dread d1/d14/d16/d20/f3b [0,4194304] 0 2023-10-21T17:06:54.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/184: write d0/f4 [268828,71771] 0 2023-10-21T17:06:54.134 INFO:tasks.workunit.client.0.smithi012.stdout:0/231: write d7/d55/d9/f1e [49851,98786] 0 2023-10-21T17:06:54.706 INFO:tasks.workunit.client.0.smithi012.stdout:9/198: mknod d0/d4/db/d12/d2a/c41 0 2023-10-21T17:06:54.706 INFO:tasks.workunit.client.0.smithi012.stdout:9/199: chown d0/d4/db/d12/d2a/d36/f38 25298087 1 2023-10-21T17:06:54.931 INFO:tasks.workunit.client.0.smithi012.stdout:5/165: rmdir d2/d1d 39 2023-10-21T17:06:55.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/232: creat d7/d55/d1f/d28/f59 x:0 0 0 2023-10-21T17:06:55.397 INFO:tasks.workunit.client.0.smithi012.stdout:0/233: readlink d7/ld 0 2023-10-21T17:06:55.397 INFO:tasks.workunit.client.0.smithi012.stdout:0/234: dread - d7/d55/d1f/f50 zero size 2023-10-21T17:06:55.471 INFO:tasks.workunit.client.0.smithi012.stdout:0/235: dwrite d7/d55/f3b [0,4194304] 0 2023-10-21T17:06:55.472 INFO:tasks.workunit.client.0.smithi012.stdout:0/236: truncate d7/d55/d1f/f2e 778278 0 2023-10-21T17:06:55.900 INFO:tasks.workunit.client.0.smithi012.stdout:9/200: creat d0/df/f42 x:0 0 0 2023-10-21T17:06:56.075 INFO:tasks.workunit.client.0.smithi012.stdout:1/206: rename d5/d26/d29/fd to d5/d26/f40 0 2023-10-21T17:06:56.234 INFO:tasks.workunit.client.0.smithi012.stdout:2/232: getdents d1/d14/d17 0 2023-10-21T17:06:56.761 INFO:tasks.workunit.client.0.smithi012.stdout:0/237: creat d7/d55/f5a x:0 0 0 2023-10-21T17:06:56.826 INFO:tasks.workunit.client.0.smithi012.stdout:9/201: creat d0/df/f43 x:0 0 0 2023-10-21T17:06:57.001 INFO:tasks.workunit.client.0.smithi012.stdout:6/205: truncate d13/d15/f21 224737 0 2023-10-21T17:06:57.002 INFO:tasks.workunit.client.0.smithi012.stdout:6/206: chown d13/d29/d37 5 1 2023-10-21T17:06:57.377 INFO:tasks.workunit.client.0.smithi012.stdout:1/207: mknod d5/d32/d1b/d27/c41 0 2023-10-21T17:06:57.377 INFO:tasks.workunit.client.0.smithi012.stdout:2/233: truncate d1/d8/ff 3841642 0 2023-10-21T17:06:57.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/185: link d0/d12/l18 d0/l44 0 2023-10-21T17:06:57.845 INFO:tasks.workunit.client.0.smithi012.stdout:6/207: mknod d13/d15/d1d/d24/c41 0 2023-10-21T17:06:57.846 INFO:tasks.workunit.client.0.smithi012.stdout:7/227: rename d3/d6/f25 to d3/f3f 0 2023-10-21T17:06:57.846 INFO:tasks.workunit.client.0.smithi012.stdout:6/208: write f10 [82744,59348] 0 2023-10-21T17:06:58.343 INFO:tasks.workunit.client.0.smithi012.stdout:1/208: truncate d5/d26/d29/f3b 340953 0 2023-10-21T17:06:58.343 INFO:tasks.workunit.client.0.smithi012.stdout:1/209: chown d5/d26/f40 1090184 1 2023-10-21T17:06:58.343 INFO:tasks.workunit.client.0.smithi012.stdout:1/210: creat d5/d32/d1b/d27/f42 x:0 0 0 2023-10-21T17:06:58.344 INFO:tasks.workunit.client.0.smithi012.stdout:1/211: dread - d5/d32/d1b/d35/d3a/f3d zero size 2023-10-21T17:06:58.344 INFO:tasks.workunit.client.0.smithi012.stdout:1/212: stat d5/d26/f2f 0 2023-10-21T17:06:58.841 INFO:tasks.workunit.client.0.smithi012.stdout:9/202: mkdir d0/df/d44 0 2023-10-21T17:06:58.853 INFO:tasks.workunit.client.0.smithi012.stdout:7/228: mknod d3/c40 0 2023-10-21T17:06:59.479 INFO:tasks.workunit.client.0.smithi012.stdout:2/234: truncate d1/d14/d16/f27 349643 0 2023-10-21T17:06:59.577 INFO:tasks.workunit.client.0.smithi012.stdout:8/186: symlink d0/d12/l45 0 2023-10-21T17:06:59.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/203: symlink d0/d4/db/d12/d25/d2f/l45 0 2023-10-21T17:07:00.228 INFO:tasks.workunit.client.0.smithi012.stdout:7/229: rmdir d3/d6/dc/d19/d1e/d34 39 2023-10-21T17:07:00.229 INFO:tasks.workunit.client.0.smithi012.stdout:4/216: rename dc/d15/d18/l39 to dc/d28/l45 0 2023-10-21T17:07:00.251 INFO:tasks.workunit.client.0.smithi012.stdout:1/213: mkdir d5/d26/d29/d43 0 2023-10-21T17:07:00.252 INFO:tasks.workunit.client.0.smithi012.stdout:2/235: link d1/d14/d16/d22/f36 d1/d14/f47 0 2023-10-21T17:07:00.252 INFO:tasks.workunit.client.0.smithi012.stdout:2/236: dread - d1/d8/f3d zero size 2023-10-21T17:07:00.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/209: read d13/d15/f21 [112805,25422] 0 2023-10-21T17:07:00.275 INFO:tasks.workunit.client.0.smithi012.stdout:9/204: rename d0/d5/c40 to d0/d5/c46 0 2023-10-21T17:07:00.641 INFO:tasks.workunit.client.0.smithi012.stdout:7/230: truncate d3/f1d 2480524 0 2023-10-21T17:07:00.641 INFO:tasks.workunit.client.0.smithi012.stdout:7/231: readlink l2 0 2023-10-21T17:07:01.027 INFO:tasks.workunit.client.0.smithi012.stdout:1/214: chown d5/d26/d29/l16 0 1 2023-10-21T17:07:01.141 INFO:tasks.workunit.client.0.smithi012.stdout:8/187: mkdir d0/d46 0 2023-10-21T17:07:01.141 INFO:tasks.workunit.client.0.smithi012.stdout:8/188: fdatasync d0/d1a/f3d 0 2023-10-21T17:07:01.540 INFO:tasks.workunit.client.0.smithi012.stdout:9/205: fsync d0/df/f11 0 2023-10-21T17:07:01.541 INFO:tasks.workunit.client.0.smithi012.stdout:9/206: truncate d0/d15/f30 846700 0 2023-10-21T17:07:01.742 INFO:tasks.workunit.client.0.smithi012.stdout:7/232: getdents d3/d6/dc/d19 0 2023-10-21T17:07:01.772 INFO:tasks.workunit.client.0.smithi012.stdout:7/233: dread d3/d16/f31 [0,4194304] 0 2023-10-21T17:07:01.934 INFO:tasks.workunit.client.0.smithi012.stdout:4/217: rmdir dc/d15/d18 39 2023-10-21T17:07:02.056 INFO:tasks.workunit.client.0.smithi012.stdout:1/215: mknod d5/d26/d29/d43/c44 0 2023-10-21T17:07:02.300 INFO:tasks.workunit.client.0.smithi012.stdout:9/207: dread d0/f8 [0,4194304] 0 2023-10-21T17:07:02.398 INFO:tasks.workunit.client.0.smithi012.stdout:7/234: creat d3/f41 x:0 0 0 2023-10-21T17:07:02.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/235: truncate d3/f3f 449627 0 2023-10-21T17:07:02.558 INFO:tasks.workunit.client.0.smithi012.stdout:4/218: creat dc/d15/d2a/d31/d36/f46 x:0 0 0 2023-10-21T17:07:02.652 INFO:tasks.workunit.client.0.smithi012.stdout:1/216: mknod d5/d26/d29/d43/c45 0 2023-10-21T17:07:02.665 INFO:tasks.workunit.client.0.smithi012.stdout:1/217: dread d5/f14 [0,4194304] 0 2023-10-21T17:07:02.665 INFO:tasks.workunit.client.0.smithi012.stdout:1/218: dread - d5/d32/d1b/d27/f42 zero size 2023-10-21T17:07:02.795 INFO:tasks.workunit.client.0.smithi012.stdout:8/189: symlink d0/l47 0 2023-10-21T17:07:03.616 INFO:tasks.workunit.client.0.smithi012.stdout:2/237: write d1/d8/ff [1119991,31320] 0 2023-10-21T17:07:03.616 INFO:tasks.workunit.client.0.smithi012.stdout:2/238: chown d1/d8/d25/l43 1095 1 2023-10-21T17:07:03.616 INFO:tasks.workunit.client.0.smithi012.stdout:2/239: read - d1/d14/d16/d22/f39 zero size 2023-10-21T17:07:03.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:07:03.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:07:04.042 INFO:tasks.workunit.client.0.smithi012.stdout:7/236: symlink d3/d6/dc/d19/d28/l42 0 2023-10-21T17:07:04.147 INFO:tasks.workunit.client.0.smithi012.stdout:3/192: rename d0/da/f18 to d0/da/d28/f3c 0 2023-10-21T17:07:04.519 INFO:tasks.workunit.client.0.smithi012.stdout:1/219: mkdir d5/d32/d1b/d27/d1a/d46 0 2023-10-21T17:07:04.761 INFO:tasks.workunit.client.0.smithi012.stdout:2/240: mknod d1/d14/d16/d22/c48 0 2023-10-21T17:07:04.762 INFO:tasks.workunit.client.0.smithi012.stdout:2/241: truncate d1/d8/f28 84307 0 2023-10-21T17:07:05.139 INFO:tasks.workunit.client.0.smithi012.stdout:3/193: readlink d0/l31 0 2023-10-21T17:07:05.139 INFO:tasks.workunit.client.0.smithi012.stdout:7/237: write d3/d6/dc/d19/d28/f3b [1749563,130709] 0 2023-10-21T17:07:05.140 INFO:tasks.workunit.client.0.smithi012.stdout:5/166: rename d2/d1d/l31 to d2/d1d/d29/l3a 0 2023-10-21T17:07:05.177 INFO:tasks.workunit.client.0.smithi012.stdout:5/167: dread d2/d6/f7 [0,4194304] 0 2023-10-21T17:07:05.226 INFO:tasks.workunit.client.0.smithi012.stdout:1/220: mkdir d5/d32/d1b/d27/d47 0 2023-10-21T17:07:05.402 INFO:tasks.workunit.client.0.smithi012.stdout:8/190: link d0/l6 d0/l48 0 2023-10-21T17:07:05.403 INFO:tasks.workunit.client.0.smithi012.stdout:8/191: truncate d0/d1a/f33 637468 0 2023-10-21T17:07:05.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/242: unlink d1/d14/d16/d22/f36 0 2023-10-21T17:07:05.875 INFO:tasks.workunit.client.0.smithi012.stdout:7/238: mkdir d3/d6/dc/d19/d43 0 2023-10-21T17:07:06.164 INFO:tasks.workunit.client.0.smithi012.stdout:0/238: rename d7/d55/d1f/d28/l3a to d7/d55/d23/d27/d40/d4c/l5b 0 2023-10-21T17:07:06.164 INFO:tasks.workunit.client.0.smithi012.stdout:0/239: readlink d7/l13 0 2023-10-21T17:07:06.340 INFO:tasks.workunit.client.0.smithi012.stdout:5/168: dread d2/dd/fc [0,4194304] 0 2023-10-21T17:07:06.409 INFO:tasks.workunit.client.0.smithi012.stdout:1/221: dread d5/d26/d29/f3b [0,4194304] 0 2023-10-21T17:07:06.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/243: unlink d1/d14/d17/f46 0 2023-10-21T17:07:06.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/244: dread - d1/d8/f2d zero size 2023-10-21T17:07:06.878 INFO:tasks.workunit.client.0.smithi012.stdout:3/194: creat d0/da/f3d x:0 0 0 2023-10-21T17:07:07.076 INFO:tasks.workunit.client.0.smithi012.stdout:7/239: mknod d3/d6/dc/d19/d1e/c44 0 2023-10-21T17:07:07.077 INFO:tasks.workunit.client.0.smithi012.stdout:7/240: creat d3/d29/f45 x:0 0 0 2023-10-21T17:07:07.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/241: dwrite d3/d29/f26 [0,4194304] 0 2023-10-21T17:07:07.270 INFO:tasks.workunit.client.0.smithi012.stdout:0/240: truncate d7/f10 3422347 0 2023-10-21T17:07:07.270 INFO:tasks.workunit.client.0.smithi012.stdout:0/241: chown d7/d55/d23/d27/d31/f32 857221 1 2023-10-21T17:07:07.271 INFO:tasks.workunit.client.0.smithi012.stdout:0/242: write d7/d55/d23/d27/d31/f3e [69991,43729] 0 2023-10-21T17:07:07.403 INFO:tasks.workunit.client.0.smithi012.stdout:5/169: mknod d2/dd/d15/c3b 0 2023-10-21T17:07:07.607 INFO:tasks.workunit.client.0.smithi012.stdout:1/222: mkdir d5/d32/d1b/d2c/d48 0 2023-10-21T17:07:07.607 INFO:tasks.workunit.client.0.smithi012.stdout:8/192: mknod d0/d12/c49 0 2023-10-21T17:07:07.788 INFO:tasks.workunit.client.0.smithi012.stdout:2/245: dread d1/d14/d16/f27 [0,4194304] 0 2023-10-21T17:07:07.788 INFO:tasks.workunit.client.0.smithi012.stdout:2/246: fdatasync d1/d14/d17/f1f 0 2023-10-21T17:07:07.820 INFO:tasks.workunit.client.0.smithi012.stdout:9/208: sync 2023-10-21T17:07:07.821 INFO:tasks.workunit.client.0.smithi012.stdout:9/209: dread - d0/df/f42 zero size 2023-10-21T17:07:08.362 INFO:tasks.workunit.client.0.smithi012.stdout:7/242: symlink d3/d16/l46 0 2023-10-21T17:07:08.436 INFO:tasks.workunit.client.0.smithi012.stdout:7/243: dwrite d3/d16/f1a [0,4194304] 0 2023-10-21T17:07:09.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/243: symlink d7/d52/l5c 0 2023-10-21T17:07:09.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/244: truncate d7/f35 972624 0 2023-10-21T17:07:09.172 INFO:tasks.workunit.client.0.smithi012.stdout:0/245: read d7/d55/d1f/f4a [195886,105752] 0 2023-10-21T17:07:10.263 INFO:tasks.workunit.client.0.smithi012.stdout:1/223: mkdir d5/d32/d1b/d35/d49 0 2023-10-21T17:07:10.366 INFO:tasks.workunit.client.0.smithi012.stdout:9/210: getdents d0/d4/db 0 2023-10-21T17:07:10.366 INFO:tasks.workunit.client.0.smithi012.stdout:9/211: truncate d0/f3e 512662 0 2023-10-21T17:07:10.366 INFO:tasks.workunit.client.0.smithi012.stdout:9/212: fsync d0/f14 0 2023-10-21T17:07:10.437 INFO:tasks.workunit.client.0.smithi012.stdout:3/195: mknod d0/c3e 0 2023-10-21T17:07:10.508 INFO:tasks.workunit.client.0.smithi012.stdout:3/196: dwrite d0/da/f1f [0,4194304] 0 2023-10-21T17:07:10.508 INFO:tasks.workunit.client.0.smithi012.stdout:3/197: chown d0/da/l10 201834413 1 2023-10-21T17:07:10.910 INFO:tasks.workunit.client.0.smithi012.stdout:7/244: stat d3/d6/le 0 2023-10-21T17:07:11.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/224: symlink d5/d32/l4a 0 2023-10-21T17:07:11.696 INFO:tasks.workunit.client.0.smithi012.stdout:9/213: mkdir d0/d15/d47 0 2023-10-21T17:07:12.288 INFO:tasks.workunit.client.0.smithi012.stdout:7/245: mknod d3/d6/dc/d19/d28/c47 0 2023-10-21T17:07:12.288 INFO:tasks.workunit.client.0.smithi012.stdout:6/210: rename d13/d29/d40 to d13/d42 0 2023-10-21T17:07:12.307 INFO:tasks.workunit.client.0.smithi012.stdout:7/246: dread d3/d29/f11 [0,4194304] 0 2023-10-21T17:07:12.409 INFO:tasks.workunit.client.0.smithi012.stdout:1/225: mkdir d5/d32/d1b/d2c/d4b 0 2023-10-21T17:07:12.431 INFO:tasks.workunit.client.0.smithi012.stdout:2/247: write d1/d14/d16/f27 [912257,73592] 0 2023-10-21T17:07:12.579 INFO:tasks.workunit.client.0.smithi012.stdout:9/214: creat d0/d4/db/d12/f48 x:0 0 0 2023-10-21T17:07:12.906 INFO:tasks.workunit.client.0.smithi012.stdout:6/211: truncate f6 500839 0 2023-10-21T17:07:13.112 INFO:tasks.workunit.client.0.smithi012.stdout:7/247: dread d3/f1d [0,4194304] 0 2023-10-21T17:07:13.614 INFO:tasks.workunit.client.0.smithi012.stdout:4/219: rename dc/d28/f2c to dc/d15/f47 0 2023-10-21T17:07:13.696 INFO:tasks.workunit.client.0.smithi012.stdout:4/220: dwrite dc/f42 [0,4194304] 0 2023-10-21T17:07:13.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/212: symlink d13/d42/l43 0 2023-10-21T17:07:13.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/213: chown d13/d15/d1d/d28/l3d 3766 1 2023-10-21T17:07:13.987 INFO:tasks.workunit.client.0.smithi012.stdout:8/193: unlink d0/l6 0 2023-10-21T17:07:13.987 INFO:tasks.workunit.client.0.smithi012.stdout:7/248: mknod d3/d6/dc/d19/d43/c48 0 2023-10-21T17:07:14.608 INFO:tasks.workunit.client.0.smithi012.stdout:2/248: mknod d1/d4/c49 0 2023-10-21T17:07:14.897 INFO:tasks.workunit.client.0.smithi012.stdout:5/170: sync 2023-10-21T17:07:15.119 INFO:tasks.workunit.client.0.smithi012.stdout:1/226: rmdir d5/d32 39 2023-10-21T17:07:15.120 INFO:tasks.workunit.client.0.smithi012.stdout:0/246: rename d7/d55/d23/d27/d40/d4c/f4d to d7/d55/d23/d27/f5d 0 2023-10-21T17:07:15.120 INFO:tasks.workunit.client.0.smithi012.stdout:1/227: write d5/d32/d1b/d27/d1a/f1f [7419516,18927] 0 2023-10-21T17:07:15.648 INFO:tasks.workunit.client.0.smithi012.stdout:7/249: rmdir d3 39 2023-10-21T17:07:15.648 INFO:tasks.workunit.client.0.smithi012.stdout:8/194: mkdir d0/d12/d40/d4a 0 2023-10-21T17:07:15.648 INFO:tasks.workunit.client.0.smithi012.stdout:7/250: write d3/d6/dc/d19/d28/f3c [1035349,62911] 0 2023-10-21T17:07:16.309 INFO:tasks.workunit.client.0.smithi012.stdout:3/198: dwrite d0/f4 [0,4194304] 0 2023-10-21T17:07:16.310 INFO:tasks.workunit.client.0.smithi012.stdout:3/199: read - d0/da/f37 zero size 2023-10-21T17:07:16.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/221: rename dc/d1e/c2d to dc/d15/c48 0 2023-10-21T17:07:16.468 INFO:tasks.workunit.client.0.smithi012.stdout:9/215: write d0/f8 [1822045,121839] 0 2023-10-21T17:07:16.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/222: fsync dc/f17 0 2023-10-21T17:07:16.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/223: truncate dc/d1e/f3c 650126 0 2023-10-21T17:07:16.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/224: dwrite dc/d15/f32 [0,4194304] 0 2023-10-21T17:07:16.629 INFO:tasks.workunit.client.0.smithi012.stdout:1/228: symlink d5/d32/d1b/d35/d49/l4c 0 2023-10-21T17:07:17.627 INFO:tasks.workunit.client.0.smithi012.stdout:2/249: mkdir d1/d4/d3f/d4a 0 2023-10-21T17:07:17.718 INFO:tasks.workunit.client.0.smithi012.stdout:3/200: stat d0/d1c/l1d 0 2023-10-21T17:07:17.876 INFO:tasks.workunit.client.0.smithi012.stdout:6/214: rename d13/d15/d1d/f30 to d13/d29/d37/f44 0 2023-10-21T17:07:18.107 INFO:tasks.workunit.client.0.smithi012.stdout:9/216: symlink d0/d15/l49 0 2023-10-21T17:07:18.609 INFO:tasks.workunit.client.0.smithi012.stdout:5/171: write d2/dd/fc [2006302,76718] 0 2023-10-21T17:07:18.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/247: mknod d7/d55/c5e 0 2023-10-21T17:07:18.675 INFO:tasks.workunit.client.0.smithi012.stdout:7/251: sync 2023-10-21T17:07:18.698 INFO:tasks.workunit.client.0.smithi012.stdout:1/229: getdents d5/d32 0 2023-10-21T17:07:18.735 INFO:tasks.workunit.client.0.smithi012.stdout:8/195: dwrite d0/f36 [0,4194304] 0 2023-10-21T17:07:19.078 INFO:tasks.workunit.client.0.smithi012.stdout:2/250: creat d1/d8/d35/f4b x:0 0 0 2023-10-21T17:07:19.214 INFO:tasks.workunit.client.0.smithi012.stdout:3/201: write d0/f7 [2849596,121719] 0 2023-10-21T17:07:19.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/225: rename dc/f10 to dc/d15/d2a/d31/f49 0 2023-10-21T17:07:19.429 INFO:tasks.workunit.client.0.smithi012.stdout:6/215: creat d13/d15/d1d/d24/f45 x:0 0 0 2023-10-21T17:07:19.455 INFO:tasks.workunit.client.0.smithi012.stdout:6/216: dread d13/d15/f2b [0,4194304] 0 2023-10-21T17:07:19.707 INFO:tasks.workunit.client.0.smithi012.stdout:9/217: link d0/d15/l49 d0/d4/db/d12/d25/d2f/l4a 0 2023-10-21T17:07:19.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/172: link d2/dd/d15/c3b d2/dd/c3c 0 2023-10-21T17:07:19.707 INFO:tasks.workunit.client.0.smithi012.stdout:9/218: truncate d0/d4/db/d12/d2a/f3a 4758859 0 2023-10-21T17:07:19.788 INFO:tasks.workunit.client.0.smithi012.stdout:7/252: unlink d3/d16/l46 0 2023-10-21T17:07:19.788 INFO:tasks.workunit.client.0.smithi012.stdout:7/253: chown d3/d6/dc/f36 2007410 1 2023-10-21T17:07:19.996 INFO:tasks.workunit.client.0.smithi012.stdout:1/230: truncate d5/d32/d1b/d27/d1a/f1d 3738264 0 2023-10-21T17:07:20.003 INFO:tasks.workunit.client.0.smithi012.stdout:1/231: write d5/d32/d1b/d27/d21/f37 [486733,111646] 0 2023-10-21T17:07:20.888 INFO:tasks.workunit.client.0.smithi012.stdout:3/202: stat d0/cc 0 2023-10-21T17:07:21.452 INFO:tasks.workunit.client.0.smithi012.stdout:0/248: rename d7/d55/d23/d27/d40/d4c to d7/d55/d23/d27/d31/d5f 0 2023-10-21T17:07:21.548 INFO:tasks.workunit.client.0.smithi012.stdout:0/249: dwrite d7/d55/d9/f37 [0,4194304] 0 2023-10-21T17:07:21.731 INFO:tasks.workunit.client.0.smithi012.stdout:6/217: mknod d13/d35/c46 0 2023-10-21T17:07:22.065 INFO:tasks.workunit.client.0.smithi012.stdout:2/251: dwrite d1/f2a [0,4194304] 0 2023-10-21T17:07:22.358 INFO:tasks.workunit.client.0.smithi012.stdout:9/219: mkdir d0/d4/d4b 0 2023-10-21T17:07:22.466 INFO:tasks.workunit.client.0.smithi012.stdout:7/254: dread d3/f3f [0,4194304] 0 2023-10-21T17:07:22.485 INFO:tasks.workunit.client.0.smithi012.stdout:7/255: dread d3/f1d [0,4194304] 0 2023-10-21T17:07:22.866 INFO:tasks.workunit.client.0.smithi012.stdout:8/196: getdents d0/d12/d40 0 2023-10-21T17:07:23.075 INFO:tasks.workunit.client.0.smithi012.stdout:1/232: dwrite d5/d32/d1b/d27/d1a/f1d [0,4194304] 0 2023-10-21T17:07:23.184 INFO:tasks.workunit.client.0.smithi012.stdout:3/203: rename d0/da/f37 to d0/d1c/f3f 0 2023-10-21T17:07:23.184 INFO:tasks.workunit.client.0.smithi012.stdout:3/204: dread - d0/da/d28/f2c zero size 2023-10-21T17:07:23.184 INFO:tasks.workunit.client.0.smithi012.stdout:3/205: fsync d0/da/d28/f29 0 2023-10-21T17:07:23.185 INFO:tasks.workunit.client.0.smithi012.stdout:3/206: write d0/da/f3d [1023171,98416] 0 2023-10-21T17:07:23.499 INFO:tasks.workunit.client.0.smithi012.stdout:4/226: sync 2023-10-21T17:07:23.999 INFO:tasks.workunit.client.0.smithi012.stdout:6/218: creat d13/f47 x:0 0 0 2023-10-21T17:07:24.016 INFO:tasks.workunit.client.0.smithi012.stdout:2/252: dread d1/d14/d16/f27 [0,4194304] 0 2023-10-21T17:07:24.089 INFO:tasks.workunit.client.0.smithi012.stdout:5/173: rmdir d2/d1d/d29 39 2023-10-21T17:07:24.285 INFO:tasks.workunit.client.0.smithi012.stdout:7/256: mknod d3/d6/dc/d19/c49 0 2023-10-21T17:07:24.667 INFO:tasks.workunit.client.0.smithi012.stdout:9/220: rename d0/d15/f30 to d0/d4/d4b/f4c 0 2023-10-21T17:07:24.842 INFO:tasks.workunit.client.0.smithi012.stdout:3/207: link d0/da/f1f d0/da/d28/f40 0 2023-10-21T17:07:24.862 INFO:tasks.workunit.client.0.smithi012.stdout:4/227: mknod dc/c4a 0 2023-10-21T17:07:24.872 INFO:tasks.workunit.client.0.smithi012.stdout:0/250: sync 2023-10-21T17:07:24.897 INFO:tasks.workunit.client.0.smithi012.stdout:0/251: dread d7/d55/d9/f49 [0,4194304] 0 2023-10-21T17:07:25.046 INFO:tasks.workunit.client.0.smithi012.stdout:6/219: dread f8 [0,4194304] 0 2023-10-21T17:07:25.107 INFO:tasks.workunit.client.0.smithi012.stdout:6/220: dwrite d13/d35/f3a [0,4194304] 0 2023-10-21T17:07:25.108 INFO:tasks.workunit.client.0.smithi012.stdout:6/221: write d13/f14 [1845681,127328] 0 2023-10-21T17:07:25.108 INFO:tasks.workunit.client.0.smithi012.stdout:6/222: chown d13/c17 120412 1 2023-10-21T17:07:25.496 INFO:tasks.workunit.client.0.smithi012.stdout:5/174: creat d2/dd/d15/f3d x:0 0 0 2023-10-21T17:07:25.582 INFO:tasks.workunit.client.0.smithi012.stdout:7/257: rmdir d3/d6/dc 39 2023-10-21T17:07:25.612 INFO:tasks.workunit.client.0.smithi012.stdout:1/233: rename d5/d32/d1b/d27/d1a/f1f to d5/d32/d1b/d27/d1a/d46/f4d 0 2023-10-21T17:07:25.612 INFO:tasks.workunit.client.0.smithi012.stdout:9/221: symlink d0/d4/d4b/l4d 0 2023-10-21T17:07:25.631 INFO:tasks.workunit.client.0.smithi012.stdout:4/228: creat dc/d1e/f4b x:0 0 0 2023-10-21T17:07:25.631 INFO:tasks.workunit.client.0.smithi012.stdout:4/229: chown dc/f3b 5294818 1 2023-10-21T17:07:25.651 INFO:tasks.workunit.client.0.smithi012.stdout:0/252: mkdir d7/d60 0 2023-10-21T17:07:25.692 INFO:tasks.workunit.client.0.smithi012.stdout:4/230: dwrite fb [0,4194304] 0 2023-10-21T17:07:25.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/175: getdents d2/dd 0 2023-10-21T17:07:25.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/176: chown d2/dd/d15/l1b 82487958 1 2023-10-21T17:07:25.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/177: stat d2/dd/d15/c14 0 2023-10-21T17:07:25.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/178: write d2/d6/f23 [1625987,77801] 0 2023-10-21T17:07:26.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/258: getdents d3/d6/dc 0 2023-10-21T17:07:26.029 INFO:tasks.workunit.client.0.smithi012.stdout:5/179: dread d2/f18 [0,4194304] 0 2023-10-21T17:07:26.095 INFO:tasks.workunit.client.0.smithi012.stdout:6/223: rename fa to d13/d35/f48 0 2023-10-21T17:07:26.096 INFO:tasks.workunit.client.0.smithi012.stdout:6/224: read f8 [288715,108160] 0 2023-10-21T17:07:26.143 INFO:tasks.workunit.client.0.smithi012.stdout:1/234: creat d5/d32/d1b/d27/d21/f4e x:0 0 0 2023-10-21T17:07:26.143 INFO:tasks.workunit.client.0.smithi012.stdout:3/208: mknod d0/d32/c41 0 2023-10-21T17:07:26.169 INFO:tasks.workunit.client.0.smithi012.stdout:1/235: dread f1 [0,4194304] 0 2023-10-21T17:07:26.277 INFO:tasks.workunit.client.0.smithi012.stdout:1/236: dwrite d5/f39 [0,4194304] 0 2023-10-21T17:07:26.301 INFO:tasks.workunit.client.0.smithi012.stdout:1/237: dread d5/ff [0,4194304] 0 2023-10-21T17:07:26.301 INFO:tasks.workunit.client.0.smithi012.stdout:1/238: chown d5/d32/d1b/d27/c34 53237169 1 2023-10-21T17:07:26.555 INFO:tasks.workunit.client.0.smithi012.stdout:4/231: mkdir dc/d15/d18/d4c 0 2023-10-21T17:07:26.555 INFO:tasks.workunit.client.0.smithi012.stdout:4/232: fdatasync dc/f3b 0 2023-10-21T17:07:26.556 INFO:tasks.workunit.client.0.smithi012.stdout:4/233: dread - dc/d15/d2a/d31/d36/f46 zero size 2023-10-21T17:07:27.343 INFO:tasks.workunit.client.0.smithi012.stdout:5/180: mkdir d2/d3e 0 2023-10-21T17:07:27.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/222: rename d0/l29 to d0/d4/db/d12/d25/l4e 0 2023-10-21T17:07:27.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/223: chown d0/d4/db/d12/d25/l34 947999 1 2023-10-21T17:07:27.884 INFO:tasks.workunit.client.0.smithi012.stdout:6/225: symlink d13/d29/l49 0 2023-10-21T17:07:27.884 INFO:tasks.workunit.client.0.smithi012.stdout:6/226: dread - d13/f36 zero size 2023-10-21T17:07:27.905 INFO:tasks.workunit.client.0.smithi012.stdout:9/224: dwrite d0/d4/db/d12/f48 [0,4194304] 0 2023-10-21T17:07:27.906 INFO:tasks.workunit.client.0.smithi012.stdout:9/225: write d0/d4/db/d12/f31 [4471859,53538] 0 2023-10-21T17:07:27.921 INFO:tasks.workunit.client.0.smithi012.stdout:3/209: getdents d0/da 0 2023-10-21T17:07:28.108 INFO:tasks.workunit.client.0.smithi012.stdout:2/253: dwrite d1/d8/f10 [0,4194304] 0 2023-10-21T17:07:28.109 INFO:tasks.workunit.client.0.smithi012.stdout:2/254: write d1/fe [5090285,45446] 0 2023-10-21T17:07:28.220 INFO:tasks.workunit.client.0.smithi012.stdout:8/197: dwrite d0/d12/f37 [0,4194304] 0 2023-10-21T17:07:28.469 INFO:tasks.workunit.client.0.smithi012.stdout:1/239: fsync d5/d32/d1b/d27/d21/f4e 0 2023-10-21T17:07:28.543 INFO:tasks.workunit.client.0.smithi012.stdout:0/253: write d7/f35 [947273,77076] 0 2023-10-21T17:07:28.632 INFO:tasks.workunit.client.0.smithi012.stdout:5/181: link d2/d6/l13 d2/dd/d15/l3f 0 2023-10-21T17:07:28.754 INFO:tasks.workunit.client.0.smithi012.stdout:6/227: getdents d13/d29/d37 0 2023-10-21T17:07:28.755 INFO:tasks.workunit.client.0.smithi012.stdout:6/228: readlink d13/d42/l43 0 2023-10-21T17:07:29.647 INFO:tasks.workunit.client.0.smithi012.stdout:2/255: creat d1/d4/f4c x:0 0 0 2023-10-21T17:07:29.679 INFO:tasks.workunit.client.0.smithi012.stdout:2/256: dread d1/f2a [0,4194304] 0 2023-10-21T17:07:29.972 INFO:tasks.workunit.client.0.smithi012.stdout:8/198: write d0/f19 [2478478,122844] 0 2023-10-21T17:07:30.057 INFO:tasks.workunit.client.0.smithi012.stdout:1/240: mkdir d5/d32/d1b/d27/d1a/d46/d4f 0 2023-10-21T17:07:30.397 INFO:tasks.workunit.client.0.smithi012.stdout:4/234: mknod dc/d28/c4d 0 2023-10-21T17:07:30.398 INFO:tasks.workunit.client.0.smithi012.stdout:4/235: chown dc/d1e/f4b 19087 1 2023-10-21T17:07:30.398 INFO:tasks.workunit.client.0.smithi012.stdout:0/254: creat d7/d55/d9/d48/f61 x:0 0 0 2023-10-21T17:07:30.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/259: sync 2023-10-21T17:07:30.448 INFO:tasks.workunit.client.0.smithi012.stdout:4/236: dread dc/d1e/d33/f43 [0,4194304] 0 2023-10-21T17:07:30.477 INFO:tasks.workunit.client.0.smithi012.stdout:7/260: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:07:30.537 INFO:tasks.workunit.client.0.smithi012.stdout:7/261: dwrite d3/d6/dc/d19/f33 [0,4194304] 0 2023-10-21T17:07:30.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/182: rename d2/d6/c37 to d2/d1d/c40 0 2023-10-21T17:07:30.685 INFO:tasks.workunit.client.0.smithi012.stdout:4/237: rename dc/d1e/d2b to dc/d1e/d2b/d4e 22 2023-10-21T17:07:30.880 INFO:tasks.workunit.client.0.smithi012.stdout:2/257: symlink d1/d14/d16/l4d 0 2023-10-21T17:07:31.217 INFO:tasks.workunit.client.0.smithi012.stdout:8/199: symlink d0/d12/d40/l4b 0 2023-10-21T17:07:31.560 INFO:tasks.workunit.client.0.smithi012.stdout:1/241: fdatasync d5/d26/d29/fe 0 2023-10-21T17:07:31.645 INFO:tasks.workunit.client.0.smithi012.stdout:1/242: dwrite d5/d32/f3c [0,4194304] 0 2023-10-21T17:07:31.732 INFO:tasks.workunit.client.0.smithi012.stdout:0/255: getdents d7/d55/d1f 0 2023-10-21T17:07:31.750 INFO:tasks.workunit.client.0.smithi012.stdout:3/210: sync 2023-10-21T17:07:31.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/226: sync 2023-10-21T17:07:31.751 INFO:tasks.workunit.client.0.smithi012.stdout:3/211: dread - d0/da/d28/f2c zero size 2023-10-21T17:07:31.751 INFO:tasks.workunit.client.0.smithi012.stdout:3/212: chown d0/da/d28 7041 1 2023-10-21T17:07:31.781 INFO:tasks.workunit.client.0.smithi012.stdout:3/213: write d0/d1c/f1e [3993482,114471] 0 2023-10-21T17:07:32.273 INFO:tasks.workunit.client.0.smithi012.stdout:5/183: unlink d2/c34 0 2023-10-21T17:07:32.362 INFO:tasks.workunit.client.0.smithi012.stdout:5/184: dwrite d2/f4 [4194304,4194304] 0 2023-10-21T17:07:32.362 INFO:tasks.workunit.client.0.smithi012.stdout:5/185: chown d2/dd/c3c 28514256 1 2023-10-21T17:07:32.363 INFO:tasks.workunit.client.0.smithi012.stdout:5/186: fsync d2/dd/d1e/f24 0 2023-10-21T17:07:32.497 INFO:tasks.workunit.client.0.smithi012.stdout:2/258: unlink d1/d14/d16/f27 0 2023-10-21T17:07:32.607 INFO:tasks.workunit.client.0.smithi012.stdout:8/200: fsync d0/d1a/f3d 0 2023-10-21T17:07:32.608 INFO:tasks.workunit.client.0.smithi012.stdout:8/201: dread - d0/d1a/f3d zero size 2023-10-21T17:07:33.112 INFO:tasks.workunit.client.0.smithi012.stdout:1/243: creat d5/d26/d29/d43/f50 x:0 0 0 2023-10-21T17:07:33.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/256: symlink d7/d55/d23/d27/d40/l62 0 2023-10-21T17:07:33.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/257: chown d7/d55/d9/d48/f61 20421 1 2023-10-21T17:07:33.449 INFO:tasks.workunit.client.0.smithi012.stdout:0/258: dwrite d7/d55/d1f/d28/f51 [0,4194304] 0 2023-10-21T17:07:33.652 INFO:tasks.workunit.client.0.smithi012.stdout:6/229: dwrite f1 [0,4194304] 0 2023-10-21T17:07:33.663 INFO:tasks.workunit.client.0.smithi012.stdout:3/214: dwrite d0/f3b [0,4194304] 0 2023-10-21T17:07:33.663 INFO:tasks.workunit.client.0.smithi012.stdout:3/215: chown d0/da/d28/f29 61638 1 2023-10-21T17:07:33.664 INFO:tasks.workunit.client.0.smithi012.stdout:3/216: fdatasync d0/da/fe 0 2023-10-21T17:07:33.666 INFO:tasks.workunit.client.0.smithi012.stdout:6/230: dread d13/d15/f21 [0,4194304] 0 2023-10-21T17:07:33.675 INFO:tasks.workunit.client.0.smithi012.stdout:4/238: mkdir dc/d28/d4f 0 2023-10-21T17:07:33.677 INFO:tasks.workunit.client.0.smithi012.stdout:3/217: dread d0/da/f26 [0,4194304] 0 2023-10-21T17:07:33.924 INFO:tasks.workunit.client.0.smithi012.stdout:8/202: creat d0/f4c x:0 0 0 2023-10-21T17:07:34.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:07:34.124 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:07:34.125 INFO:tasks.workunit.client.0.smithi012.stdout:1/244: mkdir d5/d30/d51 0 2023-10-21T17:07:34.516 INFO:tasks.workunit.client.0.smithi012.stdout:0/259: mkdir d7/d55/d9/d63 0 2023-10-21T17:07:34.713 INFO:tasks.workunit.client.0.smithi012.stdout:9/227: rename d0/d4/c18 to d0/d5/c4f 0 2023-10-21T17:07:35.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/262: write d3/f1d [161348,49998] 0 2023-10-21T17:07:35.094 INFO:tasks.workunit.client.0.smithi012.stdout:7/263: write d3/d29/f26 [4528409,6886] 0 2023-10-21T17:07:35.406 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:01.389 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.429 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:01.514 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.432 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:01.516 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.432 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:01.517 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.433 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:01.518 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.443 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:01.426 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/231: unlink d13/d15/d1d/f3e 0 2023-10-21T17:07:35.477 INFO:tasks.workunit.client.0.smithi012.stdout:4/239: truncate dc/f3b 3560380 0 2023-10-21T17:07:35.478 INFO:tasks.workunit.client.0.smithi012.stdout:4/240: write dc/f17 [4504165,100950] 0 2023-10-21T17:07:35.503 INFO:tasks.workunit.client.0.smithi012.stdout:3/218: stat d0/c13 0 2023-10-21T17:07:35.504 INFO:tasks.workunit.client.0.smithi012.stdout:3/219: truncate d0/da/d28/f38 758958 0 2023-10-21T17:07:35.508 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:01.592 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.510 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:01.595 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.566 INFO:tasks.workunit.client.0.smithi012.stdout:4/241: dwrite dc/d15/f32 [0,4194304] 0 2023-10-21T17:07:35.566 INFO:tasks.workunit.client.0.smithi012.stdout:4/242: stat dc/d1e/f3c 0 2023-10-21T17:07:35.566 INFO:tasks.workunit.client.0.smithi012.stdout:4/243: fdatasync dc/d15/f32 0 2023-10-21T17:07:35.594 INFO:tasks.workunit.client.0.smithi012.stdout:4/244: dread dc/d15/d2a/d31/f49 [0,4194304] 0 2023-10-21T17:07:35.596 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:01.578 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:35.629 INFO:tasks.workunit.client.0.smithi012.stdout:4/245: dread dc/d15/f32 [0,4194304] 0 2023-10-21T17:07:35.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/246: creat dc/d15/d2a/d31/d36/f50 x:0 0 0 2023-10-21T17:07:35.751 INFO:tasks.workunit.client.0.smithi012.stdout:1/245: symlink d5/d32/l52 0 2023-10-21T17:07:35.779 INFO:tasks.workunit.client.0.smithi012.stdout:0/260: link d7/d55/d23/d27/d31/d3d/c2f d7/d55/d9/d63/c64 0 2023-10-21T17:07:35.853 INFO:tasks.workunit.client.0.smithi012.stdout:5/187: rename d2/d6/f23 to d2/dd/f41 0 2023-10-21T17:07:35.984 INFO:tasks.workunit.client.0.smithi012.stdout:9/228: creat d0/d4/d4b/f50 x:0 0 0 2023-10-21T17:07:36.390 INFO:tasks.workunit.client.0.smithi012.stdout:7/264: link d3/d6/dc/d19/c37 d3/d16/c4a 0 2023-10-21T17:07:36.391 INFO:tasks.workunit.client.0.smithi012.stdout:7/265: chown d3/d6/dc/d19/d1e/c44 0 1 2023-10-21T17:07:37.203 INFO:tasks.workunit.client.0.smithi012.stdout:3/220: mkdir d0/da/d42 0 2023-10-21T17:07:37.203 INFO:tasks.workunit.client.0.smithi012.stdout:8/203: mknod d0/d46/c4d 0 2023-10-21T17:07:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:4/247: mknod dc/d1e/d33/c51 0 2023-10-21T17:07:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:1/246: symlink d5/d32/d1b/d2c/l53 0 2023-10-21T17:07:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:4/248: fsync f8 0 2023-10-21T17:07:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:4/249: stat dc/d1e/d33/f43 0 2023-10-21T17:07:37.243 INFO:tasks.workunit.client.0.smithi012.stdout:4/250: creat dc/d1e/d33/f52 x:0 0 0 2023-10-21T17:07:37.243 INFO:tasks.workunit.client.0.smithi012.stdout:1/247: write d5/d32/d1b/d27/f42 [217842,95829] 0 2023-10-21T17:07:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:0/261: mknod d7/d55/d9/c65 0 2023-10-21T17:07:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:0/262: stat d7/d55/d23 0 2023-10-21T17:07:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:2/259: rename d1/d4/d3f/c3a to d1/d8/d25/c4e 0 2023-10-21T17:07:37.279 INFO:tasks.workunit.client.0.smithi012.stdout:0/263: dread d7/f1d [0,4194304] 0 2023-10-21T17:07:37.279 INFO:tasks.workunit.client.0.smithi012.stdout:0/264: write d7/d55/d23/d27/f44 [854270,114301] 0 2023-10-21T17:07:37.320 INFO:tasks.workunit.client.0.smithi012.stdout:5/188: creat d2/d2c/f42 x:0 0 0 2023-10-21T17:07:37.320 INFO:tasks.workunit.client.0.smithi012.stdout:9/229: creat d0/df/d44/f51 x:0 0 0 2023-10-21T17:07:37.372 INFO:tasks.workunit.client.0.smithi012.stdout:0/265: dwrite d7/d55/d23/d27/f5d [0,4194304] 0 2023-10-21T17:07:37.417 INFO:tasks.workunit.client.0.smithi012.stdout:5/189: dwrite d2/dd/fc [0,4194304] 0 2023-10-21T17:07:37.491 INFO:tasks.workunit.client.0.smithi012.stdout:5/190: dwrite d2/dd/fc [0,4194304] 0 2023-10-21T17:07:37.491 INFO:tasks.workunit.client.0.smithi012.stdout:5/191: creat d2/d2c/f43 x:0 0 0 2023-10-21T17:07:37.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/266: rmdir d3 39 2023-10-21T17:07:38.450 INFO:tasks.workunit.client.0.smithi012.stdout:1/248: mkdir d5/d26/d54 0 2023-10-21T17:07:38.488 INFO:tasks.workunit.client.0.smithi012.stdout:1/249: dread d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:07:38.576 INFO:tasks.workunit.client.0.smithi012.stdout:3/221: rename d0/da/d42 to d0/d32/d43 0 2023-10-21T17:07:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/260: creat d1/d4/d3f/f4f x:0 0 0 2023-10-21T17:07:38.934 INFO:tasks.workunit.client.0.smithi012.stdout:9/230: mknod d0/c52 0 2023-10-21T17:07:38.959 INFO:tasks.workunit.client.0.smithi012.stdout:9/231: dread d0/d5/f22 [0,4194304] 0 2023-10-21T17:07:39.253 INFO:tasks.workunit.client.0.smithi012.stdout:0/266: dread d7/d55/f22 [0,4194304] 0 2023-10-21T17:07:39.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/192: link d2/d6/f7 d2/d3e/f44 0 2023-10-21T17:07:40.043 INFO:tasks.workunit.client.0.smithi012.stdout:4/251: symlink dc/l53 0 2023-10-21T17:07:40.134 INFO:tasks.workunit.client.0.smithi012.stdout:7/267: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:07:40.134 INFO:tasks.workunit.client.0.smithi012.stdout:1/250: mknod d5/d32/d1b/d2c/d48/c55 0 2023-10-21T17:07:40.157 INFO:tasks.workunit.client.0.smithi012.stdout:1/251: dread d5/d26/f40 [4194304,4194304] 0 2023-10-21T17:07:40.261 INFO:tasks.workunit.client.0.smithi012.stdout:3/222: mknod d0/d32/d43/c44 0 2023-10-21T17:07:40.486 INFO:tasks.workunit.client.0.smithi012.stdout:6/232: dwrite d13/d15/f27 [0,4194304] 0 2023-10-21T17:07:40.607 INFO:tasks.workunit.client.0.smithi012.stdout:2/261: mkdir d1/d8/d19/d50 0 2023-10-21T17:07:40.785 INFO:tasks.workunit.client.0.smithi012.stdout:9/232: dread d0/d4/d4b/f4c [0,4194304] 0 2023-10-21T17:07:40.816 INFO:tasks.workunit.client.0.smithi012.stdout:9/233: write d0/df/f11 [1069851,101911] 0 2023-10-21T17:07:40.816 INFO:tasks.workunit.client.0.smithi012.stdout:9/234: readlink d0/d5/l28 0 2023-10-21T17:07:40.817 INFO:tasks.workunit.client.0.smithi012.stdout:9/235: creat d0/d4/db/d12/d25/d39/d3b/f53 x:0 0 0 2023-10-21T17:07:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/193: symlink d2/dd/l45 0 2023-10-21T17:07:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/194: write d2/d2c/f43 [808906,15239] 0 2023-10-21T17:07:41.332 INFO:tasks.workunit.client.0.smithi012.stdout:7/268: link d3/d6/dc/d19/d1e/d34/l3e d3/d6/dc/d19/d43/l4b 0 2023-10-21T17:07:41.332 INFO:tasks.workunit.client.0.smithi012.stdout:4/252: truncate f8 6145692 0 2023-10-21T17:07:41.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/269: dread d3/d29/f26 [0,4194304] 0 2023-10-21T17:07:41.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/270: stat d3/d6/dc/d19 0 2023-10-21T17:07:41.409 INFO:tasks.workunit.client.0.smithi012.stdout:7/271: write d3/f41 [1095617,118135] 0 2023-10-21T17:07:41.410 INFO:tasks.workunit.client.0.smithi012.stdout:7/272: stat d3/d6/dc/d19/d28/f3b 0 2023-10-21T17:07:41.418 INFO:tasks.workunit.client.0.smithi012.stdout:6/233: stat d13/d15/f19 0 2023-10-21T17:07:41.506 INFO:tasks.workunit.client.0.smithi012.stdout:2/262: creat d1/d8/f51 x:0 0 0 2023-10-21T17:07:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:5/195: creat d2/d1d/d29/f46 x:0 0 0 2023-10-21T17:07:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:4/253: symlink dc/d15/d18/l54 0 2023-10-21T17:07:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:5/196: fsync d2/d6/f25 0 2023-10-21T17:07:42.277 INFO:tasks.workunit.client.0.smithi012.stdout:6/234: mknod d13/d29/c4a 0 2023-10-21T17:07:42.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/254: dread dc/f42 [0,4194304] 0 2023-10-21T17:07:42.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/255: chown f1 8883 1 2023-10-21T17:07:43.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/263: mknod d1/d14/c52 0 2023-10-21T17:07:43.577 INFO:tasks.workunit.client.0.smithi012.stdout:4/256: dread dc/f25 [0,4194304] 0 2023-10-21T17:07:43.577 INFO:tasks.workunit.client.0.smithi012.stdout:4/257: stat dc/c30 0 2023-10-21T17:07:43.664 INFO:tasks.workunit.client.0.smithi012.stdout:0/267: rename d7/d55/d9 to d7/d55/d23/d66 0 2023-10-21T17:07:43.665 INFO:tasks.workunit.client.0.smithi012.stdout:0/268: write d7/d55/d23/d66/f37 [4527938,114614] 0 2023-10-21T17:07:43.665 INFO:tasks.workunit.client.0.smithi012.stdout:0/269: chown d7/d55/d23/f2a 0 1 2023-10-21T17:07:43.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/270: dwrite d7/d55/d23/d66/f12 [0,4194304] 0 2023-10-21T17:07:43.897 INFO:tasks.workunit.client.0.smithi012.stdout:5/197: getdents d2/d6 0 2023-10-21T17:07:44.006 INFO:tasks.workunit.client.0.smithi012.stdout:2/264: symlink d1/d4/d3f/d41/l53 0 2023-10-21T17:07:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:4/258: mkdir dc/d15/d18/d4c/d55 0 2023-10-21T17:07:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:4/259: dread dc/f25 [0,4194304] 0 2023-10-21T17:07:44.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/223: rename d0/d1c/f3f to d0/d32/d43/f45 0 2023-10-21T17:07:44.518 INFO:tasks.workunit.client.0.smithi012.stdout:0/271: mknod d7/d52/c67 0 2023-10-21T17:07:44.912 INFO:tasks.workunit.client.0.smithi012.stdout:4/260: dread dc/f3b [0,4194304] 0 2023-10-21T17:07:45.073 INFO:tasks.workunit.client.0.smithi012.stdout:6/235: rename d13/d15/d1d/d24/f3f to d13/f4b 0 2023-10-21T17:07:45.268 INFO:tasks.workunit.client.0.smithi012.stdout:5/198: truncate d2/f4 6890037 0 2023-10-21T17:07:45.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/199: chown d2/dd/l45 816 1 2023-10-21T17:07:45.361 INFO:tasks.workunit.client.0.smithi012.stdout:8/204: unlink d0/c3a 0 2023-10-21T17:07:45.536 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:11.519 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.556 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:11.539 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.587 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:11.672 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.593 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:11.677 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.595 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:11.680 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.598 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:11.683 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.613 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:41:11.698 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.614 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:41:11.699 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/265: rmdir d1/d14/d16 39 2023-10-21T17:07:45.758 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:41:11.740 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:07:45.771 INFO:tasks.workunit.client.0.smithi012.stdout:4/261: symlink dc/d15/d2a/d31/d36/l56 0 2023-10-21T17:07:45.771 INFO:tasks.workunit.client.0.smithi012.stdout:4/262: chown dc/d15/d18/c3d 1022315 1 2023-10-21T17:07:46.113 INFO:tasks.workunit.client.0.smithi012.stdout:0/272: rename d7/d55/d23/d66/f12 to d7/d55/d23/d66/d48/f68 0 2023-10-21T17:07:46.114 INFO:tasks.workunit.client.0.smithi012.stdout:6/236: mkdir d13/d35/d4c 0 2023-10-21T17:07:46.114 INFO:tasks.workunit.client.0.smithi012.stdout:6/237: fsync ff 0 2023-10-21T17:07:46.136 INFO:tasks.workunit.client.0.smithi012.stdout:0/273: dread d7/d55/d1f/f4a [0,4194304] 0 2023-10-21T17:07:46.166 INFO:tasks.workunit.client.0.smithi012.stdout:6/238: dread f7 [0,4194304] 0 2023-10-21T17:07:46.197 INFO:tasks.workunit.client.0.smithi012.stdout:0/274: dwrite f6 [0,4194304] 0 2023-10-21T17:07:46.316 INFO:tasks.workunit.client.0.smithi012.stdout:1/252: mknod d5/d32/d1b/c56 0 2023-10-21T17:07:46.317 INFO:tasks.workunit.client.0.smithi012.stdout:1/253: readlink d5/d32/l52 0 2023-10-21T17:07:46.457 INFO:tasks.workunit.client.0.smithi012.stdout:5/200: mkdir d2/d1d/d29/d47 0 2023-10-21T17:07:46.458 INFO:tasks.workunit.client.0.smithi012.stdout:5/201: read - d2/d6/f25 zero size 2023-10-21T17:07:46.697 INFO:tasks.workunit.client.0.smithi012.stdout:9/236: write d0/d4/d4b/f4c [941511,130090] 0 2023-10-21T17:07:46.769 INFO:tasks.workunit.client.0.smithi012.stdout:9/237: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:07:47.202 INFO:tasks.workunit.client.0.smithi012.stdout:2/266: creat d1/d8/d19/d50/f54 x:0 0 0 2023-10-21T17:07:47.203 INFO:tasks.workunit.client.0.smithi012.stdout:2/267: fdatasync d1/d8/d19/d50/f54 0 2023-10-21T17:07:47.288 INFO:tasks.workunit.client.0.smithi012.stdout:4/263: mkdir dc/d15/d18/d57 0 2023-10-21T17:07:48.042 INFO:tasks.workunit.client.0.smithi012.stdout:6/239: symlink d13/d35/d4c/l4d 0 2023-10-21T17:07:48.042 INFO:tasks.workunit.client.0.smithi012.stdout:6/240: chown d13/f14 7 1 2023-10-21T17:07:48.161 INFO:tasks.workunit.client.0.smithi012.stdout:0/275: rename d7/d55/d23/d30/c4b to d7/d55/d23/d66/d48/c69 0 2023-10-21T17:07:48.479 INFO:tasks.workunit.client.0.smithi012.stdout:1/254: creat d5/d32/d1b/d35/d49/f57 x:0 0 0 2023-10-21T17:07:48.737 INFO:tasks.workunit.client.0.smithi012.stdout:9/238: symlink d0/d4/db/d12/d2a/l54 0 2023-10-21T17:07:49.059 INFO:tasks.workunit.client.0.smithi012.stdout:8/205: truncate d0/f2 2308817 0 2023-10-21T17:07:49.100 INFO:tasks.workunit.client.0.smithi012.stdout:4/264: mkdir dc/d15/d2a/d58 0 2023-10-21T17:07:49.434 INFO:tasks.workunit.client.0.smithi012.stdout:5/202: rename d2/dd/fc to d2/d1d/d20/f48 0 2023-10-21T17:07:49.537 INFO:tasks.workunit.client.0.smithi012.stdout:3/224: link d0/da/f3d d0/f46 0 2023-10-21T17:07:49.538 INFO:tasks.workunit.client.0.smithi012.stdout:3/225: fsync d0/f4 0 2023-10-21T17:07:49.680 INFO:tasks.workunit.client.0.smithi012.stdout:0/276: symlink d7/d52/l6a 0 2023-10-21T17:07:49.983 INFO:tasks.workunit.client.0.smithi012.stdout:1/255: mknod d5/d32/d1b/d27/c58 0 2023-10-21T17:07:49.984 INFO:tasks.workunit.client.0.smithi012.stdout:9/239: rmdir d0/d4/db 39 2023-10-21T17:07:49.984 INFO:tasks.workunit.client.0.smithi012.stdout:9/240: truncate d0/d4/db/d12/d25/d39/d3b/f53 982788 0 2023-10-21T17:07:49.984 INFO:tasks.workunit.client.0.smithi012.stdout:9/241: creat d0/d4/db/d12/f55 x:0 0 0 2023-10-21T17:07:50.066 INFO:tasks.workunit.client.0.smithi012.stdout:1/256: dwrite d5/d26/d29/d43/f50 [0,4194304] 0 2023-10-21T17:07:50.243 INFO:tasks.workunit.client.0.smithi012.stdout:2/268: creat d1/d14/d17/f55 x:0 0 0 2023-10-21T17:07:50.790 INFO:tasks.workunit.client.0.smithi012.stdout:0/277: getdents d7/d55/d23/d27/d31/d5f 0 2023-10-21T17:07:50.790 INFO:tasks.workunit.client.0.smithi012.stdout:0/278: dread - d7/d55/d1f/d28/f59 zero size 2023-10-21T17:07:50.802 INFO:tasks.workunit.client.0.smithi012.stdout:3/226: dread d0/f15 [0,4194304] 0 2023-10-21T17:07:51.017 INFO:tasks.workunit.client.0.smithi012.stdout:9/242: creat d0/d4/db/d12/d25/f56 x:0 0 0 2023-10-21T17:07:51.663 INFO:tasks.workunit.client.0.smithi012.stdout:2/269: symlink d1/d4/d3f/d41/l56 0 2023-10-21T17:07:51.663 INFO:tasks.workunit.client.0.smithi012.stdout:2/270: write d1/d14/d17/f55 [25552,99486] 0 2023-10-21T17:07:51.713 INFO:tasks.workunit.client.0.smithi012.stdout:4/265: mknod dc/d28/c59 0 2023-10-21T17:07:51.713 INFO:tasks.workunit.client.0.smithi012.stdout:4/266: creat dc/d15/d2a/d31/d36/f5a x:0 0 0 2023-10-21T17:07:51.754 INFO:tasks.workunit.client.0.smithi012.stdout:7/273: rmdir d3/d29 39 2023-10-21T17:07:52.237 INFO:tasks.workunit.client.0.smithi012.stdout:0/279: symlink d7/d52/d53/l6b 0 2023-10-21T17:07:52.390 INFO:tasks.workunit.client.0.smithi012.stdout:3/227: rmdir d0/d1c 39 2023-10-21T17:07:52.390 INFO:tasks.workunit.client.0.smithi012.stdout:3/228: dread - d0/da/f34 zero size 2023-10-21T17:07:52.616 INFO:tasks.workunit.client.0.smithi012.stdout:9/243: truncate d0/f3e 197279 0 2023-10-21T17:07:52.618 INFO:tasks.workunit.client.0.smithi012.stdout:1/257: rmdir d5/d26/d29/d43 39 2023-10-21T17:07:52.618 INFO:tasks.workunit.client.0.smithi012.stdout:1/258: write d5/f10 [4016660,37881] 0 2023-10-21T17:07:52.678 INFO:tasks.workunit.client.0.smithi012.stdout:9/244: dwrite d0/f2 [4194304,4194304] 0 2023-10-21T17:07:52.730 INFO:tasks.workunit.client.0.smithi012.stdout:2/271: creat d1/d8/d19/f57 x:0 0 0 2023-10-21T17:07:52.731 INFO:tasks.workunit.client.0.smithi012.stdout:2/272: chown d1/d8/f2d 9585 1 2023-10-21T17:07:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/267: symlink dc/d15/d18/d4c/l5b 0 2023-10-21T17:07:53.278 INFO:tasks.workunit.client.0.smithi012.stdout:7/274: mknod d3/c4c 0 2023-10-21T17:07:53.278 INFO:tasks.workunit.client.0.smithi012.stdout:7/275: chown d3/c40 27 1 2023-10-21T17:07:53.279 INFO:tasks.workunit.client.0.smithi012.stdout:5/203: getdents d2/dd 0 2023-10-21T17:07:53.318 INFO:tasks.workunit.client.0.smithi012.stdout:0/280: creat d7/d60/f6c x:0 0 0 2023-10-21T17:07:53.398 INFO:tasks.workunit.client.0.smithi012.stdout:5/204: dwrite d2/d1d/d29/f46 [0,4194304] 0 2023-10-21T17:07:53.492 INFO:tasks.workunit.client.0.smithi012.stdout:5/205: dwrite d2/d3e/f44 [4194304,4194304] 0 2023-10-21T17:07:53.567 INFO:tasks.workunit.client.0.smithi012.stdout:3/229: mkdir d0/d32/d43/d47 0 2023-10-21T17:07:53.737 INFO:tasks.workunit.client.0.smithi012.stdout:1/259: symlink d5/d32/d1b/d27/d1a/l59 0 2023-10-21T17:07:53.832 INFO:tasks.workunit.client.0.smithi012.stdout:1/260: dwrite d5/d32/d1b/d27/d21/f31 [0,4194304] 0 2023-10-21T17:07:53.832 INFO:tasks.workunit.client.0.smithi012.stdout:1/261: chown d5/d26/d29/d43/c44 45273 1 2023-10-21T17:07:54.578 INFO:tasks.workunit.client.0.smithi012.stdout:8/206: sync 2023-10-21T17:07:54.773 INFO:tasks.workunit.client.0.smithi012.stdout:5/206: mkdir d2/d3e/d49 0 2023-10-21T17:07:54.773 INFO:tasks.workunit.client.0.smithi012.stdout:5/207: stat d2/dd/d1e 0 2023-10-21T17:07:54.800 INFO:tasks.workunit.client.0.smithi012.stdout:6/241: write d13/d15/f19 [2900801,115481] 0 2023-10-21T17:07:54.914 INFO:tasks.workunit.client.0.smithi012.stdout:6/242: dwrite d13/f47 [0,4194304] 0 2023-10-21T17:07:54.914 INFO:tasks.workunit.client.0.smithi012.stdout:6/243: chown f6 10844 1 2023-10-21T17:07:55.300 INFO:tasks.workunit.client.0.smithi012.stdout:1/262: creat d5/d26/d29/d43/f5a x:0 0 0 2023-10-21T17:07:55.383 INFO:tasks.workunit.client.0.smithi012.stdout:1/263: dwrite d5/d32/d1b/d27/d1a/d46/f4d [4194304,4194304] 0 2023-10-21T17:07:55.741 INFO:tasks.workunit.client.0.smithi012.stdout:8/207: dread d0/f26 [0,4194304] 0 2023-10-21T17:07:56.567 INFO:tasks.workunit.client.0.smithi012.stdout:2/273: rename d1/d8/d35 to d1/d14/d16/d58 0 2023-10-21T17:07:56.567 INFO:tasks.workunit.client.0.smithi012.stdout:2/274: readlink d1/d14/d16/d22/l2f 0 2023-10-21T17:07:56.567 INFO:tasks.workunit.client.0.smithi012.stdout:2/275: chown d1 9 1 2023-10-21T17:07:56.758 INFO:tasks.workunit.client.0.smithi012.stdout:8/208: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:07:56.839 INFO:tasks.workunit.client.0.smithi012.stdout:4/268: rename dc/f17 to dc/d1e/d2b/f5c 0 2023-10-21T17:07:56.951 INFO:tasks.workunit.client.0.smithi012.stdout:2/276: mkdir d1/d4/d3f/d41/d59 0 2023-10-21T17:07:57.028 INFO:tasks.workunit.client.0.smithi012.stdout:8/209: mkdir d0/d12/d40/d4a/d4e 0 2023-10-21T17:07:57.028 INFO:tasks.workunit.client.0.smithi012.stdout:8/210: getdents d0/d12/d40/d4a/d4e 0 2023-10-21T17:07:57.258 INFO:tasks.workunit.client.0.smithi012.stdout:4/269: unlink f1 0 2023-10-21T17:07:57.537 INFO:tasks.workunit.client.0.smithi012.stdout:7/276: rename d3/d6/dc/d19/d28/c47 to d3/d16/c4d 0 2023-10-21T17:07:57.761 INFO:tasks.workunit.client.0.smithi012.stdout:2/277: mknod d1/d8/c5a 0 2023-10-21T17:07:57.762 INFO:tasks.workunit.client.0.smithi012.stdout:2/278: readlink d1/d4/d3f/d41/l56 0 2023-10-21T17:07:57.819 INFO:tasks.workunit.client.0.smithi012.stdout:8/211: dread - d0/f35 zero size 2023-10-21T17:07:58.137 INFO:tasks.workunit.client.0.smithi012.stdout:4/270: rename dc/d15/d18/c23 to dc/d1e/c5d 0 2023-10-21T17:07:58.137 INFO:tasks.workunit.client.0.smithi012.stdout:4/271: truncate dc/d15/d2a/d31/d36/f50 982437 0 2023-10-21T17:07:58.276 INFO:tasks.workunit.client.0.smithi012.stdout:7/277: getdents d3/d6/dc/d19/d1e/d34 0 2023-10-21T17:07:58.277 INFO:tasks.workunit.client.0.smithi012.stdout:7/278: write d3/f41 [599990,46052] 0 2023-10-21T17:07:58.350 INFO:tasks.workunit.client.0.smithi012.stdout:9/245: dwrite d0/d4/f2e [0,4194304] 0 2023-10-21T17:07:58.378 INFO:tasks.workunit.client.0.smithi012.stdout:0/281: dwrite d7/d55/f14 [0,4194304] 0 2023-10-21T17:07:59.111 INFO:tasks.workunit.client.0.smithi012.stdout:3/230: dwrite d0/f46 [0,4194304] 0 2023-10-21T17:07:59.316 INFO:tasks.workunit.client.0.smithi012.stdout:7/279: rename d3/f1d to d3/d6/dc/d19/d43/f4e 0 2023-10-21T17:07:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:2/279: getdents d1/d4/d3f 0 2023-10-21T17:07:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:2/280: chown d1/d4/c49 5981421 1 2023-10-21T17:07:59.809 INFO:tasks.workunit.client.0.smithi012.stdout:9/246: creat d0/d15/f57 x:0 0 0 2023-10-21T17:08:00.438 INFO:tasks.workunit.client.0.smithi012.stdout:3/231: fsync d0/f14 0 2023-10-21T17:08:00.609 INFO:tasks.workunit.client.0.smithi012.stdout:7/280: symlink d3/d6/dc/l4f 0 2023-10-21T17:08:00.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/281: fsync d3/d6/dc/d19/d28/f3c 0 2023-10-21T17:08:00.871 INFO:tasks.workunit.client.0.smithi012.stdout:7/282: creat d3/d16/f50 x:0 0 0 2023-10-21T17:08:00.871 INFO:tasks.workunit.client.0.smithi012.stdout:7/283: chown d3/d6/dc/d19 0 1 2023-10-21T17:08:00.933 INFO:tasks.workunit.client.0.smithi012.stdout:7/284: dwrite d3/d29/f11 [0,4194304] 0 2023-10-21T17:08:00.934 INFO:tasks.workunit.client.0.smithi012.stdout:7/285: creat d3/d6/dc/d19/d28/f51 x:0 0 0 2023-10-21T17:08:00.934 INFO:tasks.workunit.client.0.smithi012.stdout:7/286: chown d3/d29/f11 1 1 2023-10-21T17:08:01.020 INFO:tasks.workunit.client.0.smithi012.stdout:7/287: dwrite d3/d6/dc/d19/d28/f3c [0,4194304] 0 2023-10-21T17:08:01.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/247: getdents d0/d4/db/d12/d25/d2f 0 2023-10-21T17:08:01.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/248: dread d0/fe [0,4194304] 0 2023-10-21T17:08:01.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/249: chown d0/d15/f57 147855 1 2023-10-21T17:08:01.283 INFO:tasks.workunit.client.0.smithi012.stdout:3/232: link d0/fd d0/d32/d43/d47/f48 0 2023-10-21T17:08:01.464 INFO:tasks.workunit.client.0.smithi012.stdout:6/244: rmdir d13 39 2023-10-21T17:08:02.216 INFO:tasks.workunit.client.0.smithi012.stdout:7/288: creat d3/d29/f52 x:0 0 0 2023-10-21T17:08:02.279 INFO:tasks.workunit.client.0.smithi012.stdout:9/250: dread d0/d4/db/d12/d25/d39/d3b/f53 [0,4194304] 0 2023-10-21T17:08:02.960 INFO:tasks.workunit.client.0.smithi012.stdout:3/233: chown d0/l3 107789003 1 2023-10-21T17:08:02.961 INFO:tasks.workunit.client.0.smithi012.stdout:6/245: write d13/d15/d1d/d24/f45 [1027115,53098] 0 2023-10-21T17:08:03.171 INFO:tasks.workunit.client.0.smithi012.stdout:7/289: symlink d3/d6/dc/d19/d28/l53 0 2023-10-21T17:08:03.258 INFO:tasks.workunit.client.0.smithi012.stdout:7/290: dwrite d3/d6/dc/d19/d43/f4e [0,4194304] 0 2023-10-21T17:08:03.353 INFO:tasks.workunit.client.0.smithi012.stdout:7/291: dwrite d3/d29/f27 [4194304,4194304] 0 2023-10-21T17:08:04.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:08:04.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:08:04.600 INFO:tasks.workunit.client.0.smithi012.stdout:7/292: creat d3/d6/dc/f54 x:0 0 0 2023-10-21T17:08:04.793 INFO:tasks.workunit.client.0.smithi012.stdout:1/264: link d5/d32/d1b/d2c/d48/c55 d5/c5b 0 2023-10-21T17:08:04.834 INFO:tasks.workunit.client.0.smithi012.stdout:1/265: write d5/d26/d29/d43/f50 [3245478,11618] 0 2023-10-21T17:08:04.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/266: read d5/d32/d1b/d27/f20 [76554,62340] 0 2023-10-21T17:08:04.940 INFO:tasks.workunit.client.0.smithi012.stdout:7/293: mknod d3/d6/dc/d19/d1e/d34/c55 0 2023-10-21T17:08:04.941 INFO:tasks.workunit.client.0.smithi012.stdout:7/294: creat d3/d16/f56 x:0 0 0 2023-10-21T17:08:05.411 INFO:tasks.workunit.client.0.smithi012.stdout:0/282: rename f5 to d7/d55/d23/d66/d63/f6d 0 2023-10-21T17:08:05.412 INFO:tasks.workunit.client.0.smithi012.stdout:5/208: rmdir d2/d3e 39 2023-10-21T17:08:05.412 INFO:tasks.workunit.client.0.smithi012.stdout:5/209: fsync d2/d1d/d20/f48 0 2023-10-21T17:08:05.412 INFO:tasks.workunit.client.0.smithi012.stdout:0/283: chown d7/d55/d23/d66/f1e 170563 1 2023-10-21T17:08:05.412 INFO:tasks.workunit.client.0.smithi012.stdout:5/210: readlink d2/d6/l13 0 2023-10-21T17:08:05.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/211: dwrite d2/d1d/d29/f39 [0,4194304] 0 2023-10-21T17:08:05.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/212: fsync d2/d3e/f44 0 2023-10-21T17:08:05.571 INFO:tasks.workunit.client.0.smithi012.stdout:7/295: creat d3/d6/dc/d19/f57 x:0 0 0 2023-10-21T17:08:05.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/296: readlink d3/d6/dc/d19/l39 0 2023-10-21T17:08:05.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/297: fdatasync d3/d16/f50 0 2023-10-21T17:08:05.998 INFO:tasks.workunit.client.0.smithi012.stdout:2/281: rename d1/d4/d3f/l37 to d1/d8/d25/l5b 0 2023-10-21T17:08:06.140 INFO:tasks.workunit.client.0.smithi012.stdout:5/213: rmdir d2/d1d/d29/d47 0 2023-10-21T17:08:06.140 INFO:tasks.workunit.client.0.smithi012.stdout:5/214: readlink d2/d6/lf 0 2023-10-21T17:08:06.279 INFO:tasks.workunit.client.0.smithi012.stdout:7/298: getdents d3/d6 0 2023-10-21T17:08:06.478 INFO:tasks.workunit.client.0.smithi012.stdout:2/282: creat d1/d14/d16/d20/f5c x:0 0 0 2023-10-21T17:08:06.495 INFO:tasks.workunit.client.0.smithi012.stdout:2/283: dread d1/d14/d16/d20/f3b [0,4194304] 0 2023-10-21T17:08:06.495 INFO:tasks.workunit.client.0.smithi012.stdout:2/284: fsync d1/d8/d19/f57 0 2023-10-21T17:08:06.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/285: dwrite d1/f30 [0,4194304] 0 2023-10-21T17:08:06.621 INFO:tasks.workunit.client.0.smithi012.stdout:9/251: creat d0/d4/db/d12/f58 x:0 0 0 2023-10-21T17:08:06.621 INFO:tasks.workunit.client.0.smithi012.stdout:9/252: chown d0/df/l1f 2 1 2023-10-21T17:08:06.621 INFO:tasks.workunit.client.0.smithi012.stdout:0/284: getdents d7/d60 0 2023-10-21T17:08:06.645 INFO:tasks.workunit.client.0.smithi012.stdout:9/253: write d0/f14 [3109786,8564] 0 2023-10-21T17:08:06.645 INFO:tasks.workunit.client.0.smithi012.stdout:9/254: chown d0/d4/db/d12/d25/d2f 190495420 1 2023-10-21T17:08:06.645 INFO:tasks.workunit.client.0.smithi012.stdout:9/255: truncate d0/d4/db/d12/f48 5127448 0 2023-10-21T17:08:06.699 INFO:tasks.workunit.client.0.smithi012.stdout:5/215: creat d2/d1d/f4a x:0 0 0 2023-10-21T17:08:06.729 INFO:tasks.workunit.client.0.smithi012.stdout:5/216: write d2/d1d/d20/f2b [2912177,68394] 0 2023-10-21T17:08:06.896 INFO:tasks.workunit.client.0.smithi012.stdout:7/299: symlink d3/d6/dc/d19/d1e/d34/l58 0 2023-10-21T17:08:06.897 INFO:tasks.workunit.client.0.smithi012.stdout:7/300: read d3/f41 [343577,60162] 0 2023-10-21T17:08:06.932 INFO:tasks.workunit.client.0.smithi012.stdout:7/301: dread d3/d6/dc/d19/d43/f4e [0,4194304] 0 2023-10-21T17:08:06.945 INFO:tasks.workunit.client.0.smithi012.stdout:7/302: dread d3/f3f [0,4194304] 0 2023-10-21T17:08:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:7/303: dread d3/d6/dc/d19/d28/f3b [0,4194304] 0 2023-10-21T17:08:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:7/304: chown d3/d6/dc/d19/d28/l53 201 1 2023-10-21T17:08:07.469 INFO:tasks.workunit.client.0.smithi012.stdout:3/234: link d0/da/d28/l33 d0/l49 0 2023-10-21T17:08:07.469 INFO:tasks.workunit.client.0.smithi012.stdout:6/246: write f8 [1387747,54122] 0 2023-10-21T17:08:07.507 INFO:tasks.workunit.client.0.smithi012.stdout:8/212: sync 2023-10-21T17:08:07.837 INFO:tasks.workunit.client.0.smithi012.stdout:2/286: chown d1/d14/l44 4282031 1 2023-10-21T17:08:07.838 INFO:tasks.workunit.client.0.smithi012.stdout:2/287: write d1/d8/f3d [770174,93462] 0 2023-10-21T17:08:08.078 INFO:tasks.workunit.client.0.smithi012.stdout:0/285: creat d7/d55/d23/d27/d31/d3d/f6e x:0 0 0 2023-10-21T17:08:08.145 INFO:tasks.workunit.client.0.smithi012.stdout:0/286: dwrite d7/d55/d23/d66/f57 [0,4194304] 0 2023-10-21T17:08:08.259 INFO:tasks.workunit.client.0.smithi012.stdout:0/287: dwrite d7/d55/d1f/f4a [0,4194304] 0 2023-10-21T17:08:08.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/256: rmdir d0/d15/d47 0 2023-10-21T17:08:08.326 INFO:tasks.workunit.client.0.smithi012.stdout:0/288: dwrite d7/d55/d23/d66/f49 [0,4194304] 0 2023-10-21T17:08:08.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/257: write d0/fe [1594849,119680] 0 2023-10-21T17:08:08.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/258: creat d0/d5/f59 x:0 0 0 2023-10-21T17:08:08.715 INFO:tasks.workunit.client.0.smithi012.stdout:1/267: rename d5/d26/d29/d43 to d5/d32/d1b/d35/d3a/d5c 0 2023-10-21T17:08:08.715 INFO:tasks.workunit.client.0.smithi012.stdout:1/268: chown d5/d32/d1b/d27/d21/f2b 20 1 2023-10-21T17:08:09.053 INFO:tasks.workunit.client.0.smithi012.stdout:8/213: fdatasync d0/f36 0 2023-10-21T17:08:09.145 INFO:tasks.workunit.client.0.smithi012.stdout:2/288: mknod d1/d8/d19/d50/c5d 0 2023-10-21T17:08:09.146 INFO:tasks.workunit.client.0.smithi012.stdout:2/289: fdatasync d1/d14/d17/f1f 0 2023-10-21T17:08:09.204 INFO:tasks.workunit.client.0.smithi012.stdout:5/217: dwrite d2/f4 [4194304,4194304] 0 2023-10-21T17:08:09.940 INFO:tasks.workunit.client.0.smithi012.stdout:2/290: write d1/f30 [4986288,125691] 0 2023-10-21T17:08:10.029 INFO:tasks.workunit.client.0.smithi012.stdout:0/289: creat d7/d60/f6f x:0 0 0 2023-10-21T17:08:10.363 INFO:tasks.workunit.client.0.smithi012.stdout:6/247: symlink d13/l4e 0 2023-10-21T17:08:11.039 INFO:tasks.workunit.client.0.smithi012.stdout:4/272: rmdir dc/d1e 39 2023-10-21T17:08:11.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/273: write dc/d15/d2a/d31/d36/f5a [110295,86561] 0 2023-10-21T17:08:11.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/274: dread - dc/d15/d2a/d31/d36/f46 zero size 2023-10-21T17:08:11.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/275: chown dc/d1e/f3c 11702127 1 2023-10-21T17:08:11.250 INFO:tasks.workunit.client.0.smithi012.stdout:7/305: rename d3/d6/dc/d19/d1e/l38 to d3/d6/dc/d19/d28/l59 0 2023-10-21T17:08:11.345 INFO:tasks.workunit.client.0.smithi012.stdout:1/269: rmdir d5/d32/d1b/d2c/d48 39 2023-10-21T17:08:11.486 INFO:tasks.workunit.client.0.smithi012.stdout:3/235: mknod d0/c4a 0 2023-10-21T17:08:11.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/236: dwrite d0/da/f34 [0,4194304] 0 2023-10-21T17:08:12.361 INFO:tasks.workunit.client.0.smithi012.stdout:4/276: creat dc/d15/f5e x:0 0 0 2023-10-21T17:08:12.434 INFO:tasks.workunit.client.0.smithi012.stdout:7/306: mknod d3/d6/c5a 0 2023-10-21T17:08:12.636 INFO:tasks.workunit.client.0.smithi012.stdout:1/270: creat d5/d32/d1b/d2c/d4b/f5d x:0 0 0 2023-10-21T17:08:12.637 INFO:tasks.workunit.client.0.smithi012.stdout:1/271: write d5/d32/d1b/d27/f42 [1220217,109942] 0 2023-10-21T17:08:12.637 INFO:tasks.workunit.client.0.smithi012.stdout:1/272: chown d5/d32/d1b/c2e 8800 1 2023-10-21T17:08:13.303 INFO:tasks.workunit.client.0.smithi012.stdout:8/214: rename d0/f19 to d0/f4f 0 2023-10-21T17:08:13.316 INFO:tasks.workunit.client.0.smithi012.stdout:8/215: dread d0/d1a/f41 [0,4194304] 0 2023-10-21T17:08:13.444 INFO:tasks.workunit.client.0.smithi012.stdout:5/218: rmdir d2/dd/d15 39 2023-10-21T17:08:13.642 INFO:tasks.workunit.client.0.smithi012.stdout:2/291: symlink d1/d4/l5e 0 2023-10-21T17:08:13.841 INFO:tasks.workunit.client.0.smithi012.stdout:0/290: rmdir d7/d55/d23/d27/d31/d3d 39 2023-10-21T17:08:13.946 INFO:tasks.workunit.client.0.smithi012.stdout:0/291: dwrite d7/d55/d23/d66/f57 [4194304,4194304] 0 2023-10-21T17:08:14.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/248: rmdir d13/d15/d1d/d24 39 2023-10-21T17:08:14.091 INFO:tasks.workunit.client.0.smithi012.stdout:4/277: truncate f8 6085563 0 2023-10-21T17:08:14.118 INFO:tasks.workunit.client.0.smithi012.stdout:4/278: dread dc/f42 [0,4194304] 0 2023-10-21T17:08:14.184 INFO:tasks.workunit.client.0.smithi012.stdout:4/279: dwrite dc/d15/d2a/d31/d36/f46 [0,4194304] 0 2023-10-21T17:08:14.256 INFO:tasks.workunit.client.0.smithi012.stdout:4/280: dwrite dc/d15/d2a/d31/f49 [0,4194304] 0 2023-10-21T17:08:14.499 INFO:tasks.workunit.client.0.smithi012.stdout:1/273: mknod d5/d32/d1b/c5e 0 2023-10-21T17:08:14.500 INFO:tasks.workunit.client.0.smithi012.stdout:9/259: link d0/d4/db/d12/d25/d39/d3b/f53 d0/f5a 0 2023-10-21T17:08:14.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/274: write d5/d32/d1b/d35/d3a/f3d [144425,110566] 0 2023-10-21T17:08:14.600 INFO:tasks.workunit.client.0.smithi012.stdout:9/260: dwrite d0/d4/db/d12/f55 [0,4194304] 0 2023-10-21T17:08:14.600 INFO:tasks.workunit.client.0.smithi012.stdout:9/261: truncate d0/d4/d4b/f50 368664 0 2023-10-21T17:08:14.600 INFO:tasks.workunit.client.0.smithi012.stdout:9/262: write d0/f5a [1369587,35292] 0 2023-10-21T17:08:14.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/263: write d0/d4/db/d12/d2a/d36/f38 [373444,4168] 0 2023-10-21T17:08:14.627 INFO:tasks.workunit.client.0.smithi012.stdout:1/275: dwrite d5/d32/d1b/d27/d21/f31 [0,4194304] 0 2023-10-21T17:08:14.972 INFO:tasks.workunit.client.0.smithi012.stdout:5/219: rename d2/d3e/f44 to d2/d6/f4b 0 2023-10-21T17:08:14.972 INFO:tasks.workunit.client.0.smithi012.stdout:5/220: write d2/dd/d15/f3d [867250,45596] 0 2023-10-21T17:08:15.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/292: mkdir d1/d8/d25/d5f 0 2023-10-21T17:08:15.794 INFO:tasks.workunit.client.0.smithi012.stdout:0/292: unlink d7/d55/d23/d66/f20 0 2023-10-21T17:08:16.834 INFO:tasks.workunit.client.0.smithi012.stdout:9/264: link d0/d4/db/d12/f58 d0/d4/db/d12/d25/d39/f5b 0 2023-10-21T17:08:16.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/265: write d0/df/f43 [831498,49462] 0 2023-10-21T17:08:17.033 INFO:tasks.workunit.client.0.smithi012.stdout:8/216: symlink d0/d29/l50 0 2023-10-21T17:08:17.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/276: rename d5/d32/d1b/d35/d3a/d5c/c45 to d5/d32/d1b/d27/d1a/c5f 0 2023-10-21T17:08:17.556 INFO:tasks.workunit.client.0.smithi012.stdout:5/221: symlink d2/d6/l4c 0 2023-10-21T17:08:17.570 INFO:tasks.workunit.client.0.smithi012.stdout:2/293: rmdir d1/d4/d3f 39 2023-10-21T17:08:17.640 INFO:tasks.workunit.client.0.smithi012.stdout:8/217: stat d0/l39 0 2023-10-21T17:08:17.650 INFO:tasks.workunit.client.0.smithi012.stdout:6/249: unlink d13/d15/f18 0 2023-10-21T17:08:17.674 INFO:tasks.workunit.client.0.smithi012.stdout:1/277: dwrite d5/d32/d1b/d27/d21/f31 [0,4194304] 0 2023-10-21T17:08:17.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/266: dwrite d0/fe [4194304,4194304] 0 2023-10-21T17:08:17.739 INFO:tasks.workunit.client.0.smithi012.stdout:9/267: fsync d0/df/f43 0 2023-10-21T17:08:17.739 INFO:tasks.workunit.client.0.smithi012.stdout:9/268: truncate d0/d4/db/d12/d25/d39/d3b/f53 2279375 0 2023-10-21T17:08:17.938 INFO:tasks.workunit.client.0.smithi012.stdout:5/222: creat d2/d1d/d20/f4d x:0 0 0 2023-10-21T17:08:17.938 INFO:tasks.workunit.client.0.smithi012.stdout:5/223: write d2/d2c/f43 [1548927,91269] 0 2023-10-21T17:08:18.108 INFO:tasks.workunit.client.0.smithi012.stdout:2/294: symlink d1/d8/d25/d5f/l60 0 2023-10-21T17:08:18.109 INFO:tasks.workunit.client.0.smithi012.stdout:2/295: fsync d1/d4/f4c 0 2023-10-21T17:08:18.137 INFO:tasks.workunit.client.0.smithi012.stdout:7/307: write d3/d6/dc/d19/f33 [5167521,34805] 0 2023-10-21T17:08:18.233 INFO:tasks.workunit.client.0.smithi012.stdout:7/308: dwrite d3/d6/dc/d19/d28/f3b [0,4194304] 0 2023-10-21T17:08:18.240 INFO:tasks.workunit.client.0.smithi012.stdout:0/293: truncate d7/d55/ff 2913728 0 2023-10-21T17:08:18.326 INFO:tasks.workunit.client.0.smithi012.stdout:7/309: dwrite d3/d16/f56 [0,4194304] 0 2023-10-21T17:08:18.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/250: rename d13/d15/d1d/d24/c41 to d13/d42/c4f 0 2023-10-21T17:08:18.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/251: write ff [1537228,1758] 0 2023-10-21T17:08:18.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/252: chown d13/d15/d1d/f20 94521 1 2023-10-21T17:08:18.657 INFO:tasks.workunit.client.0.smithi012.stdout:1/278: rmdir d5/d26 39 2023-10-21T17:08:18.945 INFO:tasks.workunit.client.0.smithi012.stdout:3/237: write d0/d32/d43/d47/f48 [1854015,24654] 0 2023-10-21T17:08:19.108 INFO:tasks.workunit.client.0.smithi012.stdout:9/269: creat d0/d4/db/d12/d25/d39/f5c x:0 0 0 2023-10-21T17:08:19.575 INFO:tasks.workunit.client.0.smithi012.stdout:0/294: symlink d7/d55/d23/d27/l70 0 2023-10-21T17:08:19.576 INFO:tasks.workunit.client.0.smithi012.stdout:0/295: chown d7/d55/d1f/l26 4803 1 2023-10-21T17:08:20.025 INFO:tasks.workunit.client.0.smithi012.stdout:8/218: mkdir d0/d12/d51 0 2023-10-21T17:08:20.172 INFO:tasks.workunit.client.0.smithi012.stdout:6/253: symlink d13/d29/d37/d3b/l50 0 2023-10-21T17:08:20.172 INFO:tasks.workunit.client.0.smithi012.stdout:6/254: write d13/d15/d1d/d28/f32 [4938404,105829] 0 2023-10-21T17:08:20.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/279: truncate f1 7700 0 2023-10-21T17:08:22.440 INFO:tasks.workunit.client.0.smithi012.stdout:2/296: mknod d1/d4/c61 0 2023-10-21T17:08:22.441 INFO:tasks.workunit.client.0.smithi012.stdout:2/297: fsync d1/d14/d17/f40 0 2023-10-21T17:08:22.633 INFO:tasks.workunit.client.0.smithi012.stdout:0/296: symlink d7/l71 0 2023-10-21T17:08:22.633 INFO:tasks.workunit.client.0.smithi012.stdout:0/297: chown d7/d55/c5e 576 1 2023-10-21T17:08:22.815 INFO:tasks.workunit.client.0.smithi012.stdout:7/310: rmdir d3/d6/dc/d19/d28 39 2023-10-21T17:08:22.956 INFO:tasks.workunit.client.0.smithi012.stdout:8/219: mknod d0/d29/c52 0 2023-10-21T17:08:23.579 INFO:tasks.workunit.client.0.smithi012.stdout:1/280: creat d5/d32/d1b/d27/d1a/d46/f60 x:0 0 0 2023-10-21T17:08:23.604 INFO:tasks.workunit.client.0.smithi012.stdout:1/281: dread d5/d32/d1b/d35/d3a/d5c/f50 [0,4194304] 0 2023-10-21T17:08:23.750 INFO:tasks.workunit.client.0.smithi012.stdout:5/224: mkdir d2/d1d/d4e 0 2023-10-21T17:08:23.750 INFO:tasks.workunit.client.0.smithi012.stdout:5/225: truncate d2/d1d/d20/f4d 211283 0 2023-10-21T17:08:23.852 INFO:tasks.workunit.client.0.smithi012.stdout:2/298: link d1/d4/f4c d1/d4/d3f/d41/d59/f62 0 2023-10-21T17:08:23.936 INFO:tasks.workunit.client.0.smithi012.stdout:2/299: dwrite d1/d8/d19/f57 [0,4194304] 0 2023-10-21T17:08:24.076 INFO:tasks.workunit.client.0.smithi012.stdout:0/298: symlink d7/d55/d1f/d28/l72 0 2023-10-21T17:08:24.077 INFO:tasks.workunit.client.0.smithi012.stdout:0/299: chown d7/d52 1610609 1 2023-10-21T17:08:24.079 INFO:tasks.workunit.client.0.smithi012.stdout:7/311: creat d3/d6/dc/d19/d28/f5b x:0 0 0 2023-10-21T17:08:24.239 INFO:tasks.workunit.client.0.smithi012.stdout:8/220: dread d0/f8 [0,4194304] 0 2023-10-21T17:08:24.239 INFO:tasks.workunit.client.0.smithi012.stdout:8/221: dread - d0/d1a/f24 zero size 2023-10-21T17:08:24.240 INFO:tasks.workunit.client.0.smithi012.stdout:8/222: write d0/d1a/f3d [742987,86922] 0 2023-10-21T17:08:24.385 INFO:tasks.workunit.client.0.smithi012.stdout:6/255: symlink d13/d15/l51 0 2023-10-21T17:08:24.906 INFO:tasks.workunit.client.0.smithi012.stdout:1/282: mkdir d5/d61 0 2023-10-21T17:08:25.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/312: unlink d3/d6/dc/d19/d1e/c44 0 2023-10-21T17:08:25.067 INFO:tasks.workunit.client.0.smithi012.stdout:7/313: chown d3/d6/dc/d19/c37 1149775 1 2023-10-21T17:08:25.067 INFO:tasks.workunit.client.0.smithi012.stdout:7/314: dread - d3/d16/f50 zero size 2023-10-21T17:08:25.067 INFO:tasks.workunit.client.0.smithi012.stdout:8/223: chown d0/d12/c14 2 1 2023-10-21T17:08:25.107 INFO:tasks.workunit.client.0.smithi012.stdout:4/281: creat dc/d1e/f5f x:0 0 0 2023-10-21T17:08:25.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/300: symlink d1/d14/l63 0 2023-10-21T17:08:25.487 INFO:tasks.workunit.client.0.smithi012.stdout:7/315: getdents d3/d6/dc/d19/d43 0 2023-10-21T17:08:25.487 INFO:tasks.workunit.client.0.smithi012.stdout:7/316: write d3/d16/f32 [952428,33218] 0 2023-10-21T17:08:25.553 INFO:tasks.workunit.client.0.smithi012.stdout:8/224: mknod d0/d12/d40/d4a/c53 0 2023-10-21T17:08:25.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/225: fdatasync d0/f35 0 2023-10-21T17:08:25.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/226: stat d0/d12/d40/l4b 0 2023-10-21T17:08:25.853 INFO:tasks.workunit.client.0.smithi012.stdout:4/282: link dc/d15/l24 dc/d15/d2a/d58/l60 0 2023-10-21T17:08:25.884 INFO:tasks.workunit.client.0.smithi012.stdout:4/283: dread dc/f11 [0,4194304] 0 2023-10-21T17:08:26.742 INFO:tasks.workunit.client.0.smithi012.stdout:7/317: creat d3/d6/dc/d19/d1e/f5c x:0 0 0 2023-10-21T17:08:26.826 INFO:tasks.workunit.client.0.smithi012.stdout:8/227: chown d0/l47 47 1 2023-10-21T17:08:26.832 INFO:tasks.workunit.client.0.smithi012.stdout:7/318: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:08:27.424 INFO:tasks.workunit.client.0.smithi012.stdout:8/228: mkdir d0/d1a/d54 0 2023-10-21T17:08:27.811 INFO:tasks.workunit.client.0.smithi012.stdout:8/229: creat d0/d12/d40/d4a/d4e/f55 x:0 0 0 2023-10-21T17:08:27.967 INFO:tasks.workunit.client.0.smithi012.stdout:7/319: symlink d3/d6/dc/l5d 0 2023-10-21T17:08:27.967 INFO:tasks.workunit.client.0.smithi012.stdout:7/320: truncate d3/d6/dc/d19/d1e/f5c 558952 0 2023-10-21T17:08:28.239 INFO:tasks.workunit.client.0.smithi012.stdout:8/230: symlink d0/d1a/l56 0 2023-10-21T17:08:28.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/231: dwrite d0/d29/f3c [0,4194304] 0 2023-10-21T17:08:28.701 INFO:tasks.workunit.client.0.smithi012.stdout:0/300: write d7/d55/d23/d27/d31/f32 [4409476,80712] 0 2023-10-21T17:08:28.701 INFO:tasks.workunit.client.0.smithi012.stdout:3/238: sync 2023-10-21T17:08:28.701 INFO:tasks.workunit.client.0.smithi012.stdout:9/270: sync 2023-10-21T17:08:28.702 INFO:tasks.workunit.client.0.smithi012.stdout:9/271: read - d0/f1b zero size 2023-10-21T17:08:28.738 INFO:tasks.workunit.client.0.smithi012.stdout:0/301: dread d7/d55/d23/d27/f2d [0,4194304] 0 2023-10-21T17:08:28.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/302: dread d7/d55/d23/d27/d31/f3e [0,4194304] 0 2023-10-21T17:08:29.162 INFO:tasks.workunit.client.0.smithi012.stdout:8/232: creat d0/d12/d51/f57 x:0 0 0 2023-10-21T17:08:29.466 INFO:tasks.workunit.client.0.smithi012.stdout:7/321: unlink d3/d6/dc/d19/d28/f5b 0 2023-10-21T17:08:29.467 INFO:tasks.workunit.client.0.smithi012.stdout:3/239: symlink d0/d32/d43/l4b 0 2023-10-21T17:08:29.547 INFO:tasks.workunit.client.0.smithi012.stdout:9/272: mknod d0/d5/c5d 0 2023-10-21T17:08:29.548 INFO:tasks.workunit.client.0.smithi012.stdout:9/273: fsync d0/d5/f59 0 2023-10-21T17:08:29.554 INFO:tasks.workunit.client.0.smithi012.stdout:9/274: write d0/d4/db/d12/d2a/d36/f3c [106145,129143] 0 2023-10-21T17:08:29.800 INFO:tasks.workunit.client.0.smithi012.stdout:1/283: rename d5/d26/d29 to d5/d32/d62 0 2023-10-21T17:08:29.800 INFO:tasks.workunit.client.0.smithi012.stdout:1/284: stat d5/d32/d1b/d27/d1a 0 2023-10-21T17:08:29.800 INFO:tasks.workunit.client.0.smithi012.stdout:0/303: mknod d7/d52/c73 0 2023-10-21T17:08:29.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/285: write d5/d32/d62/fe [829221,65808] 0 2023-10-21T17:08:29.892 INFO:tasks.workunit.client.0.smithi012.stdout:0/304: dwrite d7/d55/d23/f2a [0,4194304] 0 2023-10-21T17:08:29.899 INFO:tasks.workunit.client.0.smithi012.stdout:8/233: unlink d0/f2 0 2023-10-21T17:08:30.319 INFO:tasks.workunit.client.0.smithi012.stdout:9/275: creat d0/df/f5e x:0 0 0 2023-10-21T17:08:30.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/305: symlink d7/d55/d23/d27/d31/d5f/l74 0 2023-10-21T17:08:30.686 INFO:tasks.workunit.client.0.smithi012.stdout:0/306: dread d7/f1d [0,4194304] 0 2023-10-21T17:08:30.686 INFO:tasks.workunit.client.0.smithi012.stdout:0/307: chown d7/d55/d23/d66/ca 890810 1 2023-10-21T17:08:30.829 INFO:tasks.workunit.client.0.smithi012.stdout:8/234: rmdir d0/d12/d40 39 2023-10-21T17:08:30.830 INFO:tasks.workunit.client.0.smithi012.stdout:8/235: fdatasync d0/f36 0 2023-10-21T17:08:30.870 INFO:tasks.workunit.client.0.smithi012.stdout:8/236: dread d0/f36 [0,4194304] 0 2023-10-21T17:08:30.942 INFO:tasks.workunit.client.0.smithi012.stdout:9/276: dread d0/d4/db/d12/d2a/f3a [0,4194304] 0 2023-10-21T17:08:31.001 INFO:tasks.workunit.client.0.smithi012.stdout:4/284: write dc/d15/f47 [1255886,80907] 0 2023-10-21T17:08:31.045 INFO:tasks.workunit.client.0.smithi012.stdout:1/286: truncate d5/ff 906625 0 2023-10-21T17:08:31.046 INFO:tasks.workunit.client.0.smithi012.stdout:1/287: read - d5/d32/d1b/d27/d21/f4e zero size 2023-10-21T17:08:31.046 INFO:tasks.workunit.client.0.smithi012.stdout:1/288: chown d5/c1e 1406149 1 2023-10-21T17:08:32.226 INFO:tasks.workunit.client.0.smithi012.stdout:9/277: truncate d0/df/f43 569819 0 2023-10-21T17:08:33.030 INFO:tasks.workunit.client.0.smithi012.stdout:3/240: write d0/f15 [532909,52072] 0 2023-10-21T17:08:33.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/226: mkdir d2/d4f 0 2023-10-21T17:08:33.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/227: getdents d2/d3e/d49 0 2023-10-21T17:08:33.057 INFO:tasks.workunit.client.0.smithi012.stdout:6/256: write d13/d15/f33 [3108140,124956] 0 2023-10-21T17:08:33.072 INFO:tasks.workunit.client.0.smithi012.stdout:3/241: dread d0/f4 [0,4194304] 0 2023-10-21T17:08:33.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/301: mknod d1/c64 0 2023-10-21T17:08:33.195 INFO:tasks.workunit.client.0.smithi012.stdout:1/289: rename d5/ff to d5/d26/d54/f63 0 2023-10-21T17:08:33.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/237: dwrite d0/f26 [0,4194304] 0 2023-10-21T17:08:33.576 INFO:tasks.workunit.client.0.smithi012.stdout:4/285: dwrite dc/f3b [0,4194304] 0 2023-10-21T17:08:34.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/322: creat d3/d6/dc/f5e x:0 0 0 2023-10-21T17:08:34.264 INFO:tasks.workunit.client.0.smithi012.stdout:6/257: mknod d13/d35/d4c/c52 0 2023-10-21T17:08:34.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/323: readlink d3/d6/l3a 0 2023-10-21T17:08:34.325 INFO:tasks.workunit.client.0.smithi012.stdout:9/278: rename d0/d5/c46 to d0/d4/c5f 0 2023-10-21T17:08:34.406 INFO:tasks.workunit.client.0.smithi012.stdout:1/290: mkdir d5/d26/d64 0 2023-10-21T17:08:34.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:08:34.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:08:34.858 INFO:tasks.workunit.client.0.smithi012.stdout:8/238: creat d0/d12/d51/f58 x:0 0 0 2023-10-21T17:08:34.998 INFO:tasks.workunit.client.0.smithi012.stdout:4/286: link f8 dc/d15/d18/d57/f61 0 2023-10-21T17:08:35.030 INFO:tasks.workunit.client.0.smithi012.stdout:4/287: write dc/d15/d2a/d31/f49 [2896249,31358] 0 2023-10-21T17:08:35.085 INFO:tasks.workunit.client.0.smithi012.stdout:0/308: sync 2023-10-21T17:08:35.101 INFO:tasks.workunit.client.0.smithi012.stdout:0/309: dread d7/d55/d23/d27/d31/f3e [0,4194304] 0 2023-10-21T17:08:35.262 INFO:tasks.workunit.client.0.smithi012.stdout:3/242: sync 2023-10-21T17:08:35.262 INFO:tasks.workunit.client.0.smithi012.stdout:5/228: sync 2023-10-21T17:08:35.263 INFO:tasks.workunit.client.0.smithi012.stdout:7/324: truncate d3/d29/f27 4777367 0 2023-10-21T17:08:35.263 INFO:tasks.workunit.client.0.smithi012.stdout:7/325: truncate d3/d6/dc/d19/d28/f51 267578 0 2023-10-21T17:08:35.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/258: dread d13/d15/f1a [0,4194304] 0 2023-10-21T17:08:35.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/259: fdatasync f10 0 2023-10-21T17:08:35.335 INFO:tasks.workunit.client.0.smithi012.stdout:2/302: write d1/d4/f11 [284228,55735] 0 2023-10-21T17:08:35.547 INFO:tasks.workunit.client.0.smithi012.stdout:9/279: mknod d0/d4/db/d12/c60 0 2023-10-21T17:08:35.548 INFO:tasks.workunit.client.0.smithi012.stdout:1/291: creat d5/d26/d54/f65 x:0 0 0 2023-10-21T17:08:35.986 INFO:tasks.workunit.client.0.smithi012.stdout:8/239: creat d0/d29/f59 x:0 0 0 2023-10-21T17:08:36.290 INFO:tasks.workunit.client.0.smithi012.stdout:0/310: creat d7/d52/d53/f75 x:0 0 0 2023-10-21T17:08:36.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/229: symlink d2/d1d/d20/l50 0 2023-10-21T17:08:36.376 INFO:tasks.workunit.client.0.smithi012.stdout:0/311: dwrite d7/d55/d23/f2a [0,4194304] 0 2023-10-21T17:08:36.377 INFO:tasks.workunit.client.0.smithi012.stdout:0/312: chown d7/d55/d23/d27/d31/d3d/c2f 124 1 2023-10-21T17:08:36.385 INFO:tasks.workunit.client.0.smithi012.stdout:7/326: mknod d3/d16/c5f 0 2023-10-21T17:08:36.881 INFO:tasks.workunit.client.0.smithi012.stdout:6/260: rename d13/d29/d34 to d13/d35/d4c/d53 0 2023-10-21T17:08:37.432 INFO:tasks.workunit.client.0.smithi012.stdout:4/288: dwrite dc/f25 [0,4194304] 0 2023-10-21T17:08:37.432 INFO:tasks.workunit.client.0.smithi012.stdout:4/289: write dc/d15/d2a/d31/f49 [2872691,112998] 0 2023-10-21T17:08:37.463 INFO:tasks.workunit.client.0.smithi012.stdout:4/290: dread dc/f25 [0,4194304] 0 2023-10-21T17:08:37.510 INFO:tasks.workunit.client.0.smithi012.stdout:9/280: rmdir d0/d4/d4b 39 2023-10-21T17:08:37.538 INFO:tasks.workunit.client.0.smithi012.stdout:9/281: write d0/d4/db/d12/d25/d39/d3b/f3f [1174811,6363] 0 2023-10-21T17:08:37.541 INFO:tasks.workunit.client.0.smithi012.stdout:9/282: read d0/d4/db/d12/d2a/d36/f38 [127313,99468] 0 2023-10-21T17:08:37.542 INFO:tasks.workunit.client.0.smithi012.stdout:9/283: read d0/f14 [2467902,66263] 0 2023-10-21T17:08:37.542 INFO:tasks.workunit.client.0.smithi012.stdout:9/284: dread - d0/d5/f32 zero size 2023-10-21T17:08:37.972 INFO:tasks.workunit.client.0.smithi012.stdout:5/230: rmdir d2/dd/d1e 39 2023-10-21T17:08:37.972 INFO:tasks.workunit.client.0.smithi012.stdout:5/231: truncate d2/d1d/d20/f2b 4644850 0 2023-10-21T17:08:38.014 INFO:tasks.workunit.client.0.smithi012.stdout:5/232: dread d2/d6/f7 [4194304,4194304] 0 2023-10-21T17:08:38.307 INFO:tasks.workunit.client.0.smithi012.stdout:7/327: symlink d3/d6/dc/d19/d43/l60 0 2023-10-21T17:08:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:3/243: sync 2023-10-21T17:08:38.851 INFO:tasks.workunit.client.0.smithi012.stdout:2/303: mkdir d1/d4/d65 0 2023-10-21T17:08:39.581 INFO:tasks.workunit.client.0.smithi012.stdout:0/313: sync 2023-10-21T17:08:39.581 INFO:tasks.workunit.client.0.smithi012.stdout:4/291: rmdir dc/d28/d4f 0 2023-10-21T17:08:39.581 INFO:tasks.workunit.client.0.smithi012.stdout:4/292: readlink dc/d15/l24 0 2023-10-21T17:08:39.581 INFO:tasks.workunit.client.0.smithi012.stdout:4/293: chown l4 1357701013 1 2023-10-21T17:08:39.582 INFO:tasks.workunit.client.0.smithi012.stdout:4/294: readlink l2 0 2023-10-21T17:08:40.177 INFO:tasks.workunit.client.0.smithi012.stdout:5/233: creat d2/d6/f51 x:0 0 0 2023-10-21T17:08:40.177 INFO:tasks.workunit.client.0.smithi012.stdout:5/234: dread - d2/d2c/f42 zero size 2023-10-21T17:08:40.177 INFO:tasks.workunit.client.0.smithi012.stdout:7/328: creat d3/d6/dc/d19/d43/f61 x:0 0 0 2023-10-21T17:08:40.211 INFO:tasks.workunit.client.0.smithi012.stdout:2/304: creat d1/d14/d16/d58/f66 x:0 0 0 2023-10-21T17:08:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:3/244: dread d0/da/f1f [0,4194304] 0 2023-10-21T17:08:40.332 INFO:tasks.workunit.client.0.smithi012.stdout:3/245: dwrite d0/da/fb [0,4194304] 0 2023-10-21T17:08:40.332 INFO:tasks.workunit.client.0.smithi012.stdout:6/261: link d13/d15/d1d/f20 d13/f54 0 2023-10-21T17:08:40.359 INFO:tasks.workunit.client.0.smithi012.stdout:6/262: dread d13/f47 [0,4194304] 0 2023-10-21T17:08:40.449 INFO:tasks.workunit.client.0.smithi012.stdout:6/263: dwrite f1 [0,4194304] 0 2023-10-21T17:08:40.450 INFO:tasks.workunit.client.0.smithi012.stdout:6/264: write f10 [3529529,65782] 0 2023-10-21T17:08:40.792 INFO:tasks.workunit.client.0.smithi012.stdout:0/314: mknod d7/d55/d23/d27/d40/c76 0 2023-10-21T17:08:40.792 INFO:tasks.workunit.client.0.smithi012.stdout:4/295: link dc/d15/d18/d4c/l5b dc/d15/d2a/d31/l62 0 2023-10-21T17:08:40.835 INFO:tasks.workunit.client.0.smithi012.stdout:8/240: link d0/d1a/l21 d0/d46/l5a 0 2023-10-21T17:08:41.158 INFO:tasks.workunit.client.0.smithi012.stdout:5/235: rmdir d2/d1d 39 2023-10-21T17:08:41.424 INFO:tasks.workunit.client.0.smithi012.stdout:3/246: link d0/d1c/c21 d0/da/d28/c4c 0 2023-10-21T17:08:41.883 INFO:tasks.workunit.client.0.smithi012.stdout:4/296: dread f8 [0,4194304] 0 2023-10-21T17:08:42.148 INFO:tasks.workunit.client.0.smithi012.stdout:8/241: unlink d0/d29/l50 0 2023-10-21T17:08:42.148 INFO:tasks.workunit.client.0.smithi012.stdout:8/242: fsync d0/d12/f37 0 2023-10-21T17:08:42.366 INFO:tasks.workunit.client.0.smithi012.stdout:1/292: rename d5/c2d to d5/d32/d62/c66 0 2023-10-21T17:08:42.385 INFO:tasks.workunit.client.0.smithi012.stdout:1/293: dread d5/d32/d1b/d27/f20 [0,4194304] 0 2023-10-21T17:08:42.418 INFO:tasks.workunit.client.0.smithi012.stdout:1/294: write d5/f11 [2565839,53910] 0 2023-10-21T17:08:42.451 INFO:tasks.workunit.client.0.smithi012.stdout:1/295: dread d5/d32/d1b/d27/d1a/f1d [0,4194304] 0 2023-10-21T17:08:42.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/296: dread d5/d32/f3c [0,4194304] 0 2023-10-21T17:08:42.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/297: getdents d5/d32/d1b/d27/d47 0 2023-10-21T17:08:42.854 INFO:tasks.workunit.client.0.smithi012.stdout:8/243: mkdir d0/d12/d40/d4a/d5b 0 2023-10-21T17:08:43.485 INFO:tasks.workunit.client.0.smithi012.stdout:1/298: dread d5/d26/d54/f63 [0,4194304] 0 2023-10-21T17:08:43.865 INFO:tasks.workunit.client.0.smithi012.stdout:4/297: unlink dc/d1e/d2b/f38 0 2023-10-21T17:08:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:9/285: symlink d0/d4/l61 0 2023-10-21T17:08:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:9/286: read d0/f8 [4065657,33559] 0 2023-10-21T17:08:44.441 INFO:tasks.workunit.client.0.smithi012.stdout:7/329: dwrite d3/d16/f32 [0,4194304] 0 2023-10-21T17:08:44.512 INFO:tasks.workunit.client.0.smithi012.stdout:7/330: dwrite d3/d6/dc/d19/d28/f3b [4194304,4194304] 0 2023-10-21T17:08:44.517 INFO:tasks.workunit.client.0.smithi012.stdout:2/305: rename d1/d4/l29 to d1/d14/d16/d58/l67 0 2023-10-21T17:08:44.518 INFO:tasks.workunit.client.0.smithi012.stdout:2/306: creat d1/d8/d19/d50/f68 x:0 0 0 2023-10-21T17:08:44.529 INFO:tasks.workunit.client.0.smithi012.stdout:7/331: dread d3/f3f [0,4194304] 0 2023-10-21T17:08:44.529 INFO:tasks.workunit.client.0.smithi012.stdout:7/332: truncate d3/d6/dc/f54 896981 0 2023-10-21T17:08:44.743 INFO:tasks.workunit.client.0.smithi012.stdout:1/299: creat d5/d30/f67 x:0 0 0 2023-10-21T17:08:44.764 INFO:tasks.workunit.client.0.smithi012.stdout:1/300: write d5/d32/f3c [1748718,111632] 0 2023-10-21T17:08:44.765 INFO:tasks.workunit.client.0.smithi012.stdout:1/301: fdatasync d5/d32/d62/fe 0 2023-10-21T17:08:44.855 INFO:tasks.workunit.client.0.smithi012.stdout:1/302: dwrite d5/d32/d1b/d35/d3a/d5c/f50 [4194304,4194304] 0 2023-10-21T17:08:45.054 INFO:tasks.workunit.client.0.smithi012.stdout:0/315: dwrite d7/d55/ff [0,4194304] 0 2023-10-21T17:08:45.055 INFO:tasks.workunit.client.0.smithi012.stdout:0/316: write d7/d55/d23/d27/d31/f4f [214280,87574] 0 2023-10-21T17:08:45.128 INFO:tasks.workunit.client.0.smithi012.stdout:0/317: dwrite f6 [0,4194304] 0 2023-10-21T17:08:45.186 INFO:tasks.workunit.client.0.smithi012.stdout:9/287: rmdir d0/df/d44 39 2023-10-21T17:08:45.189 INFO:tasks.workunit.client.0.smithi012.stdout:0/318: dwrite d7/d60/f6c [0,4194304] 0 2023-10-21T17:08:45.189 INFO:tasks.workunit.client.0.smithi012.stdout:0/319: fsync d7/d55/d23/d66/f57 0 2023-10-21T17:08:45.396 INFO:tasks.workunit.client.0.smithi012.stdout:5/236: dwrite d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:08:45.578 INFO:tasks.workunit.client.0.smithi012.stdout:8/244: rename d0/d29/l2d to d0/d12/d40/d4a/d5b/l5c 0 2023-10-21T17:08:45.845 INFO:tasks.workunit.client.0.smithi012.stdout:2/307: link d1/d14/d17/f1f d1/d4/d3f/d41/d59/f69 0 2023-10-21T17:08:46.484 INFO:tasks.workunit.client.0.smithi012.stdout:1/303: mkdir d5/d26/d54/d68 0 2023-10-21T17:08:46.485 INFO:tasks.workunit.client.0.smithi012.stdout:9/288: creat d0/d4/db/d12/d25/d2f/f62 x:0 0 0 2023-10-21T17:08:46.590 INFO:tasks.workunit.client.0.smithi012.stdout:3/247: dwrite d0/da/f1f [0,4194304] 0 2023-10-21T17:08:46.634 INFO:tasks.workunit.client.0.smithi012.stdout:6/265: write d13/d15/f1f [1252013,124109] 0 2023-10-21T17:08:46.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/248: dread d0/da/f34 [0,4194304] 0 2023-10-21T17:08:47.133 INFO:tasks.workunit.client.0.smithi012.stdout:0/320: creat d7/d52/f77 x:0 0 0 2023-10-21T17:08:47.134 INFO:tasks.workunit.client.0.smithi012.stdout:5/237: link d2/d6/lf d2/d1d/d29/l52 0 2023-10-21T17:08:47.333 INFO:tasks.workunit.client.0.smithi012.stdout:8/245: dread d0/f4 [0,4194304] 0 2023-10-21T17:08:47.563 INFO:tasks.workunit.client.0.smithi012.stdout:2/308: unlink d1/d14/l63 0 2023-10-21T17:08:47.701 INFO:tasks.workunit.client.0.smithi012.stdout:1/304: mkdir d5/d32/d1b/d35/d49/d69 0 2023-10-21T17:08:47.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/289: unlink d0/d4/db/d12/d25/d39/f5c 0 2023-10-21T17:08:48.116 INFO:tasks.workunit.client.0.smithi012.stdout:6/266: symlink d13/d35/l55 0 2023-10-21T17:08:48.245 INFO:tasks.workunit.client.0.smithi012.stdout:0/321: symlink d7/d52/l78 0 2023-10-21T17:08:48.490 INFO:tasks.workunit.client.0.smithi012.stdout:8/246: creat d0/d46/f5d x:0 0 0 2023-10-21T17:08:48.755 INFO:tasks.workunit.client.0.smithi012.stdout:2/309: rename d1/d4/f11 to d1/d8/d19/d50/f6a 0 2023-10-21T17:08:48.756 INFO:tasks.workunit.client.0.smithi012.stdout:2/310: chown d1/d4/d3f/d4a 169 1 2023-10-21T17:08:48.825 INFO:tasks.workunit.client.0.smithi012.stdout:1/305: mknod d5/d32/d1b/d27/c6a 0 2023-10-21T17:08:49.180 INFO:tasks.workunit.client.0.smithi012.stdout:2/311: fsync d1/d14/d16/d20/f2e 0 2023-10-21T17:08:50.535 INFO:tasks.workunit.client.0.smithi012.stdout:4/298: mkdir dc/d15/d63 0 2023-10-21T17:08:50.727 INFO:tasks.workunit.client.0.smithi012.stdout:6/267: truncate d13/d15/f33 2103665 0 2023-10-21T17:08:51.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/322: mknod d7/d55/d23/d30/c79 0 2023-10-21T17:08:51.015 INFO:tasks.workunit.client.0.smithi012.stdout:0/323: truncate d7/d55/d23/d27/d31/d3d/f6e 978159 0 2023-10-21T17:08:51.015 INFO:tasks.workunit.client.0.smithi012.stdout:0/324: dread - d7/d55/d23/d66/d48/f61 zero size 2023-10-21T17:08:51.299 INFO:tasks.workunit.client.0.smithi012.stdout:5/238: getdents d2/d2c 0 2023-10-21T17:08:51.497 INFO:tasks.workunit.client.0.smithi012.stdout:7/333: symlink d3/d6/l62 0 2023-10-21T17:08:51.714 INFO:tasks.workunit.client.0.smithi012.stdout:1/306: mknod d5/d32/d1b/d35/d3a/c6b 0 2023-10-21T17:08:51.715 INFO:tasks.workunit.client.0.smithi012.stdout:2/312: symlink d1/d14/d16/d58/l6b 0 2023-10-21T17:08:51.718 INFO:tasks.workunit.client.0.smithi012.stdout:1/307: write d5/d32/d1b/d27/f42 [131045,36924] 0 2023-10-21T17:08:51.718 INFO:tasks.workunit.client.0.smithi012.stdout:1/308: fsync d5/f10 0 2023-10-21T17:08:51.829 INFO:tasks.workunit.client.0.smithi012.stdout:1/309: dwrite d5/d32/d1b/d27/d1a/d46/f60 [0,4194304] 0 2023-10-21T17:08:51.829 INFO:tasks.workunit.client.0.smithi012.stdout:1/310: dread - d5/d32/d1b/d27/d21/f2b zero size 2023-10-21T17:08:51.905 INFO:tasks.workunit.client.0.smithi012.stdout:4/299: creat dc/d15/d18/d4c/d55/f64 x:0 0 0 2023-10-21T17:08:51.953 INFO:tasks.workunit.client.0.smithi012.stdout:4/300: dread fb [0,4194304] 0 2023-10-21T17:08:52.355 INFO:tasks.workunit.client.0.smithi012.stdout:0/325: mknod d7/d55/d23/d27/d31/d3d/c7a 0 2023-10-21T17:08:52.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/239: chown l1 694927158 1 2023-10-21T17:08:52.987 INFO:tasks.workunit.client.0.smithi012.stdout:2/313: fdatasync d1/d4/f7 0 2023-10-21T17:08:53.222 INFO:tasks.workunit.client.0.smithi012.stdout:4/301: truncate dc/d15/d18/d57/f61 3254243 0 2023-10-21T17:08:53.248 INFO:tasks.workunit.client.0.smithi012.stdout:4/302: write dc/f42 [3296528,64444] 0 2023-10-21T17:08:53.344 INFO:tasks.workunit.client.0.smithi012.stdout:6/268: rename d13/d15/d1d/l3c to d13/d15/l56 0 2023-10-21T17:08:53.344 INFO:tasks.workunit.client.0.smithi012.stdout:6/269: dread - d13/f36 zero size 2023-10-21T17:08:53.493 INFO:tasks.workunit.client.0.smithi012.stdout:0/326: link d7/d55/d23/d27/d31/f4f d7/f7b 0 2023-10-21T17:08:53.742 INFO:tasks.workunit.client.0.smithi012.stdout:2/314: link d1/d4/c61 d1/d14/d16/d58/c6c 0 2023-10-21T17:08:53.929 INFO:tasks.workunit.client.0.smithi012.stdout:6/270: link f8 d13/d29/d37/d3b/f57 0 2023-10-21T17:08:54.216 INFO:tasks.workunit.client.0.smithi012.stdout:2/315: chown d1/d14/l38 65249 1 2023-10-21T17:08:54.217 INFO:tasks.workunit.client.0.smithi012.stdout:2/316: chown d1/d8/d25/f42 5276642 1 2023-10-21T17:08:54.217 INFO:tasks.workunit.client.0.smithi012.stdout:2/317: write d1/d14/d16/f3e [497833,86880] 0 2023-10-21T17:08:54.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/318: dwrite d1/d14/d16/d20/f3b [0,4194304] 0 2023-10-21T17:08:54.460 INFO:tasks.workunit.client.0.smithi012.stdout:7/334: rename d3/d29/f26 to d3/d6/dc/f63 0 2023-10-21T17:08:54.782 INFO:tasks.workunit.client.0.smithi012.stdout:6/271: creat d13/d29/d37/d3b/f58 x:0 0 0 2023-10-21T17:08:55.385 INFO:tasks.workunit.client.0.smithi012.stdout:2/319: getdents d1/d14/d16 0 2023-10-21T17:08:55.386 INFO:tasks.workunit.client.0.smithi012.stdout:2/320: stat d1/d14/d16/d58/l6b 0 2023-10-21T17:08:55.386 INFO:tasks.workunit.client.0.smithi012.stdout:2/321: dread - d1/d8/d25/f42 zero size 2023-10-21T17:08:55.465 INFO:tasks.workunit.client.0.smithi012.stdout:8/247: dwrite d0/fb [4194304,4194304] 0 2023-10-21T17:08:55.465 INFO:tasks.workunit.client.0.smithi012.stdout:8/248: dread - d0/d12/d40/d4a/d4e/f55 zero size 2023-10-21T17:08:55.466 INFO:tasks.workunit.client.0.smithi012.stdout:8/249: write d0/d12/f37 [4468251,110208] 0 2023-10-21T17:08:55.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/311: rename d5/d32/d1b/d35/d3a/d5c/f50 to d5/d32/d1b/d2c/d48/f6c 0 2023-10-21T17:08:55.616 INFO:tasks.workunit.client.0.smithi012.stdout:9/290: sync 2023-10-21T17:08:55.616 INFO:tasks.workunit.client.0.smithi012.stdout:9/291: write d0/d15/f57 [268160,23231] 0 2023-10-21T17:08:55.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/272: symlink d13/d35/d4c/l59 0 2023-10-21T17:08:55.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/273: creat d13/d29/f5a x:0 0 0 2023-10-21T17:08:56.062 INFO:tasks.workunit.client.0.smithi012.stdout:2/322: dread d1/fe [0,4194304] 0 2023-10-21T17:08:56.122 INFO:tasks.workunit.client.0.smithi012.stdout:8/250: stat d0/l44 0 2023-10-21T17:08:56.364 INFO:tasks.workunit.client.0.smithi012.stdout:4/303: rename dc/d15/d63 to dc/d1e/d65 0 2023-10-21T17:08:56.562 INFO:tasks.workunit.client.0.smithi012.stdout:1/312: symlink d5/d32/d1b/d35/d49/d69/l6d 0 2023-10-21T17:08:56.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/292: unlink d0/d4/db/d12/f21 0 2023-10-21T17:08:56.649 INFO:tasks.workunit.client.0.smithi012.stdout:9/293: readlink d0/d4/db/l20 0 2023-10-21T17:08:57.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/274: rmdir d13/d35/d4c/d53 0 2023-10-21T17:08:57.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/275: dread - d13/f36 zero size 2023-10-21T17:08:58.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/304: creat dc/d1e/d65/f66 x:0 0 0 2023-10-21T17:08:58.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/305: stat dc/f3b 0 2023-10-21T17:08:58.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/313: creat d5/d26/d54/d68/f6e x:0 0 0 2023-10-21T17:08:58.831 INFO:tasks.workunit.client.0.smithi012.stdout:6/276: dwrite d13/d15/f26 [0,4194304] 0 2023-10-21T17:08:58.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/240: rename d2/d1d/d29/f46 to d2/dd/d1e/f53 0 2023-10-21T17:08:58.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/241: creat d2/d6/f54 x:0 0 0 2023-10-21T17:08:59.176 INFO:tasks.workunit.client.0.smithi012.stdout:4/306: creat dc/f67 x:0 0 0 2023-10-21T17:08:59.176 INFO:tasks.workunit.client.0.smithi012.stdout:1/314: symlink d5/d32/d1b/d27/d47/l6f 0 2023-10-21T17:08:59.197 INFO:tasks.workunit.client.0.smithi012.stdout:1/315: dread d5/d32/d1b/d27/f42 [0,4194304] 0 2023-10-21T17:08:59.198 INFO:tasks.workunit.client.0.smithi012.stdout:1/316: dread - d5/d32/d1b/d27/d21/f4e zero size 2023-10-21T17:08:59.198 INFO:tasks.workunit.client.0.smithi012.stdout:1/317: dread - d5/d26/d54/d68/f6e zero size 2023-10-21T17:08:59.198 INFO:tasks.workunit.client.0.smithi012.stdout:1/318: creat d5/d32/d1b/d2c/d4b/f70 x:0 0 0 2023-10-21T17:08:59.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/327: write d7/d55/d1f/f2e [1633658,39657] 0 2023-10-21T17:08:59.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/328: chown d7/d52/l5c 230 1 2023-10-21T17:08:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:0/329: dread d7/d55/d23/f2a [0,4194304] 0 2023-10-21T17:08:59.749 INFO:tasks.workunit.client.0.smithi012.stdout:5/242: rename d2/d2c/c35 to d2/c55 0 2023-10-21T17:08:59.756 INFO:tasks.workunit.client.0.smithi012.stdout:0/330: dwrite d7/d55/d1f/f2e [0,4194304] 0 2023-10-21T17:09:00.164 INFO:tasks.workunit.client.0.smithi012.stdout:4/307: creat dc/d1e/d65/f68 x:0 0 0 2023-10-21T17:09:00.407 INFO:tasks.workunit.client.0.smithi012.stdout:5/243: creat d2/d1d/f56 x:0 0 0 2023-10-21T17:09:00.408 INFO:tasks.workunit.client.0.smithi012.stdout:5/244: read d2/d2c/f43 [1573921,105794] 0 2023-10-21T17:09:00.659 INFO:tasks.workunit.client.0.smithi012.stdout:0/331: getdents d7/d55/d23 0 2023-10-21T17:09:00.694 INFO:tasks.workunit.client.0.smithi012.stdout:0/332: dread f6 [0,4194304] 0 2023-10-21T17:09:00.920 INFO:tasks.workunit.client.0.smithi012.stdout:5/245: unlink d2/d6/f25 0 2023-10-21T17:09:01.014 INFO:tasks.workunit.client.0.smithi012.stdout:5/246: dwrite d2/f18 [4194304,4194304] 0 2023-10-21T17:09:01.037 INFO:tasks.workunit.client.0.smithi012.stdout:0/333: mknod d7/d55/d23/d27/d40/c7c 0 2023-10-21T17:09:01.058 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:42:27.040 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.117 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:42:27.201 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.118 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:42:27.202 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.125 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:42:27.209 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.127 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:42:27.211 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.150 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:42:27.235 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.158 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:42:27.242 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.178 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:42:27.161 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.287 INFO:tasks.workunit.client.0.smithi012.stdout:5/247: mkdir d2/d1d/d29/d57 0 2023-10-21T17:09:01.342 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:42:27.325 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:09:01.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/334: unlink d7/d55/d23/d27/f2d 0 2023-10-21T17:09:01.745 INFO:tasks.workunit.client.0.smithi012.stdout:3/249: link d0/d1c/l1d d0/l4d 0 2023-10-21T17:09:01.851 INFO:tasks.workunit.client.0.smithi012.stdout:5/248: symlink d2/d2c/l58 0 2023-10-21T17:09:02.080 INFO:tasks.workunit.client.0.smithi012.stdout:0/335: mknod d7/d55/d23/c7d 0 2023-10-21T17:09:02.168 INFO:tasks.workunit.client.0.smithi012.stdout:3/250: link d0/da/f34 d0/d32/f4e 0 2023-10-21T17:09:02.168 INFO:tasks.workunit.client.0.smithi012.stdout:3/251: write d0/fd [4754616,103148] 0 2023-10-21T17:09:02.447 INFO:tasks.workunit.client.0.smithi012.stdout:5/249: mkdir d2/d4f/d59 0 2023-10-21T17:09:02.477 INFO:tasks.workunit.client.0.smithi012.stdout:5/250: dread d2/dd/d1e/f53 [0,4194304] 0 2023-10-21T17:09:02.550 INFO:tasks.workunit.client.0.smithi012.stdout:5/251: dwrite d2/dd/f41 [0,4194304] 0 2023-10-21T17:09:02.791 INFO:tasks.workunit.client.0.smithi012.stdout:9/294: dwrite d0/df/f43 [0,4194304] 0 2023-10-21T17:09:02.791 INFO:tasks.workunit.client.0.smithi012.stdout:9/295: chown d0/df/l1f 40200036 1 2023-10-21T17:09:02.791 INFO:tasks.workunit.client.0.smithi012.stdout:9/296: read - d0/d4/db/d12/d25/d2f/f62 zero size 2023-10-21T17:09:02.792 INFO:tasks.workunit.client.0.smithi012.stdout:9/297: chown d0/d4/db/d12/d25/d39/f5b 111470 1 2023-10-21T17:09:02.800 INFO:tasks.workunit.client.0.smithi012.stdout:6/277: write d13/d15/f33 [2766316,100986] 0 2023-10-21T17:09:02.801 INFO:tasks.workunit.client.0.smithi012.stdout:6/278: stat d13/d15/d1d/d28/l3d 0 2023-10-21T17:09:02.856 INFO:tasks.workunit.client.0.smithi012.stdout:9/298: dwrite d0/d4/db/d12/f55 [0,4194304] 0 2023-10-21T17:09:02.879 INFO:tasks.workunit.client.0.smithi012.stdout:6/279: dwrite d13/d15/d1d/d24/f2f [0,4194304] 0 2023-10-21T17:09:02.879 INFO:tasks.workunit.client.0.smithi012.stdout:6/280: write d13/d15/d1d/d28/f39 [959785,96326] 0 2023-10-21T17:09:03.106 INFO:tasks.workunit.client.0.smithi012.stdout:3/252: symlink d0/da/l4f 0 2023-10-21T17:09:03.174 INFO:tasks.workunit.client.0.smithi012.stdout:3/253: dwrite d0/da/d28/f40 [0,4194304] 0 2023-10-21T17:09:03.211 INFO:tasks.workunit.client.0.smithi012.stdout:3/254: dread d0/f46 [0,4194304] 0 2023-10-21T17:09:03.627 INFO:tasks.workunit.client.0.smithi012.stdout:9/299: creat d0/df/f63 x:0 0 0 2023-10-21T17:09:03.627 INFO:tasks.workunit.client.0.smithi012.stdout:9/300: chown d0/d5/f32 6 1 2023-10-21T17:09:03.692 INFO:tasks.workunit.client.0.smithi012.stdout:9/301: dwrite d0/f5a [0,4194304] 0 2023-10-21T17:09:03.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/308: write dc/d1e/f3c [1224011,1037] 0 2023-10-21T17:09:04.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/336: getdents d7/d55/d23/d27/d40 0 2023-10-21T17:09:04.037 INFO:tasks.workunit.client.0.smithi012.stdout:0/337: chown d7/d55/d1f/d28/l72 15 1 2023-10-21T17:09:04.132 INFO:tasks.workunit.client.0.smithi012.stdout:0/338: dwrite d7/d55/d1f/f4a [0,4194304] 0 2023-10-21T17:09:04.169 INFO:tasks.workunit.client.0.smithi012.stdout:3/255: unlink d0/da/fb 0 2023-10-21T17:09:04.462 INFO:tasks.workunit.client.0.smithi012.stdout:9/302: creat d0/d4/db/d12/d2a/d36/f64 x:0 0 0 2023-10-21T17:09:04.506 INFO:tasks.workunit.client.0.smithi012.stdout:9/303: dread d0/f14 [0,4194304] 0 2023-10-21T17:09:04.570 INFO:tasks.workunit.client.0.smithi012.stdout:4/309: getdents dc/d15/d18/d4c 0 2023-10-21T17:09:04.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:09:04.652 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:09:04.668 INFO:tasks.workunit.client.0.smithi012.stdout:4/310: dwrite dc/d1e/f44 [0,4194304] 0 2023-10-21T17:09:04.794 INFO:tasks.workunit.client.0.smithi012.stdout:0/339: creat d7/d55/d23/d66/d48/f7e x:0 0 0 2023-10-21T17:09:05.371 INFO:tasks.workunit.client.0.smithi012.stdout:3/256: mkdir d0/d32/d43/d47/d50 0 2023-10-21T17:09:05.403 INFO:tasks.workunit.client.0.smithi012.stdout:3/257: dread d0/f7 [0,4194304] 0 2023-10-21T17:09:05.403 INFO:tasks.workunit.client.0.smithi012.stdout:3/258: fsync d0/da/f3d 0 2023-10-21T17:09:05.555 INFO:tasks.workunit.client.0.smithi012.stdout:9/304: link d0/d4/db/d12/d25/d39/d3b/f53 d0/d4/db/d12/d25/d2f/f65 0 2023-10-21T17:09:06.244 INFO:tasks.workunit.client.0.smithi012.stdout:2/323: symlink d1/l6d 0 2023-10-21T17:09:06.459 INFO:tasks.workunit.client.0.smithi012.stdout:4/311: rename dc/d1e/l2f to dc/d15/d2a/l69 0 2023-10-21T17:09:06.460 INFO:tasks.workunit.client.0.smithi012.stdout:7/335: mkdir d3/d64 0 2023-10-21T17:09:06.460 INFO:tasks.workunit.client.0.smithi012.stdout:7/336: creat d3/d16/f65 x:0 0 0 2023-10-21T17:09:06.495 INFO:tasks.workunit.client.0.smithi012.stdout:7/337: write d3/d16/f56 [1257881,1299] 0 2023-10-21T17:09:06.940 INFO:tasks.workunit.client.0.smithi012.stdout:3/259: readlink d0/l16 0 2023-10-21T17:09:07.143 INFO:tasks.workunit.client.0.smithi012.stdout:9/305: symlink d0/d15/l66 0 2023-10-21T17:09:07.183 INFO:tasks.workunit.client.0.smithi012.stdout:9/306: dread d0/df/f43 [0,4194304] 0 2023-10-21T17:09:07.316 INFO:tasks.workunit.client.0.smithi012.stdout:2/324: creat d1/d14/f6e x:0 0 0 2023-10-21T17:09:07.316 INFO:tasks.workunit.client.0.smithi012.stdout:4/312: rename dc/d28/l45 to dc/d15/d2a/l6a 0 2023-10-21T17:09:07.607 INFO:tasks.workunit.client.0.smithi012.stdout:7/338: creat d3/d6/f66 x:0 0 0 2023-10-21T17:09:07.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/339: fsync d3/d6/dc/d19/f33 0 2023-10-21T17:09:07.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/340: write d3/d29/f45 [46094,25517] 0 2023-10-21T17:09:07.615 INFO:tasks.workunit.client.0.smithi012.stdout:7/341: read d3/d6/dc/d19/f30 [317285,111430] 0 2023-10-21T17:09:07.844 INFO:tasks.workunit.client.0.smithi012.stdout:9/307: mkdir d0/d4/db/d12/d25/d39/d3b/d67 0 2023-10-21T17:09:07.954 INFO:tasks.workunit.client.0.smithi012.stdout:6/281: write f1 [4409106,62153] 0 2023-10-21T17:09:07.954 INFO:tasks.workunit.client.0.smithi012.stdout:6/282: fsync d13/d29/d37/d3b/f58 0 2023-10-21T17:09:07.996 INFO:tasks.workunit.client.0.smithi012.stdout:2/325: symlink d1/d14/d16/d58/l6f 0 2023-10-21T17:09:08.182 INFO:tasks.workunit.client.0.smithi012.stdout:5/252: truncate d2/dd/f41 2302137 0 2023-10-21T17:09:08.182 INFO:tasks.workunit.client.0.smithi012.stdout:5/253: chown d2/d1d/d29/l3a 3 1 2023-10-21T17:09:08.194 INFO:tasks.workunit.client.0.smithi012.stdout:7/342: dread d3/d6/dc/d19/d28/f51 [0,4194304] 0 2023-10-21T17:09:08.208 INFO:tasks.workunit.client.0.smithi012.stdout:7/343: dread d3/d6/dc/d19/d1e/f5c [0,4194304] 0 2023-10-21T17:09:08.209 INFO:tasks.workunit.client.0.smithi012.stdout:7/344: creat d3/d16/f67 x:0 0 0 2023-10-21T17:09:08.210 INFO:tasks.workunit.client.0.smithi012.stdout:5/254: dread d2/dd/d1e/f53 [0,4194304] 0 2023-10-21T17:09:08.405 INFO:tasks.workunit.client.0.smithi012.stdout:9/308: rename d0/c52 to d0/d4/c68 0 2023-10-21T17:09:08.405 INFO:tasks.workunit.client.0.smithi012.stdout:9/309: creat d0/d5/f69 x:0 0 0 2023-10-21T17:09:08.522 INFO:tasks.workunit.client.0.smithi012.stdout:6/283: mkdir d13/d15/d1d/d28/d5b 0 2023-10-21T17:09:08.661 INFO:tasks.workunit.client.0.smithi012.stdout:2/326: truncate d1/d8/d19/f57 2547723 0 2023-10-21T17:09:10.302 INFO:tasks.workunit.client.0.smithi012.stdout:6/284: link d13/d15/d1d/d24/f2f d13/d42/f5c 0 2023-10-21T17:09:10.303 INFO:tasks.workunit.client.0.smithi012.stdout:6/285: stat d13/d15/d1d/d28/f32 0 2023-10-21T17:09:10.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/286: write fd [1232682,69357] 0 2023-10-21T17:09:10.418 INFO:tasks.workunit.client.0.smithi012.stdout:6/287: dwrite f7 [4194304,4194304] 0 2023-10-21T17:09:10.833 INFO:tasks.workunit.client.0.smithi012.stdout:8/251: sync 2023-10-21T17:09:10.833 INFO:tasks.workunit.client.0.smithi012.stdout:1/319: sync 2023-10-21T17:09:10.951 INFO:tasks.workunit.client.0.smithi012.stdout:1/320: dwrite d5/d32/d1b/d27/d21/f4e [0,4194304] 0 2023-10-21T17:09:11.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/321: dwrite d5/d32/d62/fe [0,4194304] 0 2023-10-21T17:09:11.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/322: readlink d5/d32/d1b/d27/d21/l24 0 2023-10-21T17:09:11.321 INFO:tasks.workunit.client.0.smithi012.stdout:0/340: dwrite d7/f10 [0,4194304] 0 2023-10-21T17:09:11.378 INFO:tasks.workunit.client.0.smithi012.stdout:8/252: readlink d0/d1a/l1c 0 2023-10-21T17:09:11.655 INFO:tasks.workunit.client.0.smithi012.stdout:9/310: rename d0/d4/db to d0/d4/d4b/d6a 0 2023-10-21T17:09:11.656 INFO:tasks.workunit.client.0.smithi012.stdout:9/311: fsync d0/df/f5e 0 2023-10-21T17:09:12.327 INFO:tasks.workunit.client.0.smithi012.stdout:0/341: mkdir d7/d55/d1f/d7f 0 2023-10-21T17:09:12.328 INFO:tasks.workunit.client.0.smithi012.stdout:0/342: creat d7/d55/d23/d66/d48/f80 x:0 0 0 2023-10-21T17:09:12.328 INFO:tasks.workunit.client.0.smithi012.stdout:0/343: write d7/d60/f6f [115193,36647] 0 2023-10-21T17:09:12.329 INFO:tasks.workunit.client.0.smithi012.stdout:0/344: write d7/d55/d23/d66/d48/f61 [666885,65746] 0 2023-10-21T17:09:12.329 INFO:tasks.workunit.client.0.smithi012.stdout:3/260: truncate d0/fd 2749530 0 2023-10-21T17:09:12.545 INFO:tasks.workunit.client.0.smithi012.stdout:8/253: creat d0/d12/d40/d4a/f5e x:0 0 0 2023-10-21T17:09:12.700 INFO:tasks.workunit.client.0.smithi012.stdout:2/327: rename d1/d14/d16/d20/f5c to d1/d8/d25/f70 0 2023-10-21T17:09:12.701 INFO:tasks.workunit.client.0.smithi012.stdout:2/328: write d1/d8/ff [4551710,12608] 0 2023-10-21T17:09:13.628 INFO:tasks.workunit.client.0.smithi012.stdout:5/255: dwrite d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:09:13.628 INFO:tasks.workunit.client.0.smithi012.stdout:5/256: chown d2/d1d/d29/l52 9 1 2023-10-21T17:09:13.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/257: dread d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:09:13.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/258: fsync d2/f4 0 2023-10-21T17:09:13.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/259: fsync d2/d2c/f43 0 2023-10-21T17:09:13.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/260: fdatasync d2/dd/d15/f3d 0 2023-10-21T17:09:14.610 INFO:tasks.workunit.client.0.smithi012.stdout:2/329: link d1/d14/d16/d20/f3b d1/d8/f71 0 2023-10-21T17:09:14.611 INFO:tasks.workunit.client.0.smithi012.stdout:2/330: chown d1/d14/l44 46770 1 2023-10-21T17:09:14.666 INFO:tasks.workunit.client.0.smithi012.stdout:9/312: chown d0/df/d44/f51 222 1 2023-10-21T17:09:14.666 INFO:tasks.workunit.client.0.smithi012.stdout:9/313: dread - d0/d4/d4b/d6a/d12/d25/d2f/f62 zero size 2023-10-21T17:09:15.455 INFO:tasks.workunit.client.0.smithi012.stdout:2/331: creat d1/d14/d16/f72 x:0 0 0 2023-10-21T17:09:15.456 INFO:tasks.workunit.client.0.smithi012.stdout:2/332: truncate d1/d14/d16/d58/f66 1041916 0 2023-10-21T17:09:15.456 INFO:tasks.workunit.client.0.smithi012.stdout:2/333: creat d1/d14/d17/f73 x:0 0 0 2023-10-21T17:09:15.457 INFO:tasks.workunit.client.0.smithi012.stdout:2/334: stat d1/d4/d3f/d4a 0 2023-10-21T17:09:15.670 INFO:tasks.workunit.client.0.smithi012.stdout:4/313: mkdir dc/d6b 0 2023-10-21T17:09:15.670 INFO:tasks.workunit.client.0.smithi012.stdout:9/314: truncate d0/d4/d4b/d6a/d12/d25/d39/d3b/f53 1294333 0 2023-10-21T17:09:15.946 INFO:tasks.workunit.client.0.smithi012.stdout:2/335: dread - d1/d4/f2b zero size 2023-10-21T17:09:16.275 INFO:tasks.workunit.client.0.smithi012.stdout:4/314: mkdir dc/d15/d18/d4c/d55/d6c 0 2023-10-21T17:09:16.303 INFO:tasks.workunit.client.0.smithi012.stdout:4/315: dread dc/f42 [0,4194304] 0 2023-10-21T17:09:16.415 INFO:tasks.workunit.client.0.smithi012.stdout:2/336: creat d1/d4/d3f/d41/f74 x:0 0 0 2023-10-21T17:09:17.500 INFO:tasks.workunit.client.0.smithi012.stdout:5/261: dwrite d2/dd/f41 [0,4194304] 0 2023-10-21T17:09:17.501 INFO:tasks.workunit.client.0.smithi012.stdout:8/254: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:09:17.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/262: dwrite d2/d6/f7 [0,4194304] 0 2023-10-21T17:09:17.713 INFO:tasks.workunit.client.0.smithi012.stdout:1/323: rmdir d5/d32/d62 39 2023-10-21T17:09:17.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/345: sync 2023-10-21T17:09:17.842 INFO:tasks.workunit.client.0.smithi012.stdout:8/255: dread - d0/d12/f31 zero size 2023-10-21T17:09:18.020 INFO:tasks.workunit.client.0.smithi012.stdout:5/263: symlink d2/l5a 0 2023-10-21T17:09:18.094 INFO:tasks.workunit.client.0.smithi012.stdout:1/324: mknod d5/c71 0 2023-10-21T17:09:18.279 INFO:tasks.workunit.client.0.smithi012.stdout:7/346: truncate d3/d16/f32 3944212 0 2023-10-21T17:09:18.754 INFO:tasks.workunit.client.0.smithi012.stdout:8/256: creat d0/d1a/d54/f5f x:0 0 0 2023-10-21T17:09:18.809 INFO:tasks.workunit.client.0.smithi012.stdout:5/264: rename d2/dd to d2/d4f/d59/d5b 0 2023-10-21T17:09:18.810 INFO:tasks.workunit.client.0.smithi012.stdout:1/325: symlink d5/d32/d1b/d2c/d48/l72 0 2023-10-21T17:09:18.826 INFO:tasks.workunit.client.0.smithi012.stdout:1/326: dread d5/f14 [0,4194304] 0 2023-10-21T17:09:19.037 INFO:tasks.workunit.client.0.smithi012.stdout:7/347: creat d3/d6/dc/f68 x:0 0 0 2023-10-21T17:09:19.467 INFO:tasks.workunit.client.0.smithi012.stdout:6/288: mkdir d13/d15/d1d/d5d 0 2023-10-21T17:09:19.468 INFO:tasks.workunit.client.0.smithi012.stdout:5/265: rmdir d2/d4f 39 2023-10-21T17:09:19.732 INFO:tasks.workunit.client.0.smithi012.stdout:7/348: mkdir d3/d6/dc/d19/d1e/d69 0 2023-10-21T17:09:19.732 INFO:tasks.workunit.client.0.smithi012.stdout:1/327: creat d5/d30/d51/f73 x:0 0 0 2023-10-21T17:09:19.733 INFO:tasks.workunit.client.0.smithi012.stdout:7/349: dread - d3/d6/dc/d19/f57 zero size 2023-10-21T17:09:19.733 INFO:tasks.workunit.client.0.smithi012.stdout:1/328: chown d5/d32/d62/c66 672216 1 2023-10-21T17:09:19.733 INFO:tasks.workunit.client.0.smithi012.stdout:7/350: write d3/d6/dc/d19/f57 [338345,115366] 0 2023-10-21T17:09:19.733 INFO:tasks.workunit.client.0.smithi012.stdout:7/351: getdents d3/d64 0 2023-10-21T17:09:19.785 INFO:tasks.workunit.client.0.smithi012.stdout:4/316: write dc/d15/d2a/d31/f49 [827558,86758] 0 2023-10-21T17:09:19.811 INFO:tasks.workunit.client.0.smithi012.stdout:1/329: dwrite d5/f39 [0,4194304] 0 2023-10-21T17:09:19.812 INFO:tasks.workunit.client.0.smithi012.stdout:1/330: chown d5/f10 826513102 1 2023-10-21T17:09:19.829 INFO:tasks.workunit.client.0.smithi012.stdout:6/289: chown d13/d15/f27 1187545277 1 2023-10-21T17:09:19.829 INFO:tasks.workunit.client.0.smithi012.stdout:6/290: fsync d13/f47 0 2023-10-21T17:09:20.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/266: rename d2/d4f/d59/d5b/d1e/f53 to d2/d1d/d4e/f5c 0 2023-10-21T17:09:20.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/267: readlink d2/d4f/d59/d5b/l17 0 2023-10-21T17:09:20.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/268: stat d2/d1d/d4e 0 2023-10-21T17:09:20.001 INFO:tasks.workunit.client.0.smithi012.stdout:5/269: read - d2/d6/f51 zero size 2023-10-21T17:09:20.001 INFO:tasks.workunit.client.0.smithi012.stdout:2/337: write d1/d8/f28 [713556,85039] 0 2023-10-21T17:09:20.001 INFO:tasks.workunit.client.0.smithi012.stdout:2/338: chown d1/d8/d19/d50 710080 1 2023-10-21T17:09:20.001 INFO:tasks.workunit.client.0.smithi012.stdout:2/339: readlink d1/d8/d25/l43 0 2023-10-21T17:09:20.021 INFO:tasks.workunit.client.0.smithi012.stdout:7/352: truncate d3/d6/dc/d19/d1e/f5c 406829 0 2023-10-21T17:09:20.067 INFO:tasks.workunit.client.0.smithi012.stdout:7/353: dread d3/d6/dc/d19/f33 [0,4194304] 0 2023-10-21T17:09:20.836 INFO:tasks.workunit.client.0.smithi012.stdout:0/345: mkdir d7/d81 0 2023-10-21T17:09:21.014 INFO:tasks.workunit.client.0.smithi012.stdout:9/315: creat d0/f6b x:0 0 0 2023-10-21T17:09:21.014 INFO:tasks.workunit.client.0.smithi012.stdout:9/316: read - d0/d5/f59 zero size 2023-10-21T17:09:21.078 INFO:tasks.workunit.client.0.smithi012.stdout:9/317: dwrite d0/d4/d4b/d6a/d12/d2a/d36/f38 [0,4194304] 0 2023-10-21T17:09:21.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/318: readlink d0/d4/d4b/d6a/d12/d25/l34 0 2023-10-21T17:09:21.139 INFO:tasks.workunit.client.0.smithi012.stdout:9/319: dwrite d0/d4/d4b/d6a/d12/f55 [0,4194304] 0 2023-10-21T17:09:21.139 INFO:tasks.workunit.client.0.smithi012.stdout:9/320: write d0/df/f11 [213956,41262] 0 2023-10-21T17:09:21.305 INFO:tasks.workunit.client.0.smithi012.stdout:4/317: unlink dc/d15/l24 0 2023-10-21T17:09:21.417 INFO:tasks.workunit.client.0.smithi012.stdout:4/318: dwrite dc/d1e/d65/f68 [0,4194304] 0 2023-10-21T17:09:21.418 INFO:tasks.workunit.client.0.smithi012.stdout:4/319: dread - dc/d1e/f5f zero size 2023-10-21T17:09:21.418 INFO:tasks.workunit.client.0.smithi012.stdout:4/320: readlink dc/d15/d2a/d31/d36/l56 0 2023-10-21T17:09:21.418 INFO:tasks.workunit.client.0.smithi012.stdout:4/321: dread - dc/d1e/f4b zero size 2023-10-21T17:09:21.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/270: truncate d2/d1d/d20/f2b 4203220 0 2023-10-21T17:09:21.647 INFO:tasks.workunit.client.0.smithi012.stdout:2/340: dwrite d1/d14/d16/d58/f66 [0,4194304] 0 2023-10-21T17:09:21.676 INFO:tasks.workunit.client.0.smithi012.stdout:7/354: mkdir d3/d6/d6a 0 2023-10-21T17:09:21.766 INFO:tasks.workunit.client.0.smithi012.stdout:7/355: dwrite d3/d6/f66 [0,4194304] 0 2023-10-21T17:09:21.766 INFO:tasks.workunit.client.0.smithi012.stdout:7/356: chown d3/d6/dc/d19/d28/l35 5783 1 2023-10-21T17:09:22.510 INFO:tasks.workunit.client.0.smithi012.stdout:9/321: symlink d0/d5/l6c 0 2023-10-21T17:09:22.814 INFO:tasks.workunit.client.0.smithi012.stdout:4/322: mknod dc/d15/d2a/d31/c6d 0 2023-10-21T17:09:23.084 INFO:tasks.workunit.client.0.smithi012.stdout:8/257: dwrite d0/f35 [0,4194304] 0 2023-10-21T17:09:23.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/258: dread d0/f8 [0,4194304] 0 2023-10-21T17:09:23.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/259: write d0/d12/d51/f57 [581068,6842] 0 2023-10-21T17:09:23.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/260: readlink d0/d12/l18 0 2023-10-21T17:09:23.212 INFO:tasks.workunit.client.0.smithi012.stdout:8/261: dwrite d0/d12/f37 [0,4194304] 0 2023-10-21T17:09:23.505 INFO:tasks.workunit.client.0.smithi012.stdout:7/357: creat d3/d6/dc/d19/d1e/d69/f6b x:0 0 0 2023-10-21T17:09:23.629 INFO:tasks.workunit.client.0.smithi012.stdout:9/322: rename d0/d5/c4f to d0/c6d 0 2023-10-21T17:09:23.650 INFO:tasks.workunit.client.0.smithi012.stdout:9/323: dread d0/d4/d4b/d6a/d12/d2a/f3a [0,4194304] 0 2023-10-21T17:09:24.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/323: mkdir dc/d1e/d6e 0 2023-10-21T17:09:24.715 INFO:tasks.workunit.client.0.smithi012.stdout:8/262: fsync d0/f17 0 2023-10-21T17:09:24.919 INFO:tasks.workunit.client.0.smithi012.stdout:9/324: symlink d0/d4/l6e 0 2023-10-21T17:09:24.920 INFO:tasks.workunit.client.0.smithi012.stdout:3/261: sync 2023-10-21T17:09:24.920 INFO:tasks.workunit.client.0.smithi012.stdout:3/262: readlink d0/l4d 0 2023-10-21T17:09:25.209 INFO:tasks.workunit.client.0.smithi012.stdout:4/324: unlink dc/d1e/f3c 0 2023-10-21T17:09:25.236 INFO:tasks.workunit.client.0.smithi012.stdout:4/325: read dc/d1e/d33/f43 [1201974,115230] 0 2023-10-21T17:09:25.320 INFO:tasks.workunit.client.0.smithi012.stdout:4/326: dwrite dc/d15/d2a/d31/d36/f5a [0,4194304] 0 2023-10-21T17:09:25.321 INFO:tasks.workunit.client.0.smithi012.stdout:4/327: chown l9 2644 1 2023-10-21T17:09:25.345 INFO:tasks.workunit.client.0.smithi012.stdout:4/328: dread dc/f42 [0,4194304] 0 2023-10-21T17:09:25.492 INFO:tasks.workunit.client.0.smithi012.stdout:8/263: creat d0/d12/d40/f60 x:0 0 0 2023-10-21T17:09:25.492 INFO:tasks.workunit.client.0.smithi012.stdout:3/263: symlink d0/d32/d43/d47/d50/l51 0 2023-10-21T17:09:25.492 INFO:tasks.workunit.client.0.smithi012.stdout:3/264: chown d0/f46 1287 1 2023-10-21T17:09:25.506 INFO:tasks.workunit.client.0.smithi012.stdout:3/265: dread d0/da/f26 [0,4194304] 0 2023-10-21T17:09:26.026 INFO:tasks.workunit.client.0.smithi012.stdout:1/331: sync 2023-10-21T17:09:26.027 INFO:tasks.workunit.client.0.smithi012.stdout:6/291: sync 2023-10-21T17:09:26.027 INFO:tasks.workunit.client.0.smithi012.stdout:1/332: dread - d5/d32/d1b/d27/d21/f2b zero size 2023-10-21T17:09:26.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/292: read d13/d15/d1d/d28/f39 [716877,50189] 0 2023-10-21T17:09:26.036 INFO:tasks.workunit.client.0.smithi012.stdout:6/293: creat d13/d29/d37/d3b/f5e x:0 0 0 2023-10-21T17:09:26.036 INFO:tasks.workunit.client.0.smithi012.stdout:6/294: chown d13/d15/d1d/c1e 12027869 1 2023-10-21T17:09:26.146 INFO:tasks.workunit.client.0.smithi012.stdout:8/264: truncate d0/f8 1973924 0 2023-10-21T17:09:26.319 INFO:tasks.workunit.client.0.smithi012.stdout:3/266: mkdir d0/d32/d43/d47/d50/d52 0 2023-10-21T17:09:26.319 INFO:tasks.workunit.client.0.smithi012.stdout:3/267: fsync d0/d32/f4e 0 2023-10-21T17:09:26.320 INFO:tasks.workunit.client.0.smithi012.stdout:3/268: write d0/da/d28/f2c [155183,111577] 0 2023-10-21T17:09:26.730 INFO:tasks.workunit.client.0.smithi012.stdout:0/346: mkdir d7/d55/d23/d66/d82 0 2023-10-21T17:09:26.905 INFO:tasks.workunit.client.0.smithi012.stdout:1/333: truncate d5/d32/d1b/d27/d21/f31 3144239 0 2023-10-21T17:09:27.175 INFO:tasks.workunit.client.0.smithi012.stdout:6/295: truncate d13/d15/f26 939127 0 2023-10-21T17:09:27.335 INFO:tasks.workunit.client.0.smithi012.stdout:8/265: mknod d0/d12/d40/d4a/c61 0 2023-10-21T17:09:27.768 INFO:tasks.workunit.client.0.smithi012.stdout:1/334: getdents d5/d26 0 2023-10-21T17:09:27.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/296: truncate d13/d15/f27 4940901 0 2023-10-21T17:09:27.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/297: creat d13/d29/f5f x:0 0 0 2023-10-21T17:09:27.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/298: dread - d13/d29/d37/d3b/f5e zero size 2023-10-21T17:09:27.905 INFO:tasks.workunit.client.0.smithi012.stdout:5/271: dwrite d2/f18 [8388608,4194304] 0 2023-10-21T17:09:27.906 INFO:tasks.workunit.client.0.smithi012.stdout:5/272: write d2/d1d/f56 [341286,40891] 0 2023-10-21T17:09:28.084 INFO:tasks.workunit.client.0.smithi012.stdout:1/335: creat d5/d32/d1b/d2c/d48/f74 x:0 0 0 2023-10-21T17:09:28.084 INFO:tasks.workunit.client.0.smithi012.stdout:1/336: stat d5/d32/d1b/d27/c19 0 2023-10-21T17:09:28.263 INFO:tasks.workunit.client.0.smithi012.stdout:6/299: mknod d13/d15/d1d/d28/d5b/c60 0 2023-10-21T17:09:28.479 INFO:tasks.workunit.client.0.smithi012.stdout:8/266: mkdir d0/d62 0 2023-10-21T17:09:28.479 INFO:tasks.workunit.client.0.smithi012.stdout:8/267: fsync d0/d1a/f33 0 2023-10-21T17:09:28.479 INFO:tasks.workunit.client.0.smithi012.stdout:8/268: fdatasync d0/d12/f37 0 2023-10-21T17:09:29.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/337: getdents d5/d32/d1b/d27/d1a/d46 0 2023-10-21T17:09:29.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/338: fsync d5/d32/d1b/d27/d21/f4e 0 2023-10-21T17:09:29.131 INFO:tasks.workunit.client.0.smithi012.stdout:1/339: truncate d5/d30/f67 547539 0 2023-10-21T17:09:29.132 INFO:tasks.workunit.client.0.smithi012.stdout:1/340: fdatasync d5/d32/d1b/d27/d21/f4e 0 2023-10-21T17:09:29.132 INFO:tasks.workunit.client.0.smithi012.stdout:1/341: write d5/d32/d62/fe [4710395,124499] 0 2023-10-21T17:09:29.132 INFO:tasks.workunit.client.0.smithi012.stdout:1/342: chown d5/d32/l4a 13 1 2023-10-21T17:09:29.352 INFO:tasks.workunit.client.0.smithi012.stdout:8/269: truncate d0/f32 867677 0 2023-10-21T17:09:29.662 INFO:tasks.workunit.client.0.smithi012.stdout:1/343: mknod d5/d32/d1b/d2c/c75 0 2023-10-21T17:09:29.662 INFO:tasks.workunit.client.0.smithi012.stdout:1/344: stat d5/d32/d1b/d27/d47/l6f 0 2023-10-21T17:09:29.663 INFO:tasks.workunit.client.0.smithi012.stdout:1/345: stat d5/d32/d1b/c56 0 2023-10-21T17:09:29.663 INFO:tasks.workunit.client.0.smithi012.stdout:1/346: fdatasync d5/d32/d1b/d2c/d4b/f70 0 2023-10-21T17:09:29.691 INFO:tasks.workunit.client.0.smithi012.stdout:1/347: dread d5/f11 [0,4194304] 0 2023-10-21T17:09:29.714 INFO:tasks.workunit.client.0.smithi012.stdout:1/348: dread d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:09:29.747 INFO:tasks.workunit.client.0.smithi012.stdout:1/349: write d5/d32/d62/fe [1331186,85652] 0 2023-10-21T17:09:29.804 INFO:tasks.workunit.client.0.smithi012.stdout:8/270: symlink d0/d1a/d54/l63 0 2023-10-21T17:09:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:8/271: truncate d0/d1a/f41 3483078 0 2023-10-21T17:09:30.807 INFO:tasks.workunit.client.0.smithi012.stdout:2/341: creat d1/d14/d16/f75 x:0 0 0 2023-10-21T17:09:30.807 INFO:tasks.workunit.client.0.smithi012.stdout:2/342: stat d1/d8/d19/d50 0 2023-10-21T17:09:31.216 INFO:tasks.workunit.client.0.smithi012.stdout:1/350: rmdir d5/d26/d54 39 2023-10-21T17:09:31.852 INFO:tasks.workunit.client.0.smithi012.stdout:2/343: creat d1/d8/f76 x:0 0 0 2023-10-21T17:09:32.265 INFO:tasks.workunit.client.0.smithi012.stdout:1/351: mknod d5/d32/d1b/d35/c76 0 2023-10-21T17:09:32.433 INFO:tasks.workunit.client.0.smithi012.stdout:8/272: rename d0/d29/c3b to d0/d1a/c64 0 2023-10-21T17:09:33.102 INFO:tasks.workunit.client.0.smithi012.stdout:8/273: dread d0/d1a/f3d [0,4194304] 0 2023-10-21T17:09:33.103 INFO:tasks.workunit.client.0.smithi012.stdout:3/269: dwrite d0/f2b [0,4194304] 0 2023-10-21T17:09:33.103 INFO:tasks.workunit.client.0.smithi012.stdout:8/274: chown d0/cc 4132499 1 2023-10-21T17:09:33.970 INFO:tasks.workunit.client.0.smithi012.stdout:3/270: creat d0/d32/d43/d47/d50/d52/f53 x:0 0 0 2023-10-21T17:09:33.978 INFO:tasks.workunit.client.0.smithi012.stdout:1/352: rename d5/d32/d1b/d2c/d48/l72 to d5/d32/d62/l77 0 2023-10-21T17:09:33.978 INFO:tasks.workunit.client.0.smithi012.stdout:6/300: link d13/d15/d1d/d28/f39 d13/d15/f61 0 2023-10-21T17:09:33.979 INFO:tasks.workunit.client.0.smithi012.stdout:6/301: chown d13/d29/d37/f44 10 1 2023-10-21T17:09:34.011 INFO:tasks.workunit.client.0.smithi012.stdout:9/325: sync 2023-10-21T17:09:34.011 INFO:tasks.workunit.client.0.smithi012.stdout:7/358: sync 2023-10-21T17:09:34.011 INFO:tasks.workunit.client.0.smithi012.stdout:7/359: readlink d3/d6/l62 0 2023-10-21T17:09:34.041 INFO:tasks.workunit.client.0.smithi012.stdout:9/326: dread d0/f14 [0,4194304] 0 2023-10-21T17:09:34.050 INFO:tasks.workunit.client.0.smithi012.stdout:6/302: dwrite d13/d15/d1d/d24/f45 [0,4194304] 0 2023-10-21T17:09:34.302 INFO:tasks.workunit.client.0.smithi012.stdout:0/347: creat d7/f83 x:0 0 0 2023-10-21T17:09:34.612 INFO:tasks.workunit.client.0.smithi012.stdout:3/271: creat d0/da/f54 x:0 0 0 2023-10-21T17:09:34.613 INFO:tasks.workunit.client.0.smithi012.stdout:3/272: stat d0/d32/d43/d47 0 2023-10-21T17:09:34.751 INFO:tasks.workunit.client.0.smithi012.stdout:1/353: mknod d5/d32/d1b/d27/d47/c78 0 2023-10-21T17:09:34.752 INFO:tasks.workunit.client.0.smithi012.stdout:1/354: truncate d5/d32/d1b/d27/d1a/d46/f60 4656528 0 2023-10-21T17:09:34.752 INFO:tasks.workunit.client.0.smithi012.stdout:1/355: fdatasync d5/d32/d1b/d27/f38 0 2023-10-21T17:09:34.752 INFO:tasks.workunit.client.0.smithi012.stdout:1/356: chown d5/d32/d62/l16 898 1 2023-10-21T17:09:34.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:09:34.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:09:34.851 INFO:tasks.workunit.client.0.smithi012.stdout:5/273: rmdir d2/d1d/d20 39 2023-10-21T17:09:34.852 INFO:tasks.workunit.client.0.smithi012.stdout:5/274: fsync d2/d6/f7 0 2023-10-21T17:09:34.852 INFO:tasks.workunit.client.0.smithi012.stdout:5/275: read - d2/d1d/f4a zero size 2023-10-21T17:09:35.065 INFO:tasks.workunit.client.0.smithi012.stdout:9/327: rename d0/d4/d4b/d6a/d12/f31 to d0/d4/d4b/d6a/d12/d25/d39/d3b/f6f 0 2023-10-21T17:09:35.416 INFO:tasks.workunit.client.0.smithi012.stdout:0/348: truncate d7/d55/f22 1254544 0 2023-10-21T17:09:35.717 INFO:tasks.workunit.client.0.smithi012.stdout:1/357: creat d5/d32/d1b/d35/d3a/f79 x:0 0 0 2023-10-21T17:09:35.829 INFO:tasks.workunit.client.0.smithi012.stdout:5/276: symlink d2/d4f/d59/l5d 0 2023-10-21T17:09:36.243 INFO:tasks.workunit.client.0.smithi012.stdout:9/328: creat d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 x:0 0 0 2023-10-21T17:09:36.535 INFO:tasks.workunit.client.0.smithi012.stdout:0/349: symlink d7/d55/d23/d30/l84 0 2023-10-21T17:09:36.536 INFO:tasks.workunit.client.0.smithi012.stdout:4/329: creat dc/d15/f6f x:0 0 0 2023-10-21T17:09:36.648 INFO:tasks.workunit.client.0.smithi012.stdout:4/330: dwrite dc/d15/f47 [0,4194304] 0 2023-10-21T17:09:36.648 INFO:tasks.workunit.client.0.smithi012.stdout:4/331: chown dc/d15/d2a/d58 1 1 2023-10-21T17:09:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/358: unlink d5/d32/d1b/d35/c76 0 2023-10-21T17:09:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/359: chown d5/d32/d1b/d27/c28 13898 1 2023-10-21T17:09:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:2/344: creat d1/f77 x:0 0 0 2023-10-21T17:09:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:2/345: chown d1/l2c 9 1 2023-10-21T17:09:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:1/360: read - d5/d32/d1b/d2c/d48/f74 zero size 2023-10-21T17:09:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:2/346: dread - d1/d4/f2b zero size 2023-10-21T17:09:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:1/361: truncate d5/d30/d51/f73 311170 0 2023-10-21T17:09:36.846 INFO:tasks.workunit.client.0.smithi012.stdout:2/347: write d1/f9 [823069,39139] 0 2023-10-21T17:09:36.867 INFO:tasks.workunit.client.0.smithi012.stdout:2/348: dread d1/d8/f28 [0,4194304] 0 2023-10-21T17:09:36.867 INFO:tasks.workunit.client.0.smithi012.stdout:2/349: truncate d1/d14/d17/f73 263630 0 2023-10-21T17:09:36.978 INFO:tasks.workunit.client.0.smithi012.stdout:5/277: getdents d2/d4f/d59/d5b/d1e 0 2023-10-21T17:09:36.978 INFO:tasks.workunit.client.0.smithi012.stdout:5/278: readlink d2/d4f/d59/d5b/l12 0 2023-10-21T17:09:37.004 INFO:tasks.workunit.client.0.smithi012.stdout:5/279: dread d2/d4f/d59/d5b/d15/f3d [0,4194304] 0 2023-10-21T17:09:37.004 INFO:tasks.workunit.client.0.smithi012.stdout:5/280: write d2/d1d/d20/f4d [5094121,16208] 0 2023-10-21T17:09:37.031 INFO:tasks.workunit.client.0.smithi012.stdout:5/281: write d2/d1d/d4e/f5c [5267,130055] 0 2023-10-21T17:09:37.031 INFO:tasks.workunit.client.0.smithi012.stdout:5/282: chown d2/d4f/d59/d5b/l45 192 1 2023-10-21T17:09:37.057 INFO:tasks.workunit.client.0.smithi012.stdout:5/283: read d2/d1d/d29/f39 [872974,42483] 0 2023-10-21T17:09:37.074 INFO:tasks.workunit.client.0.smithi012.stdout:5/284: dread d2/d4f/d59/d5b/d15/f3d [0,4194304] 0 2023-10-21T17:09:37.388 INFO:tasks.workunit.client.0.smithi012.stdout:7/360: creat d3/d6/dc/d19/f6c x:0 0 0 2023-10-21T17:09:37.516 INFO:tasks.workunit.client.0.smithi012.stdout:1/362: rename d5/d32/d1b/d27/f20 to d5/d26/d54/d68/f7a 0 2023-10-21T17:09:37.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/363: dread f1 [0,4194304] 0 2023-10-21T17:09:37.532 INFO:tasks.workunit.client.0.smithi012.stdout:1/364: chown d5/c1e 0 1 2023-10-21T17:09:37.558 INFO:tasks.workunit.client.0.smithi012.stdout:1/365: dread d5/f10 [0,4194304] 0 2023-10-21T17:09:37.558 INFO:tasks.workunit.client.0.smithi012.stdout:1/366: truncate d5/d32/d1b/d35/d3a/f79 158205 0 2023-10-21T17:09:37.559 INFO:tasks.workunit.client.0.smithi012.stdout:1/367: creat d5/d32/d1b/d35/d49/f7b x:0 0 0 2023-10-21T17:09:37.559 INFO:tasks.workunit.client.0.smithi012.stdout:1/368: dread - d5/d32/d1b/d2c/d4b/f70 zero size 2023-10-21T17:09:37.559 INFO:tasks.workunit.client.0.smithi012.stdout:1/369: chown d5/d32/l52 252 1 2023-10-21T17:09:37.727 INFO:tasks.workunit.client.0.smithi012.stdout:2/350: symlink d1/l78 0 2023-10-21T17:09:37.764 INFO:tasks.workunit.client.0.smithi012.stdout:3/273: rmdir d0/d32/d43/d47/d50/d52 39 2023-10-21T17:09:38.078 INFO:tasks.workunit.client.0.smithi012.stdout:5/285: dread d2/d1d/d20/f2b [0,4194304] 0 2023-10-21T17:09:38.113 INFO:tasks.workunit.client.0.smithi012.stdout:5/286: write d2/d4f/d59/d5b/f41 [2567090,60534] 0 2023-10-21T17:09:38.193 INFO:tasks.workunit.client.0.smithi012.stdout:4/332: symlink dc/d28/l70 0 2023-10-21T17:09:38.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/303: getdents d13/d15 0 2023-10-21T17:09:38.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/304: write d13/d15/f1a [416715,119398] 0 2023-10-21T17:09:38.313 INFO:tasks.workunit.client.0.smithi012.stdout:6/305: fsync d13/f36 0 2023-10-21T17:09:38.313 INFO:tasks.workunit.client.0.smithi012.stdout:6/306: fdatasync d13/d35/f48 0 2023-10-21T17:09:38.346 INFO:tasks.workunit.client.0.smithi012.stdout:6/307: dread f10 [0,4194304] 0 2023-10-21T17:09:38.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/275: dwrite d0/f11 [4194304,4194304] 0 2023-10-21T17:09:38.877 INFO:tasks.workunit.client.0.smithi012.stdout:8/276: creat d0/d12/d40/d4a/d4e/f65 x:0 0 0 2023-10-21T17:09:39.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/370: mkdir d5/d32/d1b/d35/d3a/d5c/d7c 0 2023-10-21T17:09:39.957 INFO:tasks.workunit.client.0.smithi012.stdout:3/274: mknod d0/da/d28/c55 0 2023-10-21T17:09:40.080 INFO:tasks.workunit.client.0.smithi012.stdout:3/275: dwrite d0/f2b [4194304,4194304] 0 2023-10-21T17:09:40.081 INFO:tasks.workunit.client.0.smithi012.stdout:3/276: chown d0/d1c/l20 3154571 1 2023-10-21T17:09:40.110 INFO:tasks.workunit.client.0.smithi012.stdout:0/350: read d7/d55/d23/d27/d31/f32 [976451,92865] 0 2023-10-21T17:09:40.110 INFO:tasks.workunit.client.0.smithi012.stdout:0/351: creat d7/d55/d23/d66/d48/f85 x:0 0 0 2023-10-21T17:09:40.144 INFO:tasks.workunit.client.0.smithi012.stdout:5/287: truncate d2/d6/f4b 5709987 0 2023-10-21T17:09:40.221 INFO:tasks.workunit.client.0.smithi012.stdout:5/288: dwrite d2/d1d/f4a [0,4194304] 0 2023-10-21T17:09:40.284 INFO:tasks.workunit.client.0.smithi012.stdout:4/333: creat dc/d15/d18/f71 x:0 0 0 2023-10-21T17:09:40.285 INFO:tasks.workunit.client.0.smithi012.stdout:4/334: fsync dc/d1e/d33/f52 0 2023-10-21T17:09:40.481 INFO:tasks.workunit.client.0.smithi012.stdout:6/308: mknod d13/d15/d1d/d5d/c62 0 2023-10-21T17:09:40.482 INFO:tasks.workunit.client.0.smithi012.stdout:6/309: stat ff 0 2023-10-21T17:09:40.905 INFO:tasks.workunit.client.0.smithi012.stdout:9/329: getdents d0/d4/d4b/d6a/d12/d25/d39/d3b 0 2023-10-21T17:09:41.404 INFO:tasks.workunit.client.0.smithi012.stdout:1/371: truncate d5/d26/f40 8432677 0 2023-10-21T17:09:41.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/372: chown d5/f14 718306 1 2023-10-21T17:09:41.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/277: link d0/d32/c41 d0/da/d28/c56 0 2023-10-21T17:09:41.985 INFO:tasks.workunit.client.0.smithi012.stdout:0/352: mknod d7/d55/d23/d27/d40/c86 0 2023-10-21T17:09:42.433 INFO:tasks.workunit.client.0.smithi012.stdout:5/289: unlink d2/d4f/d59/d5b/d1e/f24 0 2023-10-21T17:09:42.433 INFO:tasks.workunit.client.0.smithi012.stdout:5/290: readlink d2/d4f/d59/d5b/l17 0 2023-10-21T17:09:42.447 INFO:tasks.workunit.client.0.smithi012.stdout:5/291: dread d2/d1d/f56 [0,4194304] 0 2023-10-21T17:09:42.448 INFO:tasks.workunit.client.0.smithi012.stdout:5/292: fsync d2/f4 0 2023-10-21T17:09:42.724 INFO:tasks.workunit.client.0.smithi012.stdout:6/310: symlink d13/d29/l63 0 2023-10-21T17:09:42.725 INFO:tasks.workunit.client.0.smithi012.stdout:6/311: fdatasync d13/f54 0 2023-10-21T17:09:42.725 INFO:tasks.workunit.client.0.smithi012.stdout:4/335: truncate dc/f42 1161796 0 2023-10-21T17:09:42.725 INFO:tasks.workunit.client.0.smithi012.stdout:4/336: readlink dc/d28/l70 0 2023-10-21T17:09:42.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/373: symlink d5/d32/d1b/d35/d3a/l7d 0 2023-10-21T17:09:43.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/293: symlink d2/d1d/d29/d57/l5e 0 2023-10-21T17:09:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:0/353: dread d7/d55/f24 [0,4194304] 0 2023-10-21T17:09:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:0/354: write d7/f36 [814570,6005] 0 2023-10-21T17:09:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:0/355: fsync d7/f83 0 2023-10-21T17:09:43.064 INFO:tasks.workunit.client.0.smithi012.stdout:3/278: dwrite d0/f5 [0,4194304] 0 2023-10-21T17:09:43.859 INFO:tasks.workunit.client.0.smithi012.stdout:4/337: getdents dc/d1e 0 2023-10-21T17:09:43.901 INFO:tasks.workunit.client.0.smithi012.stdout:9/330: truncate d0/d4/d4b/f4c 1497166 0 2023-10-21T17:09:43.901 INFO:tasks.workunit.client.0.smithi012.stdout:1/374: creat d5/d32/d1b/d35/d3a/d5c/f7e x:0 0 0 2023-10-21T17:09:44.095 INFO:tasks.workunit.client.0.smithi012.stdout:5/294: link d2/d4f/d59/d5b/f41 d2/d1d/d29/d57/f5f 0 2023-10-21T17:09:44.134 INFO:tasks.workunit.client.0.smithi012.stdout:7/361: sync 2023-10-21T17:09:44.135 INFO:tasks.workunit.client.0.smithi012.stdout:7/362: chown d3/d6/d6a 533 1 2023-10-21T17:09:44.135 INFO:tasks.workunit.client.0.smithi012.stdout:7/363: truncate d3/d16/f67 577890 0 2023-10-21T17:09:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/364: dread d3/d16/f67 [0,4194304] 0 2023-10-21T17:09:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/365: creat d3/d6/dc/d19/d28/f6d x:0 0 0 2023-10-21T17:09:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:0/356: creat d7/d55/d23/d27/d40/f87 x:0 0 0 2023-10-21T17:09:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:0/357: fdatasync d7/d55/f3b 0 2023-10-21T17:09:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:2/351: write d1/d8/ff [1552722,97587] 0 2023-10-21T17:09:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:2/352: readlink d1/d4/d3f/d41/l56 0 2023-10-21T17:09:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:0/358: write d7/f36 [3491,96354] 0 2023-10-21T17:09:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:0/359: write d7/d52/d53/f75 [704811,127849] 0 2023-10-21T17:09:45.405 INFO:tasks.workunit.client.0.smithi012.stdout:9/331: link d0/d4/d4b/d6a/d12/f48 d0/d4/d4b/d6a/d12/d25/f71 0 2023-10-21T17:09:45.405 INFO:tasks.workunit.client.0.smithi012.stdout:5/295: creat d2/d3e/f60 x:0 0 0 2023-10-21T17:09:45.524 INFO:tasks.workunit.client.0.smithi012.stdout:9/332: dwrite d0/d5/f69 [0,4194304] 0 2023-10-21T17:09:45.582 INFO:tasks.workunit.client.0.smithi012.stdout:9/333: dwrite d0/d4/d4b/d6a/d12/d25/d2f/f62 [0,4194304] 0 2023-10-21T17:09:45.641 INFO:tasks.workunit.client.0.smithi012.stdout:2/353: link d1/d8/f71 d1/d8/d19/d50/f79 0 2023-10-21T17:09:45.641 INFO:tasks.workunit.client.0.smithi012.stdout:2/354: chown d1/c64 2676660 1 2023-10-21T17:09:45.642 INFO:tasks.workunit.client.0.smithi012.stdout:2/355: readlink d1/d14/d16/d22/l2f 0 2023-10-21T17:09:45.642 INFO:tasks.workunit.client.0.smithi012.stdout:2/356: creat d1/d8/d19/d50/f7a x:0 0 0 2023-10-21T17:09:45.643 INFO:tasks.workunit.client.0.smithi012.stdout:2/357: fdatasync d1/d4/d3f/d41/d59/f62 0 2023-10-21T17:09:45.643 INFO:tasks.workunit.client.0.smithi012.stdout:2/358: fdatasync d1/d8/d19/d50/f7a 0 2023-10-21T17:09:45.662 INFO:tasks.workunit.client.0.smithi012.stdout:2/359: dread d1/d8/f28 [0,4194304] 0 2023-10-21T17:09:45.662 INFO:tasks.workunit.client.0.smithi012.stdout:2/360: fdatasync d1/d4/d3f/d41/d59/f69 0 2023-10-21T17:09:45.993 INFO:tasks.workunit.client.0.smithi012.stdout:4/338: symlink dc/d28/l72 0 2023-10-21T17:09:45.994 INFO:tasks.workunit.client.0.smithi012.stdout:4/339: read - dc/f67 zero size 2023-10-21T17:09:45.994 INFO:tasks.workunit.client.0.smithi012.stdout:4/340: dread - dc/d1e/f3e zero size 2023-10-21T17:09:46.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/341: dwrite dc/d15/d2a/d31/d36/f5a [0,4194304] 0 2023-10-21T17:09:46.224 INFO:tasks.workunit.client.0.smithi012.stdout:8/277: sync 2023-10-21T17:09:46.224 INFO:tasks.workunit.client.0.smithi012.stdout:8/278: chown d0/d1a 461 1 2023-10-21T17:09:46.635 INFO:tasks.workunit.client.0.smithi012.stdout:5/296: mknod d2/d4f/d59/d5b/c61 0 2023-10-21T17:09:47.320 INFO:tasks.workunit.client.0.smithi012.stdout:0/360: getdents d7/d52/d53 0 2023-10-21T17:09:47.403 INFO:tasks.workunit.client.0.smithi012.stdout:2/361: getdents d1/d14 0 2023-10-21T17:09:47.490 INFO:tasks.workunit.client.0.smithi012.stdout:2/362: dwrite d1/d8/f76 [0,4194304] 0 2023-10-21T17:09:47.490 INFO:tasks.workunit.client.0.smithi012.stdout:2/363: write d1/d14/d16/f75 [773760,108973] 0 2023-10-21T17:09:47.491 INFO:tasks.workunit.client.0.smithi012.stdout:2/364: truncate d1/d14/d17/f40 505070 0 2023-10-21T17:09:47.595 INFO:tasks.workunit.client.0.smithi012.stdout:4/342: link dc/l20 dc/d15/d2a/l73 0 2023-10-21T17:09:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/366: rename l2 to d3/d6/dc/d19/l6e 0 2023-10-21T17:09:47.706 INFO:tasks.workunit.client.0.smithi012.stdout:7/367: dread d3/f3f [0,4194304] 0 2023-10-21T17:09:48.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/279: symlink d0/d12/d40/d4a/d5b/l66 0 2023-10-21T17:09:48.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/280: fsync d0/d1a/f24 0 2023-10-21T17:09:48.291 INFO:tasks.workunit.client.0.smithi012.stdout:0/361: mkdir d7/d55/d23/d66/d48/d88 0 2023-10-21T17:09:48.589 INFO:tasks.workunit.client.0.smithi012.stdout:2/365: mknod d1/d4/d3f/d41/d59/c7b 0 2023-10-21T17:09:48.590 INFO:tasks.workunit.client.0.smithi012.stdout:2/366: chown d1/d8/d19/d50/f6a 3857738 1 2023-10-21T17:09:48.679 INFO:tasks.workunit.client.0.smithi012.stdout:4/343: truncate fb 275588 0 2023-10-21T17:09:48.690 INFO:tasks.workunit.client.0.smithi012.stdout:2/367: dwrite d1/f9 [0,4194304] 0 2023-10-21T17:09:48.690 INFO:tasks.workunit.client.0.smithi012.stdout:2/368: write d1/d8/f51 [17668,24278] 0 2023-10-21T17:09:48.691 INFO:tasks.workunit.client.0.smithi012.stdout:2/369: creat d1/d8/f7c x:0 0 0 2023-10-21T17:09:48.691 INFO:tasks.workunit.client.0.smithi012.stdout:2/370: chown d1/d8/d25/f42 3069 1 2023-10-21T17:09:49.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/312: unlink d13/l4e 0 2023-10-21T17:09:49.153 INFO:tasks.workunit.client.0.smithi012.stdout:6/313: write d13/d15/f1a [136883,79637] 0 2023-10-21T17:09:49.595 INFO:tasks.workunit.client.0.smithi012.stdout:2/371: chown d1/d4/f5 116623 1 2023-10-21T17:09:49.595 INFO:tasks.workunit.client.0.smithi012.stdout:2/372: write d1/d14/d16/f72 [93927,27414] 0 2023-10-21T17:09:49.596 INFO:tasks.workunit.client.0.smithi012.stdout:2/373: read - d1/f77 zero size 2023-10-21T17:09:50.007 INFO:tasks.workunit.client.0.smithi012.stdout:3/279: write d0/da/f26 [1315876,64952] 0 2023-10-21T17:09:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:1/375: write d5/d30/d51/f73 [286822,79525] 0 2023-10-21T17:09:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:1/376: truncate d5/d32/d1b/d35/d3a/f79 1000946 0 2023-10-21T17:09:50.009 INFO:tasks.workunit.client.0.smithi012.stdout:1/377: chown d5/d32/d1b/d35/d49/d69/l6d 1358900226 1 2023-10-21T17:09:50.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/314: mkdir d13/d64 0 2023-10-21T17:09:50.365 INFO:tasks.workunit.client.0.smithi012.stdout:4/344: truncate dc/d1e/d2b/f5c 552612 0 2023-10-21T17:09:52.349 INFO:tasks.workunit.client.0.smithi012.stdout:9/334: dwrite d0/d4/d4b/d6a/d12/d25/d2f/f65 [0,4194304] 0 2023-10-21T17:09:52.387 INFO:tasks.workunit.client.0.smithi012.stdout:5/297: dwrite d2/d1d/d20/f2b [4194304,4194304] 0 2023-10-21T17:09:52.795 INFO:tasks.workunit.client.0.smithi012.stdout:9/335: dread d0/f2 [4194304,4194304] 0 2023-10-21T17:09:52.803 INFO:tasks.workunit.client.0.smithi012.stdout:8/281: dwrite d0/f16 [4194304,4194304] 0 2023-10-21T17:09:53.618 INFO:tasks.workunit.client.0.smithi012.stdout:5/298: unlink d2/d4f/d59/d5b/d15/l1b 0 2023-10-21T17:09:53.929 INFO:tasks.workunit.client.0.smithi012.stdout:3/280: mknod d0/c57 0 2023-10-21T17:09:54.152 INFO:tasks.workunit.client.0.smithi012.stdout:8/282: link d0/d1a/f1d d0/d12/d40/d4a/d5b/f67 0 2023-10-21T17:09:54.506 INFO:tasks.workunit.client.0.smithi012.stdout:5/299: mknod d2/d2c/c62 0 2023-10-21T17:09:54.642 INFO:tasks.workunit.client.0.smithi012.stdout:3/281: symlink d0/d32/l58 0 2023-10-21T17:09:54.761 INFO:tasks.workunit.client.0.smithi012.stdout:8/283: creat d0/d62/f68 x:0 0 0 2023-10-21T17:09:54.965 INFO:tasks.workunit.client.0.smithi012.stdout:5/300: link d2/d2c/l58 d2/d3e/d49/l63 0 2023-10-21T17:09:55.215 INFO:tasks.workunit.client.0.smithi012.stdout:3/282: link d0/da/d28/f38 d0/d32/d43/f59 0 2023-10-21T17:09:55.216 INFO:tasks.workunit.client.0.smithi012.stdout:8/284: link d0/d12/d40/l4b d0/d12/d40/d4a/d5b/l69 0 2023-10-21T17:09:55.216 INFO:tasks.workunit.client.0.smithi012.stdout:3/283: write d0/d32/d43/f45 [713887,54277] 0 2023-10-21T17:09:55.217 INFO:tasks.workunit.client.0.smithi012.stdout:3/284: readlink d0/d32/l58 0 2023-10-21T17:09:55.217 INFO:tasks.workunit.client.0.smithi012.stdout:3/285: write d0/da/fe [4694066,14234] 0 2023-10-21T17:09:55.217 INFO:tasks.workunit.client.0.smithi012.stdout:3/286: fsync d0/da/f34 0 2023-10-21T17:09:55.218 INFO:tasks.workunit.client.0.smithi012.stdout:3/287: write d0/d32/f4e [5099356,86012] 0 2023-10-21T17:09:55.218 INFO:tasks.workunit.client.0.smithi012.stdout:3/288: readlink d0/d32/d43/d47/d50/l51 0 2023-10-21T17:09:55.377 INFO:tasks.workunit.client.0.smithi012.stdout:5/301: creat d2/d4f/d59/d5b/f64 x:0 0 0 2023-10-21T17:09:55.849 INFO:tasks.workunit.client.0.smithi012.stdout:7/368: rename d3/d6/dc/f5e to d3/d6/f6f 0 2023-10-21T17:09:55.863 INFO:tasks.workunit.client.0.smithi012.stdout:3/289: creat d0/d1c/f5a x:0 0 0 2023-10-21T17:09:55.986 INFO:tasks.workunit.client.0.smithi012.stdout:5/302: creat d2/d1d/d4e/f65 x:0 0 0 2023-10-21T17:09:56.145 INFO:tasks.workunit.client.0.smithi012.stdout:8/285: mkdir d0/d12/d6a 0 2023-10-21T17:09:56.146 INFO:tasks.workunit.client.0.smithi012.stdout:8/286: truncate d0/d12/d40/d4a/d4e/f55 429098 0 2023-10-21T17:09:56.370 INFO:tasks.workunit.client.0.smithi012.stdout:0/362: rename d7/d55/d1f/d28/l72 to d7/d55/d23/d27/l89 0 2023-10-21T17:09:56.370 INFO:tasks.workunit.client.0.smithi012.stdout:1/378: rename d5/d26/d54 to d5/d26/d54/d68/d7f 22 2023-10-21T17:09:56.459 INFO:tasks.workunit.client.0.smithi012.stdout:0/363: dwrite d7/d55/ff [0,4194304] 0 2023-10-21T17:09:56.460 INFO:tasks.workunit.client.0.smithi012.stdout:0/364: write d7/f1d [657628,6810] 0 2023-10-21T17:09:56.771 INFO:tasks.workunit.client.0.smithi012.stdout:7/369: symlink d3/d29/l70 0 2023-10-21T17:09:57.031 INFO:tasks.workunit.client.0.smithi012.stdout:5/303: mkdir d2/d1d/d29/d57/d66 0 2023-10-21T17:09:57.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/304: dwrite d2/d1d/d29/f39 [0,4194304] 0 2023-10-21T17:09:57.102 INFO:tasks.workunit.client.0.smithi012.stdout:5/305: write d2/d4f/d59/d5b/f41 [4547347,10166] 0 2023-10-21T17:09:57.102 INFO:tasks.workunit.client.0.smithi012.stdout:5/306: fdatasync d2/d6/f51 0 2023-10-21T17:09:57.360 INFO:tasks.workunit.client.0.smithi012.stdout:8/287: read d0/f27 [1050131,93282] 0 2023-10-21T17:09:57.360 INFO:tasks.workunit.client.0.smithi012.stdout:8/288: creat d0/d62/f6b x:0 0 0 2023-10-21T17:09:57.386 INFO:tasks.workunit.client.0.smithi012.stdout:6/315: rename d13/d35/f48 to d13/d35/d4c/f65 0 2023-10-21T17:09:57.404 INFO:tasks.workunit.client.0.smithi012.stdout:6/316: dread d13/d15/f1f [0,4194304] 0 2023-10-21T17:09:57.495 INFO:tasks.workunit.client.0.smithi012.stdout:6/317: dwrite d13/f47 [0,4194304] 0 2023-10-21T17:09:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:1/379: creat d5/d26/d64/f80 x:0 0 0 2023-10-21T17:09:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:0/365: mkdir d7/d60/d8a 0 2023-10-21T17:09:57.829 INFO:tasks.workunit.client.0.smithi012.stdout:7/370: read d3/d6/dc/f36 [3046182,45762] 0 2023-10-21T17:09:57.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/371: fsync d3/d6/dc/d19/d28/f3b 0 2023-10-21T17:09:57.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/372: readlink d3/d6/dc/d19/l21 0 2023-10-21T17:09:57.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/373: chown d3/d16/c5f 652 1 2023-10-21T17:09:57.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/374: chown d3/d6/dc/d19/l39 48764 1 2023-10-21T17:09:57.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/375: dread - d3/d29/f52 zero size 2023-10-21T17:09:57.909 INFO:tasks.workunit.client.0.smithi012.stdout:3/290: truncate d0/d32/d43/d47/f48 2270677 0 2023-10-21T17:09:57.909 INFO:tasks.workunit.client.0.smithi012.stdout:3/291: stat d0/c13 0 2023-10-21T17:09:57.921 INFO:tasks.workunit.client.0.smithi012.stdout:7/376: dwrite d3/d16/f31 [4194304,4194304] 0 2023-10-21T17:09:57.946 INFO:tasks.workunit.client.0.smithi012.stdout:3/292: write d0/f3b [1328431,46533] 0 2023-10-21T17:09:58.010 INFO:tasks.workunit.client.0.smithi012.stdout:7/377: dwrite d3/d16/f1a [0,4194304] 0 2023-10-21T17:09:59.158 INFO:tasks.workunit.client.0.smithi012.stdout:4/345: rename l4 to dc/d15/d2a/d31/l74 0 2023-10-21T17:09:59.159 INFO:tasks.workunit.client.0.smithi012.stdout:4/346: stat dc/d15/l37 0 2023-10-21T17:09:59.159 INFO:tasks.workunit.client.0.smithi012.stdout:1/380: truncate d5/d32/d1b/d35/d3a/f79 150779 0 2023-10-21T17:09:59.159 INFO:tasks.workunit.client.0.smithi012.stdout:4/347: fsync dc/d1e/d33/f52 0 2023-10-21T17:09:59.159 INFO:tasks.workunit.client.0.smithi012.stdout:0/366: creat d7/d55/f8b x:0 0 0 2023-10-21T17:09:59.159 INFO:tasks.workunit.client.0.smithi012.stdout:0/367: chown d7/d55/d1f/d7f 154702 1 2023-10-21T17:09:59.160 INFO:tasks.workunit.client.0.smithi012.stdout:6/318: mkdir d13/d15/d1d/d5d/d66 0 2023-10-21T17:09:59.439 INFO:tasks.workunit.client.0.smithi012.stdout:3/293: truncate d0/f7 2276687 0 2023-10-21T17:09:59.439 INFO:tasks.workunit.client.0.smithi012.stdout:3/294: chown d0/d32/d43/d47/f48 513116 1 2023-10-21T17:09:59.439 INFO:tasks.workunit.client.0.smithi012.stdout:3/295: fsync d0/f4 0 2023-10-21T17:09:59.619 INFO:tasks.workunit.client.0.smithi012.stdout:7/378: creat d3/d64/f71 x:0 0 0 2023-10-21T17:09:59.620 INFO:tasks.workunit.client.0.smithi012.stdout:7/379: write d3/d6/dc/d19/d1e/d69/f6b [139565,13050] 0 2023-10-21T17:09:59.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/381: truncate d5/d32/d62/f3b 1308696 0 2023-10-21T17:09:59.785 INFO:tasks.workunit.client.0.smithi012.stdout:1/382: fsync d5/d32/f17 0 2023-10-21T17:09:59.785 INFO:tasks.workunit.client.0.smithi012.stdout:1/383: dread - d5/d32/d1b/d2c/d4b/f5d zero size 2023-10-21T17:09:59.947 INFO:tasks.workunit.client.0.smithi012.stdout:6/319: rmdir d13/d35/d4c 39 2023-10-21T17:09:59.986 INFO:tasks.workunit.client.0.smithi012.stdout:6/320: dread d13/d35/f3a [0,4194304] 0 2023-10-21T17:10:00.056 INFO:tasks.workunit.client.0.smithi012.stdout:6/321: dwrite d13/d29/f5f [0,4194304] 0 2023-10-21T17:10:00.141 INFO:tasks.workunit.client.0.smithi012.stdout:6/322: dwrite f8 [0,4194304] 0 2023-10-21T17:10:00.142 INFO:tasks.workunit.client.0.smithi012.stdout:6/323: fdatasync d13/d15/f23 0 2023-10-21T17:10:00.161 INFO:tasks.workunit.client.0.smithi012.stdout:6/324: read d13/d15/f19 [2294595,84175] 0 2023-10-21T17:10:00.218 INFO:tasks.workunit.client.0.smithi012.stdout:0/368: mkdir d7/d55/d23/d30/d8c 0 2023-10-21T17:10:00.220 INFO:tasks.workunit.client.0.smithi012.stdout:9/336: sync 2023-10-21T17:10:00.221 INFO:tasks.workunit.client.0.smithi012.stdout:2/374: sync 2023-10-21T17:10:00.221 INFO:tasks.workunit.client.0.smithi012.stdout:9/337: dread - d0/df/f63 zero size 2023-10-21T17:10:00.221 INFO:tasks.workunit.client.0.smithi012.stdout:2/375: stat d1/d14 0 2023-10-21T17:10:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:8/289: getdents d0/d12 0 2023-10-21T17:10:00.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/380: rename d3/d6/dc/f68 to d3/d6/dc/d19/f72 0 2023-10-21T17:10:00.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/381: dread - d3/d16/f50 zero size 2023-10-21T17:10:01.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/369: mkdir d7/d55/d23/d66/d82/d8d 0 2023-10-21T17:10:01.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/370: chown d7/d55/d23/d27/d31/d5f 282023 1 2023-10-21T17:10:02.104 INFO:tasks.workunit.client.0.smithi012.stdout:9/338: truncate d0/d4/d4b/d6a/d12/d2a/d36/f38 3199693 0 2023-10-21T17:10:02.104 INFO:tasks.workunit.client.0.smithi012.stdout:9/339: chown d0/d4/d4b/d6a/d12/d25/f71 1972 1 2023-10-21T17:10:02.105 INFO:tasks.workunit.client.0.smithi012.stdout:9/340: write d0/d5/f69 [4582606,84123] 0 2023-10-21T17:10:02.205 INFO:tasks.workunit.client.0.smithi012.stdout:2/376: mknod d1/d8/d19/d50/c7d 0 2023-10-21T17:10:02.418 INFO:tasks.workunit.client.0.smithi012.stdout:8/290: chown d0/ca 220941 1 2023-10-21T17:10:02.521 INFO:tasks.workunit.client.0.smithi012.stdout:8/291: dwrite d0/fb [0,4194304] 0 2023-10-21T17:10:02.521 INFO:tasks.workunit.client.0.smithi012.stdout:8/292: write d0/d12/d51/f58 [24444,50112] 0 2023-10-21T17:10:02.522 INFO:tasks.workunit.client.0.smithi012.stdout:8/293: fdatasync d0/d1a/f33 0 2023-10-21T17:10:03.324 INFO:tasks.workunit.client.0.smithi012.stdout:5/307: sync 2023-10-21T17:10:03.324 INFO:tasks.workunit.client.0.smithi012.stdout:5/308: chown d2/d1d/c21 57 1 2023-10-21T17:10:03.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/309: dread d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:10:03.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/310: truncate d2/d3e/f60 672056 0 2023-10-21T17:10:03.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/311: creat d2/d4f/d59/d5b/f67 x:0 0 0 2023-10-21T17:10:03.348 INFO:tasks.workunit.client.0.smithi012.stdout:5/312: stat d2/d1d/d20/f4d 0 2023-10-21T17:10:03.758 INFO:tasks.workunit.client.0.smithi012.stdout:5/313: creat d2/d4f/d59/f68 x:0 0 0 2023-10-21T17:10:03.759 INFO:tasks.workunit.client.0.smithi012.stdout:5/314: fsync d2/d6/f7 0 2023-10-21T17:10:03.859 INFO:tasks.workunit.client.0.smithi012.stdout:5/315: dwrite d2/d1d/d20/f2b [0,4194304] 0 2023-10-21T17:10:03.925 INFO:tasks.workunit.client.0.smithi012.stdout:4/348: write dc/f42 [2052078,11128] 0 2023-10-21T17:10:03.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/316: dwrite d2/d6/f54 [0,4194304] 0 2023-10-21T17:10:03.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/317: dread d2/d4f/d59/d5b/f41 [0,4194304] 0 2023-10-21T17:10:03.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/318: chown d2/d1d/d29/l52 5449040 1 2023-10-21T17:10:03.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/319: fsync d2/d1d/d29/f39 0 2023-10-21T17:10:04.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/320: dwrite d2/d6/f51 [0,4194304] 0 2023-10-21T17:10:04.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:10:04.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:10:05.088 INFO:tasks.workunit.client.0.smithi012.stdout:1/384: write d5/d32/d1b/d27/d21/f31 [667598,48085] 0 2023-10-21T17:10:05.110 INFO:tasks.workunit.client.0.smithi012.stdout:6/325: rename d13/d15/f19 to d13/d15/f67 0 2023-10-21T17:10:05.147 INFO:tasks.workunit.client.0.smithi012.stdout:1/385: dwrite d5/d32/d1b/d35/d3a/f3d [0,4194304] 0 2023-10-21T17:10:05.147 INFO:tasks.workunit.client.0.smithi012.stdout:1/386: fsync d5/d32/d1b/d35/d3a/f79 0 2023-10-21T17:10:05.306 INFO:tasks.workunit.client.0.smithi012.stdout:6/326: creat d13/d15/d1d/d28/d5b/f68 x:0 0 0 2023-10-21T17:10:05.426 INFO:tasks.workunit.client.0.smithi012.stdout:4/349: rmdir dc/d15/d18 39 2023-10-21T17:10:05.841 INFO:tasks.workunit.client.0.smithi012.stdout:1/387: link d5/d32/d1b/d27/c28 d5/d32/d1b/d2c/d4b/c81 0 2023-10-21T17:10:06.045 INFO:tasks.workunit.client.0.smithi012.stdout:6/327: link d13/f47 d13/f69 0 2023-10-21T17:10:06.176 INFO:tasks.workunit.client.0.smithi012.stdout:4/350: mkdir dc/d15/d18/d4c/d75 0 2023-10-21T17:10:06.177 INFO:tasks.workunit.client.0.smithi012.stdout:4/351: truncate dc/d15/f47 5126746 0 2023-10-21T17:10:06.177 INFO:tasks.workunit.client.0.smithi012.stdout:4/352: truncate dc/f67 195021 0 2023-10-21T17:10:06.387 INFO:tasks.workunit.client.0.smithi012.stdout:1/388: creat d5/d32/d62/f82 x:0 0 0 2023-10-21T17:10:06.423 INFO:tasks.workunit.client.0.smithi012.stdout:1/389: write d5/d32/d1b/d2c/d48/f6c [4799479,21455] 0 2023-10-21T17:10:06.423 INFO:tasks.workunit.client.0.smithi012.stdout:1/390: stat d5/d32/d1b/d27/d47/c78 0 2023-10-21T17:10:06.423 INFO:tasks.workunit.client.0.smithi012.stdout:1/391: creat d5/d26/d64/f83 x:0 0 0 2023-10-21T17:10:06.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/328: rmdir d13/d15/d1d/d24 39 2023-10-21T17:10:06.722 INFO:tasks.workunit.client.0.smithi012.stdout:4/353: mknod dc/d1e/d33/c76 0 2023-10-21T17:10:06.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/329: write fd [882265,43639] 0 2023-10-21T17:10:06.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/341: creat d0/f72 x:0 0 0 2023-10-21T17:10:06.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/342: write d0/d5/f22 [1611556,27959] 0 2023-10-21T17:10:06.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/343: truncate d0/d15/f23 441295 0 2023-10-21T17:10:07.129 INFO:tasks.workunit.client.0.smithi012.stdout:1/392: symlink d5/d26/d64/l84 0 2023-10-21T17:10:07.129 INFO:tasks.workunit.client.0.smithi012.stdout:1/393: chown d5/d32/d62/c66 320414554 1 2023-10-21T17:10:07.129 INFO:tasks.workunit.client.0.smithi012.stdout:1/394: creat d5/d32/d1b/d35/d3a/d5c/f85 x:0 0 0 2023-10-21T17:10:07.241 INFO:tasks.workunit.client.0.smithi012.stdout:6/330: mknod d13/d15/d1d/d5d/d66/c6a 0 2023-10-21T17:10:08.070 INFO:tasks.workunit.client.0.smithi012.stdout:8/294: mkdir d0/d12/d6c 0 2023-10-21T17:10:08.091 INFO:tasks.workunit.client.0.smithi012.stdout:7/382: rmdir d3/d6 39 2023-10-21T17:10:08.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/383: dwrite d3/d16/f65 [0,4194304] 0 2023-10-21T17:10:08.229 INFO:tasks.workunit.client.0.smithi012.stdout:7/384: dread d3/f41 [0,4194304] 0 2023-10-21T17:10:08.229 INFO:tasks.workunit.client.0.smithi012.stdout:7/385: chown d3/d6/f66 0 1 2023-10-21T17:10:08.897 INFO:tasks.workunit.client.0.smithi012.stdout:8/295: truncate d0/d12/f22 683631 0 2023-10-21T17:10:09.267 INFO:tasks.workunit.client.0.smithi012.stdout:7/386: unlink d3/d6/dc/d19/d1e/d69/f6b 0 2023-10-21T17:10:09.267 INFO:tasks.workunit.client.0.smithi012.stdout:8/296: mknod d0/d12/d40/d4a/d4e/c6d 0 2023-10-21T17:10:09.794 INFO:tasks.workunit.client.0.smithi012.stdout:4/354: getdents dc/d15/d18/d4c 0 2023-10-21T17:10:09.794 INFO:tasks.workunit.client.0.smithi012.stdout:4/355: chown dc/d15/d2a/d58 3484419 1 2023-10-21T17:10:09.977 INFO:tasks.workunit.client.0.smithi012.stdout:6/331: symlink d13/d35/l6b 0 2023-10-21T17:10:10.079 INFO:tasks.workunit.client.0.smithi012.stdout:7/387: mkdir d3/d6/d73 0 2023-10-21T17:10:10.370 INFO:tasks.workunit.client.0.smithi012.stdout:4/356: mkdir dc/d15/d18/d4c/d55/d6c/d77 0 2023-10-21T17:10:10.888 INFO:tasks.workunit.client.0.smithi012.stdout:0/371: rename d7/f35 to d7/d55/d23/f8e 0 2023-10-21T17:10:11.281 INFO:tasks.workunit.client.0.smithi012.stdout:3/296: mknod d0/c5b 0 2023-10-21T17:10:11.315 INFO:tasks.workunit.client.0.smithi012.stdout:3/297: read d0/da/f3d [632086,30358] 0 2023-10-21T17:10:11.315 INFO:tasks.workunit.client.0.smithi012.stdout:3/298: fsync d0/f4 0 2023-10-21T17:10:11.316 INFO:tasks.workunit.client.0.smithi012.stdout:3/299: chown d0/f15 28 1 2023-10-21T17:10:11.569 INFO:tasks.workunit.client.0.smithi012.stdout:4/357: creat dc/d15/d2a/f78 x:0 0 0 2023-10-21T17:10:11.710 INFO:tasks.workunit.client.0.smithi012.stdout:8/297: rmdir d0/d62 39 2023-10-21T17:10:11.710 INFO:tasks.workunit.client.0.smithi012.stdout:0/372: unlink d7/l71 0 2023-10-21T17:10:11.724 INFO:tasks.workunit.client.0.smithi012.stdout:8/298: dread d0/d12/d40/d4a/d5b/f67 [0,4194304] 0 2023-10-21T17:10:11.795 INFO:tasks.workunit.client.0.smithi012.stdout:0/373: dwrite d7/f10 [0,4194304] 0 2023-10-21T17:10:11.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/374: chown d7/d60/d8a 76072123 1 2023-10-21T17:10:11.936 INFO:tasks.workunit.client.0.smithi012.stdout:2/377: rename d1/d8/d25/c4e to d1/d4/d3f/d41/d59/c7e 0 2023-10-21T17:10:12.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/300: symlink d0/d32/d43/d47/d50/d52/l5c 0 2023-10-21T17:10:12.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/301: stat d0/da 0 2023-10-21T17:10:12.433 INFO:tasks.workunit.client.0.smithi012.stdout:4/358: symlink dc/d15/d2a/d31/l79 0 2023-10-21T17:10:12.462 INFO:tasks.workunit.client.0.smithi012.stdout:4/359: write dc/f25 [794241,24017] 0 2023-10-21T17:10:12.489 INFO:tasks.workunit.client.0.smithi012.stdout:4/360: write dc/d1e/f44 [886513,72453] 0 2023-10-21T17:10:12.576 INFO:tasks.workunit.client.0.smithi012.stdout:5/321: rename d2/d4f/d59/f68 to d2/d6/f69 0 2023-10-21T17:10:12.576 INFO:tasks.workunit.client.0.smithi012.stdout:5/322: creat d2/d6/f6a x:0 0 0 2023-10-21T17:10:12.597 INFO:tasks.workunit.client.0.smithi012.stdout:4/361: dwrite dc/d1e/f44 [0,4194304] 0 2023-10-21T17:10:12.709 INFO:tasks.workunit.client.0.smithi012.stdout:3/302: chown d0/l8 1899 1 2023-10-21T17:10:12.710 INFO:tasks.workunit.client.0.smithi012.stdout:3/303: write d0/f15 [924570,118622] 0 2023-10-21T17:10:12.710 INFO:tasks.workunit.client.0.smithi012.stdout:3/304: dread - d0/d32/d43/d47/d50/d52/f53 zero size 2023-10-21T17:10:12.715 INFO:tasks.workunit.client.0.smithi012.stdout:3/305: write d0/f15 [416426,22382] 0 2023-10-21T17:10:12.942 INFO:tasks.workunit.client.0.smithi012.stdout:9/344: rename d0/df/f5e to d0/d4/d4b/d6a/d12/d25/d39/d3b/f73 0 2023-10-21T17:10:13.134 INFO:tasks.workunit.client.0.smithi012.stdout:4/362: mkdir dc/d1e/d33/d7a 0 2023-10-21T17:10:13.230 INFO:tasks.workunit.client.0.smithi012.stdout:3/306: unlink d0/da/l39 0 2023-10-21T17:10:13.757 INFO:tasks.workunit.client.0.smithi012.stdout:1/395: rename d5/d26/d54/d68 to d5/d32/d1b/d27/d86 0 2023-10-21T17:10:13.758 INFO:tasks.workunit.client.0.smithi012.stdout:5/323: getdents d2/d1d/d29 0 2023-10-21T17:10:14.415 INFO:tasks.workunit.client.0.smithi012.stdout:9/345: link d0/d4/d4b/d6a/d12/d25/d2f/l45 d0/df/l74 0 2023-10-21T17:10:14.445 INFO:tasks.workunit.client.0.smithi012.stdout:3/307: dread d0/fd [0,4194304] 0 2023-10-21T17:10:14.643 INFO:tasks.workunit.client.0.smithi012.stdout:1/396: symlink d5/d32/d1b/d27/d47/l87 0 2023-10-21T17:10:14.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/324: link d2/d2c/f42 d2/d1d/d29/f6b 0 2023-10-21T17:10:14.974 INFO:tasks.workunit.client.0.smithi012.stdout:9/346: symlink d0/d4/d4b/d6a/d12/d25/d39/d3b/l75 0 2023-10-21T17:10:14.999 INFO:tasks.workunit.client.0.smithi012.stdout:9/347: write d0/d4/d4b/d6a/d12/d25/d39/d3b/f6f [2586041,106654] 0 2023-10-21T17:10:14.999 INFO:tasks.workunit.client.0.smithi012.stdout:9/348: dread - d0/d5/f32 zero size 2023-10-21T17:10:15.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/308: truncate d0/da/f3d 1006008 0 2023-10-21T17:10:15.282 INFO:tasks.workunit.client.0.smithi012.stdout:8/299: rename d0/d1a/c2c to d0/c6e 0 2023-10-21T17:10:15.283 INFO:tasks.workunit.client.0.smithi012.stdout:1/397: unlink d5/d32/d1b/d35/d3a/c6b 0 2023-10-21T17:10:15.606 INFO:tasks.workunit.client.0.smithi012.stdout:5/325: symlink d2/d1d/d20/l6c 0 2023-10-21T17:10:15.644 INFO:tasks.workunit.client.0.smithi012.stdout:5/326: read d2/d6/f54 [3581556,117039] 0 2023-10-21T17:10:15.645 INFO:tasks.workunit.client.0.smithi012.stdout:5/327: dread - d2/d2c/f42 zero size 2023-10-21T17:10:15.762 INFO:tasks.workunit.client.0.smithi012.stdout:5/328: dwrite d2/d1d/d4e/f5c [0,4194304] 0 2023-10-21T17:10:15.957 INFO:tasks.workunit.client.0.smithi012.stdout:6/332: sync 2023-10-21T17:10:16.277 INFO:tasks.workunit.client.0.smithi012.stdout:7/388: dwrite d3/d16/f32 [0,4194304] 0 2023-10-21T17:10:16.544 INFO:tasks.workunit.client.0.smithi012.stdout:0/375: rename d7/d55/d1f/f4a to d7/d60/d8a/f8f 0 2023-10-21T17:10:16.662 INFO:tasks.workunit.client.0.smithi012.stdout:8/300: symlink d0/d12/d6c/l6f 0 2023-10-21T17:10:16.662 INFO:tasks.workunit.client.0.smithi012.stdout:8/301: chown d0/d12/f22 1102 1 2023-10-21T17:10:16.663 INFO:tasks.workunit.client.0.smithi012.stdout:8/302: write d0/d1a/f33 [940074,53803] 0 2023-10-21T17:10:16.669 INFO:tasks.workunit.client.0.smithi012.stdout:8/303: read d0/d12/d51/f57 [452486,94244] 0 2023-10-21T17:10:17.025 INFO:tasks.workunit.client.0.smithi012.stdout:1/398: link d5/d32/d1b/d27/f38 d5/d32/d1b/d27/d1a/d46/f88 0 2023-10-21T17:10:17.026 INFO:tasks.workunit.client.0.smithi012.stdout:1/399: readlink d5/d32/d1b/d27/d1a/l59 0 2023-10-21T17:10:17.479 INFO:tasks.workunit.client.0.smithi012.stdout:6/333: symlink d13/d15/d1d/d28/d5b/l6c 0 2023-10-21T17:10:17.480 INFO:tasks.workunit.client.0.smithi012.stdout:6/334: chown d13/f69 953 1 2023-10-21T17:10:17.480 INFO:tasks.workunit.client.0.smithi012.stdout:6/335: fdatasync d13/d29/f5a 0 2023-10-21T17:10:17.562 INFO:tasks.workunit.client.0.smithi012.stdout:7/389: symlink d3/d16/l74 0 2023-10-21T17:10:17.867 INFO:tasks.workunit.client.0.smithi012.stdout:0/376: mkdir d7/d52/d90 0 2023-10-21T17:10:17.961 INFO:tasks.workunit.client.0.smithi012.stdout:8/304: mknod d0/d12/d40/d4a/d4e/c70 0 2023-10-21T17:10:17.961 INFO:tasks.workunit.client.0.smithi012.stdout:8/305: read - d0/d62/f6b zero size 2023-10-21T17:10:18.066 INFO:tasks.workunit.client.0.smithi012.stdout:8/306: dwrite d0/d29/f59 [0,4194304] 0 2023-10-21T17:10:18.257 INFO:tasks.workunit.client.0.smithi012.stdout:1/400: rename d5/d32/d1b/d27/d86/f6e to d5/d32/d1b/d27/d1a/f89 0 2023-10-21T17:10:18.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/336: getdents d13/d35 0 2023-10-21T17:10:18.862 INFO:tasks.workunit.client.0.smithi012.stdout:0/377: creat d7/d55/d23/d27/d31/f91 x:0 0 0 2023-10-21T17:10:19.121 INFO:tasks.workunit.client.0.smithi012.stdout:8/307: mkdir d0/d12/d40/d4a/d5b/d71 0 2023-10-21T17:10:19.127 INFO:tasks.workunit.client.0.smithi012.stdout:4/363: dwrite dc/d1e/d2b/f5c [0,4194304] 0 2023-10-21T17:10:19.225 INFO:tasks.workunit.client.0.smithi012.stdout:4/364: dwrite dc/f25 [0,4194304] 0 2023-10-21T17:10:19.312 INFO:tasks.workunit.client.0.smithi012.stdout:4/365: dwrite dc/d15/d18/d4c/d55/f64 [0,4194304] 0 2023-10-21T17:10:19.379 INFO:tasks.workunit.client.0.smithi012.stdout:1/401: getdents d5/d32/d1b 0 2023-10-21T17:10:19.898 INFO:tasks.workunit.client.0.smithi012.stdout:0/378: mknod d7/d60/d8a/c92 0 2023-10-21T17:10:20.043 INFO:tasks.workunit.client.0.smithi012.stdout:8/308: mkdir d0/d12/d40/d4a/d72 0 2023-10-21T17:10:20.752 INFO:tasks.workunit.client.0.smithi012.stdout:1/402: mkdir d5/d32/d1b/d2c/d4b/d8a 0 2023-10-21T17:10:20.873 INFO:tasks.workunit.client.0.smithi012.stdout:0/379: symlink d7/d52/d53/l93 0 2023-10-21T17:10:21.270 INFO:tasks.workunit.client.0.smithi012.stdout:0/380: truncate d7/d55/d23/d66/d48/f68 77073 0 2023-10-21T17:10:21.374 INFO:tasks.workunit.client.0.smithi012.stdout:3/309: dwrite d0/f7 [0,4194304] 0 2023-10-21T17:10:21.387 INFO:tasks.workunit.client.0.smithi012.stdout:2/378: mknod d1/c7f 0 2023-10-21T17:10:21.387 INFO:tasks.workunit.client.0.smithi012.stdout:2/379: fdatasync d1/d8/f76 0 2023-10-21T17:10:22.232 INFO:tasks.workunit.client.0.smithi012.stdout:0/381: creat d7/d55/d1f/f94 x:0 0 0 2023-10-21T17:10:22.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/382: chown d7/d55/d23/d27/d31/f4f 3642 1 2023-10-21T17:10:22.376 INFO:tasks.workunit.client.0.smithi012.stdout:3/310: rename d0/da/d28/f29 to d0/d32/d43/d47/d50/d52/f5d 0 2023-10-21T17:10:22.376 INFO:tasks.workunit.client.0.smithi012.stdout:3/311: readlink d0/d32/d43/d47/d50/l51 0 2023-10-21T17:10:22.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/380: mknod d1/d4/d3f/d41/c80 0 2023-10-21T17:10:22.792 INFO:tasks.workunit.client.0.smithi012.stdout:2/381: dwrite d1/d8/d19/d34/f45 [0,4194304] 0 2023-10-21T17:10:23.065 INFO:tasks.workunit.client.0.smithi012.stdout:7/390: write d3/d16/f67 [409761,110962] 0 2023-10-21T17:10:23.137 INFO:tasks.workunit.client.0.smithi012.stdout:3/312: mkdir d0/d1c/d5e 0 2023-10-21T17:10:23.138 INFO:tasks.workunit.client.0.smithi012.stdout:3/313: fsync d0/da/d28/f2c 0 2023-10-21T17:10:23.138 INFO:tasks.workunit.client.0.smithi012.stdout:3/314: chown d0/da/l10 2736432 1 2023-10-21T17:10:23.138 INFO:tasks.workunit.client.0.smithi012.stdout:3/315: creat d0/da/f5f x:0 0 0 2023-10-21T17:10:23.139 INFO:tasks.workunit.client.0.smithi012.stdout:3/316: creat d0/d1c/f60 x:0 0 0 2023-10-21T17:10:23.171 INFO:tasks.workunit.client.0.smithi012.stdout:3/317: dread d0/f14 [0,4194304] 0 2023-10-21T17:10:23.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/382: creat d1/d4/f81 x:0 0 0 2023-10-21T17:10:23.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/383: dread - d1/d4/f4c zero size 2023-10-21T17:10:23.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/384: chown d1/c7f 76319 1 2023-10-21T17:10:23.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/385: stat d1/d14/d16/f3e 0 2023-10-21T17:10:23.618 INFO:tasks.workunit.client.0.smithi012.stdout:2/386: dwrite d1/f30 [0,4194304] 0 2023-10-21T17:10:23.619 INFO:tasks.workunit.client.0.smithi012.stdout:2/387: readlink d1/d4/d3f/d41/l56 0 2023-10-21T17:10:23.757 INFO:tasks.workunit.client.0.smithi012.stdout:0/383: rmdir d7/d55/d23/d27/d31 39 2023-10-21T17:10:23.757 INFO:tasks.workunit.client.0.smithi012.stdout:0/384: truncate d7/d55/d1f/d28/f59 706776 0 2023-10-21T17:10:23.757 INFO:tasks.workunit.client.0.smithi012.stdout:0/385: write d7/d55/d23/d27/d31/f4f [1102521,38223] 0 2023-10-21T17:10:23.874 INFO:tasks.workunit.client.0.smithi012.stdout:7/391: truncate d3/f3f 903536 0 2023-10-21T17:10:24.133 INFO:tasks.workunit.client.0.smithi012.stdout:3/318: readlink d0/l30 0 2023-10-21T17:10:24.258 INFO:tasks.workunit.client.0.smithi012.stdout:2/388: mkdir d1/d14/d16/d22/d82 0 2023-10-21T17:10:24.362 INFO:tasks.workunit.client.0.smithi012.stdout:2/389: dwrite d1/d8/f10 [0,4194304] 0 2023-10-21T17:10:24.363 INFO:tasks.workunit.client.0.smithi012.stdout:2/390: fsync d1/d14/d17/f1f 0 2023-10-21T17:10:24.363 INFO:tasks.workunit.client.0.smithi012.stdout:2/391: readlink d1/d14/d16/d22/l2f 0 2023-10-21T17:10:24.363 INFO:tasks.workunit.client.0.smithi012.stdout:2/392: chown d1/d8/d19/d50/f79 338233658 1 2023-10-21T17:10:24.555 INFO:tasks.workunit.client.0.smithi012.stdout:0/386: rmdir d7/d55/d1f/d7f 0 2023-10-21T17:10:24.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/392: mknod d3/d6/dc/d19/d28/c75 0 2023-10-21T17:10:24.643 INFO:tasks.workunit.client.0.smithi012.stdout:7/393: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:10:24.644 INFO:tasks.workunit.client.0.smithi012.stdout:7/394: fdatasync d3/d16/f65 0 2023-10-21T17:10:24.725 INFO:tasks.workunit.client.0.smithi012.stdout:3/319: unlink d0/da/l4f 0 2023-10-21T17:10:24.855 INFO:tasks.workunit.client.0.smithi012.stdout:2/393: rename d1/d4/d3f/d41/l53 to d1/l83 0 2023-10-21T17:10:24.974 INFO:tasks.workunit.client.0.smithi012.stdout:0/387: truncate d7/d55/d23/d27/f5d 1307334 0 2023-10-21T17:10:24.974 INFO:tasks.workunit.client.0.smithi012.stdout:0/388: chown d7/d55/d1f/f94 8359066 1 2023-10-21T17:10:25.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/389: dwrite d7/d55/d23/f2a [4194304,4194304] 0 2023-10-21T17:10:25.086 INFO:tasks.workunit.client.0.smithi012.stdout:7/395: symlink d3/d6/dc/d19/d1e/l76 0 2023-10-21T17:10:25.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/390: dwrite d7/d55/d23/d27/d31/f91 [0,4194304] 0 2023-10-21T17:10:25.164 INFO:tasks.workunit.client.0.smithi012.stdout:3/320: getdents d0/d32/d43/d47 0 2023-10-21T17:10:25.164 INFO:tasks.workunit.client.0.smithi012.stdout:3/321: fdatasync d0/fd 0 2023-10-21T17:10:25.193 INFO:tasks.workunit.client.0.smithi012.stdout:0/391: dwrite d7/d55/d23/d27/d31/f32 [0,4194304] 0 2023-10-21T17:10:25.302 INFO:tasks.workunit.client.0.smithi012.stdout:4/366: dwrite dc/d15/f47 [0,4194304] 0 2023-10-21T17:10:25.302 INFO:tasks.workunit.client.0.smithi012.stdout:4/367: write dc/d1e/d33/f52 [75481,34135] 0 2023-10-21T17:10:25.376 INFO:tasks.workunit.client.0.smithi012.stdout:4/368: dwrite dc/d15/d2a/f78 [0,4194304] 0 2023-10-21T17:10:25.419 INFO:tasks.workunit.client.0.smithi012.stdout:4/369: dwrite dc/d1e/f3e [0,4194304] 0 2023-10-21T17:10:25.419 INFO:tasks.workunit.client.0.smithi012.stdout:4/370: fdatasync dc/d1e/f4b 0 2023-10-21T17:10:25.719 INFO:tasks.workunit.client.0.smithi012.stdout:1/403: write d5/d30/f67 [1414579,20812] 0 2023-10-21T17:10:26.086 INFO:tasks.workunit.client.0.smithi012.stdout:3/322: creat d0/d32/d43/f61 x:0 0 0 2023-10-21T17:10:26.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/323: chown d0/l16 0 1 2023-10-21T17:10:26.093 INFO:tasks.workunit.client.0.smithi012.stdout:5/329: sync 2023-10-21T17:10:26.093 INFO:tasks.workunit.client.0.smithi012.stdout:6/337: sync 2023-10-21T17:10:26.093 INFO:tasks.workunit.client.0.smithi012.stdout:9/349: sync 2023-10-21T17:10:26.093 INFO:tasks.workunit.client.0.smithi012.stdout:8/309: sync 2023-10-21T17:10:26.171 INFO:tasks.workunit.client.0.smithi012.stdout:2/394: getdents d1/d14/d16/d58 0 2023-10-21T17:10:26.177 INFO:tasks.workunit.client.0.smithi012.stdout:3/324: dwrite d0/d1c/f1e [4194304,4194304] 0 2023-10-21T17:10:26.201 INFO:tasks.workunit.client.0.smithi012.stdout:5/330: dwrite d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:10:26.738 INFO:tasks.workunit.client.0.smithi012.stdout:4/371: mknod dc/d15/d18/d4c/d55/d6c/c7b 0 2023-10-21T17:10:26.738 INFO:tasks.workunit.client.0.smithi012.stdout:4/372: readlink dc/d15/d18/l1a 0 2023-10-21T17:10:26.930 INFO:tasks.workunit.client.0.smithi012.stdout:1/404: dread d5/d32/d1b/d27/d1a/d46/f4d [0,4194304] 0 2023-10-21T17:10:26.931 INFO:tasks.workunit.client.0.smithi012.stdout:1/405: write d5/d26/d64/f83 [432529,115113] 0 2023-10-21T17:10:26.931 INFO:tasks.workunit.client.0.smithi012.stdout:1/406: dread - d5/d32/d1b/d2c/d48/f74 zero size 2023-10-21T17:10:26.931 INFO:tasks.workunit.client.0.smithi012.stdout:1/407: truncate d5/d32/d1b/d35/f3f 876400 0 2023-10-21T17:10:27.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/338: mkdir d13/d64/d6d 0 2023-10-21T17:10:27.454 INFO:tasks.workunit.client.0.smithi012.stdout:8/310: creat d0/d62/f73 x:0 0 0 2023-10-21T17:10:27.454 INFO:tasks.workunit.client.0.smithi012.stdout:8/311: chown d0/d12/d40/d4a/d4e/c6d 3219785 1 2023-10-21T17:10:27.621 INFO:tasks.workunit.client.0.smithi012.stdout:2/395: symlink d1/d8/d25/d5f/l84 0 2023-10-21T17:10:28.152 INFO:tasks.workunit.client.0.smithi012.stdout:5/331: link d2/d4f/d59/d5b/f67 d2/d4f/d59/d5b/f6d 0 2023-10-21T17:10:28.152 INFO:tasks.workunit.client.0.smithi012.stdout:5/332: chown d2/d4f/d59/d5b/f64 0 1 2023-10-21T17:10:28.407 INFO:tasks.workunit.client.0.smithi012.stdout:9/350: mkdir d0/d4/d4b/d6a/d12/d25/d39/d76 0 2023-10-21T17:10:29.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/339: symlink d13/d15/d1d/d5d/l6e 0 2023-10-21T17:10:29.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/340: write d13/d15/d1d/d24/f2f [2261818,127868] 0 2023-10-21T17:10:29.885 INFO:tasks.workunit.client.0.smithi012.stdout:8/312: unlink d0/d12/d40/d4a/d4e/f65 0 2023-10-21T17:10:29.962 INFO:tasks.workunit.client.0.smithi012.stdout:8/313: dwrite d0/f8 [0,4194304] 0 2023-10-21T17:10:30.046 INFO:tasks.workunit.client.0.smithi012.stdout:2/396: mknod d1/d4/d3f/d4a/c85 0 2023-10-21T17:10:30.046 INFO:tasks.workunit.client.0.smithi012.stdout:2/397: chown d1/d8/d25 10406 1 2023-10-21T17:10:30.046 INFO:tasks.workunit.client.0.smithi012.stdout:2/398: write d1/d14/d17/f55 [747167,96955] 0 2023-10-21T17:10:30.393 INFO:tasks.workunit.client.0.smithi012.stdout:3/325: truncate d0/d32/d43/f59 1010470 0 2023-10-21T17:10:30.394 INFO:tasks.workunit.client.0.smithi012.stdout:3/326: readlink d0/l49 0 2023-10-21T17:10:30.660 INFO:tasks.workunit.client.0.smithi012.stdout:5/333: creat d2/d4f/f6e x:0 0 0 2023-10-21T17:10:30.660 INFO:tasks.workunit.client.0.smithi012.stdout:5/334: chown d2/d4f/d59/l5d 51 1 2023-10-21T17:10:30.930 INFO:tasks.workunit.client.0.smithi012.stdout:9/351: truncate d0/d5/f69 4644250 0 2023-10-21T17:10:31.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/341: mknod d13/d64/c6f 0 2023-10-21T17:10:31.566 INFO:tasks.workunit.client.0.smithi012.stdout:2/399: mkdir d1/d14/d16/d22/d82/d86 0 2023-10-21T17:10:31.567 INFO:tasks.workunit.client.0.smithi012.stdout:7/396: write d3/d6/dc/d19/d1e/f5c [517076,107871] 0 2023-10-21T17:10:31.933 INFO:tasks.workunit.client.0.smithi012.stdout:9/352: mknod d0/c77 0 2023-10-21T17:10:31.934 INFO:tasks.workunit.client.0.smithi012.stdout:9/353: fdatasync d0/d4/d4b/d6a/d12/f48 0 2023-10-21T17:10:32.006 INFO:tasks.workunit.client.0.smithi012.stdout:9/354: dwrite d0/f1b [0,4194304] 0 2023-10-21T17:10:32.098 INFO:tasks.workunit.client.0.smithi012.stdout:6/342: mkdir d13/d15/d1d/d5d/d66/d70 0 2023-10-21T17:10:32.255 INFO:tasks.workunit.client.0.smithi012.stdout:0/392: rmdir d7/d55 39 2023-10-21T17:10:32.256 INFO:tasks.workunit.client.0.smithi012.stdout:8/314: link d0/l5 d0/d1a/d54/l74 0 2023-10-21T17:10:32.256 INFO:tasks.workunit.client.0.smithi012.stdout:8/315: stat d0/d12/c14 0 2023-10-21T17:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/400: creat d1/d4/d3f/f87 x:0 0 0 2023-10-21T17:10:32.482 INFO:tasks.workunit.client.0.smithi012.stdout:7/397: link d3/d6/dc/d19/d1e/d34/l58 d3/d6/dc/d19/l77 0 2023-10-21T17:10:32.482 INFO:tasks.workunit.client.0.smithi012.stdout:7/398: fsync d3/d16/f67 0 2023-10-21T17:10:32.482 INFO:tasks.workunit.client.0.smithi012.stdout:7/399: stat d3/d6/dc/d19/d28/c2c 0 2023-10-21T17:10:32.566 INFO:tasks.workunit.client.0.smithi012.stdout:7/400: dwrite d3/d6/dc/d19/f72 [0,4194304] 0 2023-10-21T17:10:32.757 INFO:tasks.workunit.client.0.smithi012.stdout:9/355: rmdir d0/df/d44 39 2023-10-21T17:10:32.757 INFO:tasks.workunit.client.0.smithi012.stdout:9/356: dread - d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 zero size 2023-10-21T17:10:33.004 INFO:tasks.workunit.client.0.smithi012.stdout:6/343: mkdir d13/d42/d71 0 2023-10-21T17:10:33.395 INFO:tasks.workunit.client.0.smithi012.stdout:8/316: link d0/f35 d0/d12/d40/d4a/d5b/f75 0 2023-10-21T17:10:33.451 INFO:tasks.workunit.client.0.smithi012.stdout:2/401: mknod d1/d4/d65/c88 0 2023-10-21T17:10:33.654 INFO:tasks.workunit.client.0.smithi012.stdout:5/335: rmdir d2/d1d 39 2023-10-21T17:10:33.654 INFO:tasks.workunit.client.0.smithi012.stdout:5/336: truncate d2/d6/f69 1029515 0 2023-10-21T17:10:33.762 INFO:tasks.workunit.client.0.smithi012.stdout:5/337: dwrite d2/d1d/d20/f48 [0,4194304] 0 2023-10-21T17:10:33.762 INFO:tasks.workunit.client.0.smithi012.stdout:5/338: chown d2/d1d/c40 921356 1 2023-10-21T17:10:35.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:10:35.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:10:35.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/393: getdents d7/d55/d23/d27 0 2023-10-21T17:10:35.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/394: chown d7/d55/d23/d27/f5d 15 1 2023-10-21T17:10:35.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/395: dread - d7/d55/d23/f46 zero size 2023-10-21T17:10:35.182 INFO:tasks.workunit.client.0.smithi012.stdout:0/396: dwrite d7/d60/d8a/f8f [0,4194304] 0 2023-10-21T17:10:35.183 INFO:tasks.workunit.client.0.smithi012.stdout:0/397: chown d7/d55/d1f/l4e 641 1 2023-10-21T17:10:35.183 INFO:tasks.workunit.client.0.smithi012.stdout:0/398: fsync d7/d55/d23/d27/d40/f87 0 2023-10-21T17:10:35.212 INFO:tasks.workunit.client.0.smithi012.stdout:2/402: creat d1/d8/d25/d5f/f89 x:0 0 0 2023-10-21T17:10:35.298 INFO:tasks.workunit.client.0.smithi012.stdout:5/339: symlink d2/d3e/d49/l6f 0 2023-10-21T17:10:35.340 INFO:tasks.workunit.client.0.smithi012.stdout:5/340: dread d2/d1d/d4e/f5c [0,4194304] 0 2023-10-21T17:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:0/399: creat d7/d52/d90/f95 x:0 0 0 2023-10-21T17:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/403: mkdir d1/d14/d17/d8a 0 2023-10-21T17:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/404: chown d1/d8/f2d 428004618 1 2023-10-21T17:10:36.190 INFO:tasks.workunit.client.0.smithi012.stdout:5/341: symlink d2/d2c/l70 0 2023-10-21T17:10:36.263 INFO:tasks.workunit.client.0.smithi012.stdout:0/400: dread d7/d55/d1f/f2e [0,4194304] 0 2023-10-21T17:10:36.354 INFO:tasks.workunit.client.0.smithi012.stdout:0/401: dwrite d7/d55/d23/d66/d48/f7e [0,4194304] 0 2023-10-21T17:10:36.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/342: link d2/d4f/d59/l5d d2/d1d/d20/l71 0 2023-10-21T17:10:36.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/343: chown d2/d1d/d20/l50 3 1 2023-10-21T17:10:37.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/401: rmdir d3/d6/dc/d19 39 2023-10-21T17:10:37.274 INFO:tasks.workunit.client.0.smithi012.stdout:7/402: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:10:37.688 INFO:tasks.workunit.client.0.smithi012.stdout:0/402: unlink d7/d52/l78 0 2023-10-21T17:10:37.688 INFO:tasks.workunit.client.0.smithi012.stdout:5/344: link d2/d1d/c40 d2/d1d/d20/c72 0 2023-10-21T17:10:38.449 INFO:tasks.workunit.client.0.smithi012.stdout:8/317: fsync d0/f35 0 2023-10-21T17:10:38.478 INFO:tasks.workunit.client.0.smithi012.stdout:5/345: dwrite d2/d1d/d29/f39 [4194304,4194304] 0 2023-10-21T17:10:38.515 INFO:tasks.workunit.client.0.smithi012.stdout:0/403: symlink d7/d55/d23/d27/d31/d3d/l96 0 2023-10-21T17:10:39.041 INFO:tasks.workunit.client.0.smithi012.stdout:8/318: fsync d0/f26 0 2023-10-21T17:10:39.042 INFO:tasks.workunit.client.0.smithi012.stdout:8/319: creat d0/d62/f76 x:0 0 0 2023-10-21T17:10:39.062 INFO:tasks.workunit.client.0.smithi012.stdout:4/373: rename dc/f11 to dc/d15/d18/d4c/d75/f7c 0 2023-10-21T17:10:39.237 INFO:tasks.workunit.client.0.smithi012.stdout:3/327: creat d0/f62 x:0 0 0 2023-10-21T17:10:39.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/320: symlink d0/d29/l77 0 2023-10-21T17:10:39.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/405: rename d1/d4/d65/c88 to d1/d8/d25/c8b 0 2023-10-21T17:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:2/406: creat d1/d14/d16/d20/f8c x:0 0 0 2023-10-21T17:10:39.731 INFO:tasks.workunit.client.0.smithi012.stdout:2/407: dread d1/d8/f76 [0,4194304] 0 2023-10-21T17:10:39.919 INFO:tasks.workunit.client.0.smithi012.stdout:4/374: rmdir dc/d15/d2a/d31/d36 39 2023-10-21T17:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/321: rmdir d0/d1a 39 2023-10-21T17:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/322: fsync d0/d12/d40/d4a/d5b/f67 0 2023-10-21T17:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/323: getdents d0/d12/d6a 0 2023-10-21T17:10:40.444 INFO:tasks.workunit.client.0.smithi012.stdout:2/408: symlink d1/d14/d16/l8d 0 2023-10-21T17:10:40.444 INFO:tasks.workunit.client.0.smithi012.stdout:2/409: chown d1/d14/d17/f73 0 1 2023-10-21T17:10:40.618 INFO:tasks.workunit.client.0.smithi012.stdout:4/375: truncate dc/d1e/d33/f43 2932378 0 2023-10-21T17:10:40.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/324: dread d0/fe [0,4194304] 0 2023-10-21T17:10:40.979 INFO:tasks.workunit.client.0.smithi012.stdout:2/410: symlink d1/d14/d17/d8a/l8e 0 2023-10-21T17:10:40.979 INFO:tasks.workunit.client.0.smithi012.stdout:2/411: dread - d1/d14/d16/d20/f8c zero size 2023-10-21T17:10:40.979 INFO:tasks.workunit.client.0.smithi012.stdout:2/412: chown d1/d14/d16/d58 7 1 2023-10-21T17:10:40.980 INFO:tasks.workunit.client.0.smithi012.stdout:2/413: creat d1/d8/f8f x:0 0 0 2023-10-21T17:10:41.353 INFO:tasks.workunit.client.0.smithi012.stdout:4/376: symlink dc/d15/d18/l7d 0 2023-10-21T17:10:41.385 INFO:tasks.workunit.client.0.smithi012.stdout:4/377: dread dc/d15/d2a/d31/d36/f46 [0,4194304] 0 2023-10-21T17:10:42.107 INFO:tasks.workunit.client.0.smithi012.stdout:4/378: creat dc/d15/d2a/d31/f7e x:0 0 0 2023-10-21T17:10:42.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/379: dread dc/d15/d18/d4c/d75/f7c [0,4194304] 0 2023-10-21T17:10:42.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/380: write dc/d1e/d33/f52 [1023715,18992] 0 2023-10-21T17:10:42.183 INFO:tasks.workunit.client.0.smithi012.stdout:1/408: sync 2023-10-21T17:10:42.183 INFO:tasks.workunit.client.0.smithi012.stdout:1/409: fdatasync d5/d32/d1b/d35/f3f 0 2023-10-21T17:10:42.205 INFO:tasks.workunit.client.0.smithi012.stdout:1/410: dread d5/d32/d1b/d27/d21/f37 [0,4194304] 0 2023-10-21T17:10:42.221 INFO:tasks.workunit.client.0.smithi012.stdout:0/404: dwrite d7/d55/d23/d66/d48/f68 [0,4194304] 0 2023-10-21T17:10:42.221 INFO:tasks.workunit.client.0.smithi012.stdout:0/405: readlink d7/d55/d23/d27/d31/d3d/l96 0 2023-10-21T17:10:42.544 INFO:tasks.workunit.client.0.smithi012.stdout:4/381: creat dc/d15/d18/d4c/d55/f7f x:0 0 0 2023-10-21T17:10:42.807 INFO:tasks.workunit.client.0.smithi012.stdout:8/325: unlink d0/d12/f37 0 2023-10-21T17:10:43.004 INFO:tasks.workunit.client.0.smithi012.stdout:0/406: creat d7/d52/d53/f97 x:0 0 0 2023-10-21T17:10:43.005 INFO:tasks.workunit.client.0.smithi012.stdout:0/407: read - d7/f83 zero size 2023-10-21T17:10:43.127 INFO:tasks.workunit.client.0.smithi012.stdout:7/403: unlink d3/d6/dc/d19/f30 0 2023-10-21T17:10:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:9/357: unlink d0/fe 0 2023-10-21T17:10:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:4/382: creat dc/d15/f80 x:0 0 0 2023-10-21T17:10:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:8/326: readlink d0/l7 0 2023-10-21T17:10:44.755 INFO:tasks.workunit.client.0.smithi012.stdout:9/358: creat d0/f78 x:0 0 0 2023-10-21T17:10:44.755 INFO:tasks.workunit.client.0.smithi012.stdout:9/359: readlink d0/d15/l49 0 2023-10-21T17:10:44.755 INFO:tasks.workunit.client.0.smithi012.stdout:9/360: fsync d0/d4/d4b/d6a/d12/d2a/d36/f64 0 2023-10-21T17:10:44.838 INFO:tasks.workunit.client.0.smithi012.stdout:8/327: rmdir d0/d12/d51 39 2023-10-21T17:10:45.622 INFO:tasks.workunit.client.0.smithi012.stdout:6/344: sync 2023-10-21T17:10:45.704 INFO:tasks.workunit.client.0.smithi012.stdout:6/345: dwrite f1 [0,4194304] 0 2023-10-21T17:10:45.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/346: dwrite fd [0,4194304] 0 2023-10-21T17:10:45.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/347: chown d13/d15/c1b 1907 1 2023-10-21T17:10:45.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/348: write d13/d15/f61 [1358993,28456] 0 2023-10-21T17:10:45.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/349: fdatasync fd 0 2023-10-21T17:10:45.970 INFO:tasks.workunit.client.0.smithi012.stdout:9/361: unlink d0/f2 0 2023-10-21T17:10:45.971 INFO:tasks.workunit.client.0.smithi012.stdout:0/408: creat d7/f98 x:0 0 0 2023-10-21T17:10:45.971 INFO:tasks.workunit.client.0.smithi012.stdout:9/362: fsync d0/f5a 0 2023-10-21T17:10:46.397 INFO:tasks.workunit.client.0.smithi012.stdout:6/350: truncate d13/f16 335188 0 2023-10-21T17:10:46.435 INFO:tasks.workunit.client.0.smithi012.stdout:0/409: symlink d7/l99 0 2023-10-21T17:10:46.441 INFO:tasks.workunit.client.0.smithi012.stdout:0/410: write d7/d55/d23/d66/d48/f61 [323749,63809] 0 2023-10-21T17:10:46.502 INFO:tasks.workunit.client.0.smithi012.stdout:9/363: write d0/f1b [226101,97316] 0 2023-10-21T17:10:46.579 INFO:tasks.workunit.client.0.smithi012.stdout:9/364: dwrite d0/d4/d4b/d6a/d12/d25/d39/d3b/f73 [0,4194304] 0 2023-10-21T17:10:46.631 INFO:tasks.workunit.client.0.smithi012.stdout:9/365: dwrite d0/d4/d4b/d6a/d12/d25/f71 [0,4194304] 0 2023-10-21T17:10:46.632 INFO:tasks.workunit.client.0.smithi012.stdout:9/366: fsync d0/d4/d4b/d6a/d12/d25/f71 0 2023-10-21T17:10:46.780 INFO:tasks.workunit.client.0.smithi012.stdout:5/346: rename d2/d3e to d2/d2c/d73 0 2023-10-21T17:10:46.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/347: creat d2/d4f/d59/d5b/f74 x:0 0 0 2023-10-21T17:10:46.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/351: mknod d13/d15/d1d/d5d/d66/c72 0 2023-10-21T17:10:46.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/348: chown d2/d4f/d59/d5b/f74 0 1 2023-10-21T17:10:46.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/352: chown d13/d15/d1d/d28/l3d 10472 1 2023-10-21T17:10:47.042 INFO:tasks.workunit.client.0.smithi012.stdout:8/328: sync 2023-10-21T17:10:47.042 INFO:tasks.workunit.client.0.smithi012.stdout:1/411: sync 2023-10-21T17:10:47.073 INFO:tasks.workunit.client.0.smithi012.stdout:8/329: write d0/d1a/f41 [2293031,24277] 0 2023-10-21T17:10:47.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/367: mknod d0/d4/d4b/d6a/d12/d2a/d36/c79 0 2023-10-21T17:10:47.536 INFO:tasks.workunit.client.0.smithi012.stdout:3/328: rename d0/c57 to d0/d32/d43/d47/c63 0 2023-10-21T17:10:47.713 INFO:tasks.workunit.client.0.smithi012.stdout:0/411: sync 2023-10-21T17:10:47.764 INFO:tasks.workunit.client.0.smithi012.stdout:5/349: dread d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:10:47.964 INFO:tasks.workunit.client.0.smithi012.stdout:6/353: mkdir d13/d64/d6d/d73 0 2023-10-21T17:10:47.964 INFO:tasks.workunit.client.0.smithi012.stdout:6/354: getdents d13/d35 0 2023-10-21T17:10:48.102 INFO:tasks.workunit.client.0.smithi012.stdout:1/412: mknod d5/d32/d1b/d35/d49/c8b 0 2023-10-21T17:10:48.315 INFO:tasks.workunit.client.0.smithi012.stdout:8/330: symlink d0/d12/d40/d4a/d5b/l78 0 2023-10-21T17:10:48.315 INFO:tasks.workunit.client.0.smithi012.stdout:8/331: stat d0/d1a/f3d 0 2023-10-21T17:10:48.315 INFO:tasks.workunit.client.0.smithi012.stdout:8/332: write d0/d1a/f41 [1538394,76953] 0 2023-10-21T17:10:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:3/329: rmdir d0/da 39 2023-10-21T17:10:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:3/330: chown d0/d32/d43/l4b 41 1 2023-10-21T17:10:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:2/414: rename d1/d8/f3d to d1/d8/d25/d5f/f90 0 2023-10-21T17:10:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:2/415: chown d1/d14/d17/f73 18092 1 2023-10-21T17:10:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:7/404: rename d3/d6/dc/d19/d43 to d3/d6/dc/d19/d43/d78 22 2023-10-21T17:10:48.674 INFO:tasks.workunit.client.0.smithi012.stdout:0/412: rmdir d7/d55/d23/d66/d63 39 2023-10-21T17:10:48.830 INFO:tasks.workunit.client.0.smithi012.stdout:6/355: mkdir d13/d15/d1d/d5d/d66/d70/d74 0 2023-10-21T17:10:48.831 INFO:tasks.workunit.client.0.smithi012.stdout:1/413: link d5/d32/d1b/c2e d5/d32/d1b/d2c/c8c 0 2023-10-21T17:10:49.876 INFO:tasks.workunit.client.0.smithi012.stdout:2/416: rename d1/d14/l1e to d1/d4/d65/l91 0 2023-10-21T17:10:49.876 INFO:tasks.workunit.client.0.smithi012.stdout:2/417: dread - d1/d8/d25/f70 zero size 2023-10-21T17:10:49.877 INFO:tasks.workunit.client.0.smithi012.stdout:2/418: creat d1/d14/d17/f92 x:0 0 0 2023-10-21T17:10:49.957 INFO:tasks.workunit.client.0.smithi012.stdout:2/419: dwrite d1/d8/f76 [0,4194304] 0 2023-10-21T17:10:49.958 INFO:tasks.workunit.client.0.smithi012.stdout:2/420: write d1/f1c [773174,10614] 0 2023-10-21T17:10:50.413 INFO:tasks.workunit.client.0.smithi012.stdout:5/350: mknod d2/d1d/d29/d57/c75 0 2023-10-21T17:10:50.413 INFO:tasks.workunit.client.0.smithi012.stdout:5/351: dread - d2/d4f/d59/d5b/f74 zero size 2023-10-21T17:10:50.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/352: dread d2/d4f/d59/d5b/d1e/f26 [0,4194304] 0 2023-10-21T17:10:50.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/353: readlink d2/d4f/d59/d5b/l45 0 2023-10-21T17:10:50.428 INFO:tasks.workunit.client.0.smithi012.stdout:5/354: write d2/d4f/d59/d5b/f64 [121720,28481] 0 2023-10-21T17:10:50.721 INFO:tasks.workunit.client.0.smithi012.stdout:1/414: truncate d5/d32/d1b/d35/f3f 336017 0 2023-10-21T17:10:50.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/356: mkdir d13/d15/d1d/d28/d5b/d75 0 2023-10-21T17:10:51.159 INFO:tasks.workunit.client.0.smithi012.stdout:9/368: link d0/d5/c24 d0/df/d44/c7a 0 2023-10-21T17:10:51.159 INFO:tasks.workunit.client.0.smithi012.stdout:9/369: write d0/f14 [139,102322] 0 2023-10-21T17:10:51.239 INFO:tasks.workunit.client.0.smithi012.stdout:3/331: getdents d0/da/d28 0 2023-10-21T17:10:51.240 INFO:tasks.workunit.client.0.smithi012.stdout:8/333: write d0/f32 [1503649,95029] 0 2023-10-21T17:10:51.386 INFO:tasks.workunit.client.0.smithi012.stdout:4/383: rename dc/d15/d18/d4c/d55/f64 to dc/d15/d18/d4c/f81 0 2023-10-21T17:10:51.406 INFO:tasks.workunit.client.0.smithi012.stdout:4/384: dread dc/f42 [0,4194304] 0 2023-10-21T17:10:51.965 INFO:tasks.workunit.client.0.smithi012.stdout:7/405: dwrite d3/f41 [0,4194304] 0 2023-10-21T17:10:52.245 INFO:tasks.workunit.client.0.smithi012.stdout:5/355: mknod d2/d4f/d59/d5b/c76 0 2023-10-21T17:10:52.246 INFO:tasks.workunit.client.0.smithi012.stdout:5/356: write d2/d1d/d29/f39 [8429318,121326] 0 2023-10-21T17:10:52.246 INFO:tasks.workunit.client.0.smithi012.stdout:5/357: creat d2/d4f/d59/d5b/f77 x:0 0 0 2023-10-21T17:10:52.250 INFO:tasks.workunit.client.0.smithi012.stdout:5/358: write d2/d2c/f43 [705613,1594] 0 2023-10-21T17:10:52.251 INFO:tasks.workunit.client.0.smithi012.stdout:5/359: creat d2/d1d/d4e/f78 x:0 0 0 2023-10-21T17:10:52.355 INFO:tasks.workunit.client.0.smithi012.stdout:1/415: unlink d5/d32/f3c 0 2023-10-21T17:10:52.444 INFO:tasks.workunit.client.0.smithi012.stdout:1/416: dwrite d5/d26/d64/f83 [0,4194304] 0 2023-10-21T17:10:52.522 INFO:tasks.workunit.client.0.smithi012.stdout:1/417: dwrite d5/d30/d51/f73 [0,4194304] 0 2023-10-21T17:10:52.625 INFO:tasks.workunit.client.0.smithi012.stdout:9/370: unlink d0/d4/d4b/d6a/d12/d2a/c41 0 2023-10-21T17:10:52.794 INFO:tasks.workunit.client.0.smithi012.stdout:3/332: unlink d0/d1c/l3a 0 2023-10-21T17:10:53.196 INFO:tasks.workunit.client.0.smithi012.stdout:0/413: rename d7/d55/d23/d27/l70 to d7/d52/l9a 0 2023-10-21T17:10:53.196 INFO:tasks.workunit.client.0.smithi012.stdout:0/414: fsync d7/d55/d23/d27/d31/f32 0 2023-10-21T17:10:53.196 INFO:tasks.workunit.client.0.smithi012.stdout:0/415: stat d7/d55/d23/d27/d31/f32 0 2023-10-21T17:10:53.400 INFO:tasks.workunit.client.0.smithi012.stdout:4/385: link dc/d15/d2a/d31/d36/f46 dc/d15/d18/f82 0 2023-10-21T17:10:53.400 INFO:tasks.workunit.client.0.smithi012.stdout:2/421: mkdir d1/d4/d93 0 2023-10-21T17:10:53.401 INFO:tasks.workunit.client.0.smithi012.stdout:2/422: creat d1/d8/d25/f94 x:0 0 0 2023-10-21T17:10:53.401 INFO:tasks.workunit.client.0.smithi012.stdout:2/423: write d1/d8/d19/d50/f7a [668597,15525] 0 2023-10-21T17:10:53.515 INFO:tasks.workunit.client.0.smithi012.stdout:2/424: dwrite d1/d14/d17/f92 [0,4194304] 0 2023-10-21T17:10:53.960 INFO:tasks.workunit.client.0.smithi012.stdout:5/360: symlink d2/d1d/d20/l79 0 2023-10-21T17:10:53.961 INFO:tasks.workunit.client.0.smithi012.stdout:5/361: chown d2/d4f/d59/d5b/c3c 17965 1 2023-10-21T17:10:53.961 INFO:tasks.workunit.client.0.smithi012.stdout:5/362: chown d2/d6/l38 3046741 1 2023-10-21T17:10:54.560 INFO:tasks.workunit.client.0.smithi012.stdout:1/418: dread d5/d32/d1b/d27/d1a/d46/f60 [0,4194304] 0 2023-10-21T17:10:54.561 INFO:tasks.workunit.client.0.smithi012.stdout:1/419: fdatasync d5/f14 0 2023-10-21T17:10:54.644 INFO:tasks.workunit.client.0.smithi012.stdout:3/333: truncate d0/d32/d43/d47/f48 1921314 0 2023-10-21T17:10:54.718 INFO:tasks.workunit.client.0.smithi012.stdout:3/334: dwrite d0/d1c/f60 [0,4194304] 0 2023-10-21T17:10:54.812 INFO:tasks.workunit.client.0.smithi012.stdout:3/335: dwrite d0/da/f34 [4194304,4194304] 0 2023-10-21T17:10:54.895 INFO:tasks.workunit.client.0.smithi012.stdout:6/357: rename d13/d15/c1b to d13/d15/d1d/d24/c76 0 2023-10-21T17:10:54.933 INFO:tasks.workunit.client.0.smithi012.stdout:6/358: read d13/d29/d37/d3b/f57 [1332226,27069] 0 2023-10-21T17:10:55.234 INFO:tasks.workunit.client.0.smithi012.stdout:4/386: mkdir dc/d15/d18/d4c/d55/d6c/d83 0 2023-10-21T17:10:55.235 INFO:tasks.workunit.client.0.smithi012.stdout:4/387: chown dc/d1e/d65/f66 59 1 2023-10-21T17:10:55.620 INFO:tasks.workunit.client.0.smithi012.stdout:2/425: unlink d1/d14/c21 0 2023-10-21T17:10:55.634 INFO:tasks.workunit.client.0.smithi012.stdout:2/426: dread d1/d14/d16/f72 [0,4194304] 0 2023-10-21T17:10:55.809 INFO:tasks.workunit.client.0.smithi012.stdout:8/334: dwrite d0/f4 [0,4194304] 0 2023-10-21T17:10:56.408 INFO:tasks.workunit.client.0.smithi012.stdout:7/406: dwrite d3/f3f [0,4194304] 0 2023-10-21T17:10:56.449 INFO:tasks.workunit.client.0.smithi012.stdout:7/407: dread d3/f3f [0,4194304] 0 2023-10-21T17:10:56.449 INFO:tasks.workunit.client.0.smithi012.stdout:7/408: chown d3/d6/dc/d19/d1e/c2a 406628730 1 2023-10-21T17:10:57.170 INFO:tasks.workunit.client.0.smithi012.stdout:9/371: symlink d0/d4/d4b/l7b 0 2023-10-21T17:10:57.170 INFO:tasks.workunit.client.0.smithi012.stdout:9/372: truncate d0/d4/d4b/d6a/d12/f58 609864 0 2023-10-21T17:10:57.765 INFO:tasks.workunit.client.0.smithi012.stdout:3/336: symlink d0/d32/d43/d47/d50/l64 0 2023-10-21T17:10:57.938 INFO:tasks.workunit.client.0.smithi012.stdout:6/359: mkdir d13/d29/d77 0 2023-10-21T17:10:58.488 INFO:tasks.workunit.client.0.smithi012.stdout:2/427: mkdir d1/d95 0 2023-10-21T17:10:59.094 INFO:tasks.workunit.client.0.smithi012.stdout:7/409: creat d3/d6/dc/f79 x:0 0 0 2023-10-21T17:10:59.095 INFO:tasks.workunit.client.0.smithi012.stdout:7/410: creat d3/d64/f7a x:0 0 0 2023-10-21T17:10:59.166 INFO:tasks.workunit.client.0.smithi012.stdout:7/411: dwrite d3/d6/dc/d19/f6c [0,4194304] 0 2023-10-21T17:10:59.235 INFO:tasks.workunit.client.0.smithi012.stdout:9/373: creat d0/df/d44/f7c x:0 0 0 2023-10-21T17:10:59.455 INFO:tasks.workunit.client.0.smithi012.stdout:1/420: getdents d5/d30/d51 0 2023-10-21T17:10:59.754 INFO:tasks.workunit.client.0.smithi012.stdout:6/360: mkdir d13/d29/d78 0 2023-10-21T17:10:59.754 INFO:tasks.workunit.client.0.smithi012.stdout:6/361: stat d13/d29/l2d 0 2023-10-21T17:10:59.784 INFO:tasks.workunit.client.0.smithi012.stdout:6/362: write fd [2879774,53945] 0 2023-10-21T17:10:59.785 INFO:tasks.workunit.client.0.smithi012.stdout:6/363: write d13/d35/d4c/f65 [145675,55451] 0 2023-10-21T17:10:59.785 INFO:tasks.workunit.client.0.smithi012.stdout:6/364: write f6 [691503,44263] 0 2023-10-21T17:10:59.938 INFO:tasks.workunit.client.0.smithi012.stdout:8/335: truncate d0/f36 2618051 0 2023-10-21T17:11:00.689 INFO:tasks.workunit.client.0.smithi012.stdout:7/412: unlink d3/d6/dc/d19/d1e/d34/l3e 0 2023-10-21T17:11:00.689 INFO:tasks.workunit.client.0.smithi012.stdout:7/413: readlink d3/d6/dc/l5d 0 2023-10-21T17:11:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:5/363: sync 2023-10-21T17:11:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:5/364: chown d2/d4f/f6e 4231 1 2023-10-21T17:11:01.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/365: creat d13/d15/d1d/d5d/d66/f79 x:0 0 0 2023-10-21T17:11:01.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/336: mkdir d0/d29/d79 0 2023-10-21T17:11:01.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/337: write d0/d12/d51/f57 [1609546,84284] 0 2023-10-21T17:11:01.583 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:44:27.566 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.592 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:44:27.677 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.596 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:44:27.680 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.602 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:44:27.585 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.603 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:44:27.688 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.606 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:44:27.691 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.644 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:44:27.729 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.656 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:44:27.740 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.730 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:44:27.712 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:11:01.921 INFO:tasks.workunit.client.0.smithi012.stdout:7/414: mkdir d3/d6/dc/d19/d1e/d7b 0 2023-10-21T17:11:01.922 INFO:tasks.workunit.client.0.smithi012.stdout:2/428: symlink d1/d8/l96 0 2023-10-21T17:11:01.922 INFO:tasks.workunit.client.0.smithi012.stdout:2/429: fdatasync d1/d14/d17/f92 0 2023-10-21T17:11:02.010 INFO:tasks.workunit.client.0.smithi012.stdout:7/415: dwrite d3/d6/dc/d19/d28/f3c [0,4194304] 0 2023-10-21T17:11:02.010 INFO:tasks.workunit.client.0.smithi012.stdout:5/365: creat d2/d2c/f7a x:0 0 0 2023-10-21T17:11:02.077 INFO:tasks.workunit.client.0.smithi012.stdout:6/366: mkdir d13/d15/d1d/d5d/d66/d7a 0 2023-10-21T17:11:02.234 INFO:tasks.workunit.client.0.smithi012.stdout:4/388: write dc/d1e/d33/f43 [2576187,44210] 0 2023-10-21T17:11:02.314 INFO:tasks.workunit.client.0.smithi012.stdout:8/338: truncate d0/f17 2695004 0 2023-10-21T17:11:02.339 INFO:tasks.workunit.client.0.smithi012.stdout:8/339: dread d0/f32 [0,4194304] 0 2023-10-21T17:11:02.339 INFO:tasks.workunit.client.0.smithi012.stdout:8/340: creat d0/d29/f7a x:0 0 0 2023-10-21T17:11:02.533 INFO:tasks.workunit.client.0.smithi012.stdout:2/430: mkdir d1/d8/d19/d50/d97 0 2023-10-21T17:11:02.715 INFO:tasks.workunit.client.0.smithi012.stdout:7/416: getdents d3/d6 0 2023-10-21T17:11:02.715 INFO:tasks.workunit.client.0.smithi012.stdout:7/417: creat d3/d29/f7c x:0 0 0 2023-10-21T17:11:02.716 INFO:tasks.workunit.client.0.smithi012.stdout:7/418: write d3/d16/f67 [295878,34251] 0 2023-10-21T17:11:02.720 INFO:tasks.workunit.client.0.smithi012.stdout:7/419: fsync d3/d16/f67 0 2023-10-21T17:11:02.720 INFO:tasks.workunit.client.0.smithi012.stdout:7/420: creat d3/d29/f7d x:0 0 0 2023-10-21T17:11:02.873 INFO:tasks.workunit.client.0.smithi012.stdout:5/366: getdents d2/d4f/d59 0 2023-10-21T17:11:03.144 INFO:tasks.workunit.client.0.smithi012.stdout:6/367: symlink d13/d42/l7b 0 2023-10-21T17:11:03.223 INFO:tasks.workunit.client.0.smithi012.stdout:4/389: creat dc/d1e/d6e/f84 x:0 0 0 2023-10-21T17:11:03.585 INFO:tasks.workunit.client.0.smithi012.stdout:8/341: truncate d0/d29/f3c 1096376 0 2023-10-21T17:11:03.586 INFO:tasks.workunit.client.0.smithi012.stdout:8/342: dread - d0/d46/f5d zero size 2023-10-21T17:11:04.184 INFO:tasks.workunit.client.0.smithi012.stdout:7/421: mknod d3/d6/dc/d19/d43/c7e 0 2023-10-21T17:11:04.185 INFO:tasks.workunit.client.0.smithi012.stdout:7/422: truncate d3/d16/f50 946385 0 2023-10-21T17:11:04.305 INFO:tasks.workunit.client.0.smithi012.stdout:5/367: creat d2/d2c/d73/d49/f7b x:0 0 0 2023-10-21T17:11:04.420 INFO:tasks.workunit.client.0.smithi012.stdout:6/368: creat d13/d15/d1d/d28/f7c x:0 0 0 2023-10-21T17:11:04.420 INFO:tasks.workunit.client.0.smithi012.stdout:6/369: write d13/d15/f1a [783624,55467] 0 2023-10-21T17:11:04.503 INFO:tasks.workunit.client.0.smithi012.stdout:4/390: getdents dc/d15/d18/d4c/d75 0 2023-10-21T17:11:04.523 INFO:tasks.workunit.client.0.smithi012.stdout:6/370: dwrite f8 [0,4194304] 0 2023-10-21T17:11:04.889 INFO:tasks.workunit.client.0.smithi012.stdout:2/431: rmdir d1/d14/d16/d20 39 2023-10-21T17:11:04.889 INFO:tasks.workunit.client.0.smithi012.stdout:2/432: write d1/d8/d25/f94 [393863,23691] 0 2023-10-21T17:11:04.890 INFO:tasks.workunit.client.0.smithi012.stdout:2/433: creat d1/d14/d17/f98 x:0 0 0 2023-10-21T17:11:04.890 INFO:tasks.workunit.client.0.smithi012.stdout:2/434: chown d1/d14/c52 35 1 2023-10-21T17:11:04.913 INFO:tasks.workunit.client.0.smithi012.stdout:7/423: rmdir d3/d6 39 2023-10-21T17:11:04.913 INFO:tasks.workunit.client.0.smithi012.stdout:7/424: chown d3/d16/f1a 921588 1 2023-10-21T17:11:04.913 INFO:tasks.workunit.client.0.smithi012.stdout:4/391: creat dc/d1e/f85 x:0 0 0 2023-10-21T17:11:05.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:11:05.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:11:05.890 INFO:tasks.workunit.client.0.smithi012.stdout:2/435: unlink d1/d14/d16/f3e 0 2023-10-21T17:11:05.891 INFO:tasks.workunit.client.0.smithi012.stdout:2/436: chown d1/d8/f2d 107819 1 2023-10-21T17:11:05.994 INFO:tasks.workunit.client.0.smithi012.stdout:0/416: rename d7/d60 to d7/d55/d1f/d28/d9b 0 2023-10-21T17:11:06.143 INFO:tasks.workunit.client.0.smithi012.stdout:7/425: unlink d3/d6/dc/d19/l39 0 2023-10-21T17:11:06.143 INFO:tasks.workunit.client.0.smithi012.stdout:7/426: chown d3/d6/dc/d19/f72 0 1 2023-10-21T17:11:06.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/427: write d3/f3f [2763928,38196] 0 2023-10-21T17:11:06.220 INFO:tasks.workunit.client.0.smithi012.stdout:7/428: dwrite d3/d6/dc/d19/d28/f3c [0,4194304] 0 2023-10-21T17:11:06.220 INFO:tasks.workunit.client.0.smithi012.stdout:7/429: read - d3/d6/dc/d19/d28/f6d zero size 2023-10-21T17:11:06.300 INFO:tasks.workunit.client.0.smithi012.stdout:7/430: dwrite d3/d6/dc/d19/d1e/f5c [0,4194304] 0 2023-10-21T17:11:06.352 INFO:tasks.workunit.client.0.smithi012.stdout:4/392: creat dc/d15/d18/d4c/d55/d6c/d83/f86 x:0 0 0 2023-10-21T17:11:06.434 INFO:tasks.workunit.client.0.smithi012.stdout:9/374: dwrite d0/f3e [0,4194304] 0 2023-10-21T17:11:06.647 INFO:tasks.workunit.client.0.smithi012.stdout:2/437: symlink d1/d8/d19/d50/d97/l99 0 2023-10-21T17:11:06.648 INFO:tasks.workunit.client.0.smithi012.stdout:2/438: dread - d1/f77 zero size 2023-10-21T17:11:06.696 INFO:tasks.workunit.client.0.smithi012.stdout:3/337: dwrite d0/da/d28/f3c [0,4194304] 0 2023-10-21T17:11:06.915 INFO:tasks.workunit.client.0.smithi012.stdout:5/368: rename d2/d2c/d73/d49/f7b to d2/d4f/d59/d5b/f7c 0 2023-10-21T17:11:07.088 INFO:tasks.workunit.client.0.smithi012.stdout:0/417: mknod d7/d55/d1f/d28/c9c 0 2023-10-21T17:11:07.465 INFO:tasks.workunit.client.0.smithi012.stdout:7/431: mkdir d3/d29/d7f 0 2023-10-21T17:11:07.465 INFO:tasks.workunit.client.0.smithi012.stdout:7/432: write d3/d16/f56 [2924266,38550] 0 2023-10-21T17:11:07.465 INFO:tasks.workunit.client.0.smithi012.stdout:7/433: readlink d3/d6/dc/d19/d28/l35 0 2023-10-21T17:11:07.647 INFO:tasks.workunit.client.0.smithi012.stdout:4/393: getdents dc/d15 0 2023-10-21T17:11:07.647 INFO:tasks.workunit.client.0.smithi012.stdout:4/394: creat dc/d15/d2a/d31/f87 x:0 0 0 2023-10-21T17:11:07.981 INFO:tasks.workunit.client.0.smithi012.stdout:2/439: mknod d1/d14/d17/c9a 0 2023-10-21T17:11:08.361 INFO:tasks.workunit.client.0.smithi012.stdout:3/338: dread d0/da/f1f [0,4194304] 0 2023-10-21T17:11:08.425 INFO:tasks.workunit.client.0.smithi012.stdout:9/375: rename d0/d4/d4b/d6a/l2d to d0/d5/l7d 0 2023-10-21T17:11:09.018 INFO:tasks.workunit.client.0.smithi012.stdout:0/418: dread d7/d55/d1f/d28/f59 [0,4194304] 0 2023-10-21T17:11:09.018 INFO:tasks.workunit.client.0.smithi012.stdout:0/419: dread - d7/f98 zero size 2023-10-21T17:11:09.074 INFO:tasks.workunit.client.0.smithi012.stdout:0/420: dwrite f6 [0,4194304] 0 2023-10-21T17:11:09.289 INFO:tasks.workunit.client.0.smithi012.stdout:7/434: dread d3/d6/dc/d19/d43/f4e [0,4194304] 0 2023-10-21T17:11:09.506 INFO:tasks.workunit.client.0.smithi012.stdout:2/440: mknod d1/d4/d65/c9b 0 2023-10-21T17:11:09.507 INFO:tasks.workunit.client.0.smithi012.stdout:2/441: getdents d1/d95 0 2023-10-21T17:11:09.507 INFO:tasks.workunit.client.0.smithi012.stdout:2/442: write d1/d14/d16/d22/f39 [86235,42537] 0 2023-10-21T17:11:09.588 INFO:tasks.workunit.client.0.smithi012.stdout:3/339: symlink d0/d32/d43/l65 0 2023-10-21T17:11:09.696 INFO:tasks.workunit.client.0.smithi012.stdout:4/395: rename dc/d15/d18/d4c/d55/d6c/c7b to dc/d1e/d33/c88 0 2023-10-21T17:11:10.166 INFO:tasks.workunit.client.0.smithi012.stdout:0/421: mknod d7/d81/c9d 0 2023-10-21T17:11:10.228 INFO:tasks.workunit.client.0.smithi012.stdout:0/422: dwrite d7/d55/f22 [0,4194304] 0 2023-10-21T17:11:10.290 INFO:tasks.workunit.client.0.smithi012.stdout:0/423: dwrite d7/d55/d23/d66/d48/f61 [0,4194304] 0 2023-10-21T17:11:10.291 INFO:tasks.workunit.client.0.smithi012.stdout:0/424: chown d7/d55/d23/d27/d31/d3d/l3f 3 1 2023-10-21T17:11:10.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/340: symlink d0/d32/d43/d47/l66 0 2023-10-21T17:11:10.666 INFO:tasks.workunit.client.0.smithi012.stdout:4/396: symlink dc/d15/d2a/d31/l89 0 2023-10-21T17:11:10.666 INFO:tasks.workunit.client.0.smithi012.stdout:4/397: chown dc/d15/d18/d57/f61 7788 1 2023-10-21T17:11:11.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/425: mknod d7/d55/d1f/d28/d9b/d8a/c9e 0 2023-10-21T17:11:11.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/341: truncate d0/da/f3d 934081 0 2023-10-21T17:11:11.491 INFO:tasks.workunit.client.0.smithi012.stdout:4/398: mkdir dc/d1e/d33/d8a 0 2023-10-21T17:11:11.506 INFO:tasks.workunit.client.0.smithi012.stdout:8/343: write d0/f36 [325947,55807] 0 2023-10-21T17:11:12.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/344: truncate d0/d12/d51/f58 784861 0 2023-10-21T17:11:12.462 INFO:tasks.workunit.client.0.smithi012.stdout:4/399: getdents dc/d15/d18/d4c/d55/d6c/d83 0 2023-10-21T17:11:12.581 INFO:tasks.workunit.client.0.smithi012.stdout:8/345: symlink d0/d12/l7b 0 2023-10-21T17:11:12.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/400: mknod dc/d15/d18/d4c/d55/d6c/d77/c8b 0 2023-10-21T17:11:13.776 INFO:tasks.workunit.client.0.smithi012.stdout:1/421: creat d5/f8d x:0 0 0 2023-10-21T17:11:13.777 INFO:tasks.workunit.client.0.smithi012.stdout:4/401: mknod dc/d1e/c8c 0 2023-10-21T17:11:13.777 INFO:tasks.workunit.client.0.smithi012.stdout:1/422: write d5/d32/d1b/d2c/d48/f6c [952403,18954] 0 2023-10-21T17:11:13.780 INFO:tasks.workunit.client.0.smithi012.stdout:1/423: fdatasync d5/d32/d1b/d2c/d48/f6c 0 2023-10-21T17:11:13.780 INFO:tasks.workunit.client.0.smithi012.stdout:1/424: chown d5/d32/l2a 452354769 1 2023-10-21T17:11:14.148 INFO:tasks.workunit.client.0.smithi012.stdout:8/346: truncate d0/f4c 358935 0 2023-10-21T17:11:14.161 INFO:tasks.workunit.client.0.smithi012.stdout:8/347: dread d0/d1a/f1d [0,4194304] 0 2023-10-21T17:11:14.250 INFO:tasks.workunit.client.0.smithi012.stdout:4/402: link dc/d15/d2a/d31/c6d dc/d15/d2a/c8d 0 2023-10-21T17:11:14.251 INFO:tasks.workunit.client.0.smithi012.stdout:4/403: readlink dc/d1e/d33/l35 0 2023-10-21T17:11:14.251 INFO:tasks.workunit.client.0.smithi012.stdout:4/404: stat dc/d15/c48 0 2023-10-21T17:11:14.584 INFO:tasks.workunit.client.0.smithi012.stdout:1/425: unlink d5/d32/d1b/d35/d3a/d5c/c44 0 2023-10-21T17:11:14.585 INFO:tasks.workunit.client.0.smithi012.stdout:1/426: readlink d5/d32/d62/l16 0 2023-10-21T17:11:14.585 INFO:tasks.workunit.client.0.smithi012.stdout:1/427: fdatasync d5/d30/d51/f73 0 2023-10-21T17:11:14.781 INFO:tasks.workunit.client.0.smithi012.stdout:8/348: creat d0/d12/d51/f7c x:0 0 0 2023-10-21T17:11:14.887 INFO:tasks.workunit.client.0.smithi012.stdout:8/349: dwrite d0/d62/f6b [0,4194304] 0 2023-10-21T17:11:15.433 INFO:tasks.workunit.client.0.smithi012.stdout:0/426: truncate d7/d55/d23/d66/d48/f61 551881 0 2023-10-21T17:11:15.433 INFO:tasks.workunit.client.0.smithi012.stdout:0/427: dread - d7/d52/f77 zero size 2023-10-21T17:11:15.552 INFO:tasks.workunit.client.0.smithi012.stdout:4/405: symlink dc/d1e/d65/l8e 0 2023-10-21T17:11:15.553 INFO:tasks.workunit.client.0.smithi012.stdout:4/406: write dc/d1e/d65/f66 [315612,121075] 0 2023-10-21T17:11:15.553 INFO:tasks.workunit.client.0.smithi012.stdout:4/407: chown l9 0 1 2023-10-21T17:11:15.553 INFO:tasks.workunit.client.0.smithi012.stdout:4/408: getdents dc/d1e/d33/d8a 0 2023-10-21T17:11:15.554 INFO:tasks.workunit.client.0.smithi012.stdout:4/409: write dc/d1e/f4b [298879,66080] 0 2023-10-21T17:11:15.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/428: mknod d5/d32/d1b/d2c/d4b/c8e 0 2023-10-21T17:11:16.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/428: truncate d7/f19 1436305 0 2023-10-21T17:11:16.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/371: sync 2023-10-21T17:11:16.258 INFO:tasks.workunit.client.0.smithi012.stdout:9/376: sync 2023-10-21T17:11:16.258 INFO:tasks.workunit.client.0.smithi012.stdout:5/369: sync 2023-10-21T17:11:16.356 INFO:tasks.workunit.client.0.smithi012.stdout:6/372: dwrite d13/f47 [0,4194304] 0 2023-10-21T17:11:16.486 INFO:tasks.workunit.client.0.smithi012.stdout:4/410: creat dc/d15/d18/d4c/d55/d6c/d77/f8f x:0 0 0 2023-10-21T17:11:16.487 INFO:tasks.workunit.client.0.smithi012.stdout:4/411: creat dc/d15/d18/d4c/d55/f90 x:0 0 0 2023-10-21T17:11:16.549 INFO:tasks.workunit.client.0.smithi012.stdout:4/412: dwrite dc/d15/d18/f71 [0,4194304] 0 2023-10-21T17:11:16.697 INFO:tasks.workunit.client.0.smithi012.stdout:1/429: mkdir d5/d26/d64/d8f 0 2023-10-21T17:11:16.935 INFO:tasks.workunit.client.0.smithi012.stdout:0/429: truncate d7/d55/d1f/f2e 4423878 0 2023-10-21T17:11:16.935 INFO:tasks.workunit.client.0.smithi012.stdout:0/430: write d7/d55/d23/d66/d48/f85 [483772,5611] 0 2023-10-21T17:11:16.970 INFO:tasks.workunit.client.0.smithi012.stdout:0/431: dread d7/d55/d23/d27/d31/f32 [0,4194304] 0 2023-10-21T17:11:18.018 INFO:tasks.workunit.client.0.smithi012.stdout:9/377: unlink d0/d4/d4b/d6a/c33 0 2023-10-21T17:11:18.018 INFO:tasks.workunit.client.0.smithi012.stdout:5/370: creat d2/d1d/d29/d57/f7d x:0 0 0 2023-10-21T17:11:18.019 INFO:tasks.workunit.client.0.smithi012.stdout:5/371: write d2/d4f/d59/d5b/f7c [3198,123177] 0 2023-10-21T17:11:18.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/413: rmdir dc/d15/d18 39 2023-10-21T17:11:18.053 INFO:tasks.workunit.client.0.smithi012.stdout:9/378: dread d0/d4/d4b/d6a/d12/d25/d39/d3b/f6f [0,4194304] 0 2023-10-21T17:11:18.085 INFO:tasks.workunit.client.0.smithi012.stdout:9/379: write d0/d4/d4b/d6a/d12/f55 [2914311,26310] 0 2023-10-21T17:11:18.086 INFO:tasks.workunit.client.0.smithi012.stdout:9/380: write d0/df/f43 [4919297,84304] 0 2023-10-21T17:11:18.120 INFO:tasks.workunit.client.0.smithi012.stdout:7/435: rename d3/d16/c4a to d3/d6/dc/c80 0 2023-10-21T17:11:18.120 INFO:tasks.workunit.client.0.smithi012.stdout:7/436: write d3/d6/dc/d19/f57 [1455162,70739] 0 2023-10-21T17:11:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:8/350: dwrite d0/f26 [0,4194304] 0 2023-10-21T17:11:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:8/351: truncate d0/f35 5060302 0 2023-10-21T17:11:18.254 INFO:tasks.workunit.client.0.smithi012.stdout:8/352: dwrite d0/f32 [0,4194304] 0 2023-10-21T17:11:18.310 INFO:tasks.workunit.client.0.smithi012.stdout:0/432: symlink d7/d55/d23/d66/d82/l9f 0 2023-10-21T17:11:18.391 INFO:tasks.workunit.client.0.smithi012.stdout:5/372: mkdir d2/d4f/d7e 0 2023-10-21T17:11:18.392 INFO:tasks.workunit.client.0.smithi012.stdout:5/373: chown d2/d2c/d73/f60 5536 1 2023-10-21T17:11:19.491 INFO:tasks.workunit.client.0.smithi012.stdout:1/430: write d5/d32/d1b/d35/f3f [1228813,130323] 0 2023-10-21T17:11:19.492 INFO:tasks.workunit.client.0.smithi012.stdout:1/431: creat d5/d32/d1b/d2c/d4b/f90 x:0 0 0 2023-10-21T17:11:19.492 INFO:tasks.workunit.client.0.smithi012.stdout:1/432: truncate d5/f14 834561 0 2023-10-21T17:11:20.263 INFO:tasks.workunit.client.0.smithi012.stdout:4/414: mkdir dc/d1e/d91 0 2023-10-21T17:11:21.066 INFO:tasks.workunit.client.0.smithi012.stdout:0/433: creat d7/d55/d23/d30/d8c/fa0 x:0 0 0 2023-10-21T17:11:21.237 INFO:tasks.workunit.client.0.smithi012.stdout:9/381: dwrite d0/d4/d4b/f50 [0,4194304] 0 2023-10-21T17:11:21.260 INFO:tasks.workunit.client.0.smithi012.stdout:9/382: dread d0/df/f43 [0,4194304] 0 2023-10-21T17:11:21.360 INFO:tasks.workunit.client.0.smithi012.stdout:9/383: dwrite d0/d4/d4b/d6a/d12/f55 [0,4194304] 0 2023-10-21T17:11:21.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/443: rename d1/d14/f47 to d1/d8/d19/d50/f9c 0 2023-10-21T17:11:21.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/444: getdents d1/d14/d16/d22/d82/d86 0 2023-10-21T17:11:21.418 INFO:tasks.workunit.client.0.smithi012.stdout:9/384: dwrite d0/d4/d4b/d6a/d12/d2a/d36/f3c [0,4194304] 0 2023-10-21T17:11:21.418 INFO:tasks.workunit.client.0.smithi012.stdout:9/385: creat d0/d5/f7e x:0 0 0 2023-10-21T17:11:21.707 INFO:tasks.workunit.client.0.smithi012.stdout:1/433: mknod d5/d32/d1b/d35/d3a/d5c/d7c/c91 0 2023-10-21T17:11:21.773 INFO:tasks.workunit.client.0.smithi012.stdout:1/434: dwrite d5/d32/d1b/d2c/d48/f74 [0,4194304] 0 2023-10-21T17:11:21.930 INFO:tasks.workunit.client.0.smithi012.stdout:0/434: mkdir d7/d55/d23/d27/da1 0 2023-10-21T17:11:21.956 INFO:tasks.workunit.client.0.smithi012.stdout:0/435: write d7/d55/d1f/d28/f34 [3375377,128098] 0 2023-10-21T17:11:22.395 INFO:tasks.workunit.client.0.smithi012.stdout:3/342: rename d0/d1c/c22 to d0/d32/d43/c67 0 2023-10-21T17:11:22.396 INFO:tasks.workunit.client.0.smithi012.stdout:3/343: stat d0/da/f34 0 2023-10-21T17:11:22.396 INFO:tasks.workunit.client.0.smithi012.stdout:3/344: chown d0/d32/d43/d47/d50/d52/f5d 49592013 1 2023-10-21T17:11:22.476 INFO:tasks.workunit.client.0.smithi012.stdout:2/445: rmdir d1/d4/d3f 39 2023-10-21T17:11:22.476 INFO:tasks.workunit.client.0.smithi012.stdout:2/446: write d1/d8/f51 [150646,5601] 0 2023-10-21T17:11:22.891 INFO:tasks.workunit.client.0.smithi012.stdout:9/386: creat d0/d4/d4b/d6a/d12/d2a/f7f x:0 0 0 2023-10-21T17:11:23.191 INFO:tasks.workunit.client.0.smithi012.stdout:1/435: link d5/d32/d1b/d2c/c75 d5/d32/d1b/d2c/d4b/c92 0 2023-10-21T17:11:23.191 INFO:tasks.workunit.client.0.smithi012.stdout:1/436: chown d5/d32/d62/f82 6 1 2023-10-21T17:11:23.192 INFO:tasks.workunit.client.0.smithi012.stdout:1/437: write d5/d32/d1b/d35/d49/f7b [554107,79714] 0 2023-10-21T17:11:23.192 INFO:tasks.workunit.client.0.smithi012.stdout:1/438: chown d5/d32/d1b/d35 39911325 1 2023-10-21T17:11:23.285 INFO:tasks.workunit.client.0.smithi012.stdout:4/415: rmdir dc/d15/d2a/d31 39 2023-10-21T17:11:23.560 INFO:tasks.workunit.client.0.smithi012.stdout:0/436: getdents d7/d55/d1f/d28/d9b 0 2023-10-21T17:11:23.560 INFO:tasks.workunit.client.0.smithi012.stdout:0/437: stat d7/d55/d23/d27/d31/d3d/f6e 0 2023-10-21T17:11:23.890 INFO:tasks.workunit.client.0.smithi012.stdout:6/373: rename d13/d29/d37/d3b/f58 to d13/d42/d71/f7d 0 2023-10-21T17:11:24.152 INFO:tasks.workunit.client.0.smithi012.stdout:8/353: write d0/d12/d40/d4a/d4e/f55 [1444975,110890] 0 2023-10-21T17:11:24.154 INFO:tasks.workunit.client.0.smithi012.stdout:7/437: sync 2023-10-21T17:11:24.155 INFO:tasks.workunit.client.0.smithi012.stdout:7/438: readlink d3/d6/la 0 2023-10-21T17:11:24.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/387: symlink d0/d4/d4b/d6a/d12/d2a/d36/l80 0 2023-10-21T17:11:24.936 INFO:tasks.workunit.client.0.smithi012.stdout:1/439: mkdir d5/d32/d1b/d35/d3a/d93 0 2023-10-21T17:11:24.936 INFO:tasks.workunit.client.0.smithi012.stdout:1/440: dread - d5/d32/d1b/d35/d3a/d5c/f5a zero size 2023-10-21T17:11:25.069 INFO:tasks.workunit.client.0.smithi012.stdout:4/416: creat dc/d15/d2a/d58/f92 x:0 0 0 2023-10-21T17:11:26.044 INFO:tasks.workunit.client.0.smithi012.stdout:5/374: rename d2/d1d/f4a to d2/d1d/d29/d57/d66/f7f 0 2023-10-21T17:11:26.246 INFO:tasks.workunit.client.0.smithi012.stdout:6/374: truncate f10 721928 0 2023-10-21T17:11:26.246 INFO:tasks.workunit.client.0.smithi012.stdout:6/375: truncate d13/d15/d1d/d5d/d66/f79 27483 0 2023-10-21T17:11:26.628 INFO:tasks.workunit.client.0.smithi012.stdout:7/439: truncate d3/d16/f50 1402266 0 2023-10-21T17:11:26.629 INFO:tasks.workunit.client.0.smithi012.stdout:4/417: getdents dc/d15/d18/d57 0 2023-10-21T17:11:26.629 INFO:tasks.workunit.client.0.smithi012.stdout:4/418: chown dc/d28/l70 1863 1 2023-10-21T17:11:26.680 INFO:tasks.workunit.client.0.smithi012.stdout:0/438: mkdir d7/d55/da2 0 2023-10-21T17:11:26.746 INFO:tasks.workunit.client.0.smithi012.stdout:4/419: dwrite dc/d15/f47 [0,4194304] 0 2023-10-21T17:11:26.842 INFO:tasks.workunit.client.0.smithi012.stdout:4/420: dwrite dc/d15/f5e [0,4194304] 0 2023-10-21T17:11:26.843 INFO:tasks.workunit.client.0.smithi012.stdout:4/421: dread - dc/d1e/f85 zero size 2023-10-21T17:11:26.861 INFO:tasks.workunit.client.0.smithi012.stdout:5/375: fdatasync d2/d1d/d4e/f78 0 2023-10-21T17:11:26.874 INFO:tasks.workunit.client.0.smithi012.stdout:2/447: sync 2023-10-21T17:11:27.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/376: creat d13/d42/f7e x:0 0 0 2023-10-21T17:11:27.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/377: dwrite d13/d15/f33 [0,4194304] 0 2023-10-21T17:11:27.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/378: fdatasync d13/f47 0 2023-10-21T17:11:27.192 INFO:tasks.workunit.client.0.smithi012.stdout:6/379: write d13/d35/f3a [1767435,127764] 0 2023-10-21T17:11:27.212 INFO:tasks.workunit.client.0.smithi012.stdout:9/388: getdents d0/d5 0 2023-10-21T17:11:27.341 INFO:tasks.workunit.client.0.smithi012.stdout:7/440: getdents d3 0 2023-10-21T17:11:27.582 INFO:tasks.workunit.client.0.smithi012.stdout:0/439: mknod d7/d55/d23/d30/d8c/ca3 0 2023-10-21T17:11:27.686 INFO:tasks.workunit.client.0.smithi012.stdout:3/345: mknod d0/c68 0 2023-10-21T17:11:28.094 INFO:tasks.workunit.client.0.smithi012.stdout:5/376: dwrite d2/d1d/d29/f6b [0,4194304] 0 2023-10-21T17:11:28.094 INFO:tasks.workunit.client.0.smithi012.stdout:5/377: truncate d2/d2c/f7a 656964 0 2023-10-21T17:11:28.095 INFO:tasks.workunit.client.0.smithi012.stdout:5/378: creat d2/d2c/f80 x:0 0 0 2023-10-21T17:11:28.170 INFO:tasks.workunit.client.0.smithi012.stdout:5/379: dwrite d2/d1d/d4e/f78 [0,4194304] 0 2023-10-21T17:11:28.270 INFO:tasks.workunit.client.0.smithi012.stdout:2/448: dread - d1/d4/d3f/d41/d59/f62 zero size 2023-10-21T17:11:28.353 INFO:tasks.workunit.client.0.smithi012.stdout:2/449: dwrite d1/d14/d16/d20/f2e [0,4194304] 0 2023-10-21T17:11:28.353 INFO:tasks.workunit.client.0.smithi012.stdout:2/450: fdatasync d1/d14/d17/f73 0 2023-10-21T17:11:28.567 INFO:tasks.workunit.client.0.smithi012.stdout:6/380: unlink d13/d15/f23 0 2023-10-21T17:11:28.567 INFO:tasks.workunit.client.0.smithi012.stdout:9/389: creat d0/d4/d4b/d6a/d12/d25/d39/d3b/f81 x:0 0 0 2023-10-21T17:11:28.630 INFO:tasks.workunit.client.0.smithi012.stdout:7/441: creat d3/d6/f81 x:0 0 0 2023-10-21T17:11:28.823 INFO:tasks.workunit.client.0.smithi012.stdout:0/440: getdents d7/d55/d23/d27/d31/d3d 0 2023-10-21T17:11:28.823 INFO:tasks.workunit.client.0.smithi012.stdout:0/441: chown d7/d55/d23/d27/d40/f87 239256 1 2023-10-21T17:11:29.243 INFO:tasks.workunit.client.0.smithi012.stdout:3/346: unlink d0/da/d28/c2f 0 2023-10-21T17:11:29.729 INFO:tasks.workunit.client.0.smithi012.stdout:8/354: dwrite d0/d12/f31 [0,4194304] 0 2023-10-21T17:11:29.729 INFO:tasks.workunit.client.0.smithi012.stdout:8/355: chown d0/d62 41012748 1 2023-10-21T17:11:29.729 INFO:tasks.workunit.client.0.smithi012.stdout:8/356: getdents d0/d12/d40/d4a/d5b/d71 0 2023-10-21T17:11:29.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/357: dwrite d0/d1a/d54/f5f [0,4194304] 0 2023-10-21T17:11:29.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/358: getdents d0/d12/d40/d4a/d5b/d71 0 2023-10-21T17:11:29.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/359: write d0/d12/d40/d4a/d5b/f67 [220271,440] 0 2023-10-21T17:11:30.126 INFO:tasks.workunit.client.0.smithi012.stdout:2/451: symlink d1/d14/d17/l9d 0 2023-10-21T17:11:30.127 INFO:tasks.workunit.client.0.smithi012.stdout:2/452: stat d1/d8/d25/l43 0 2023-10-21T17:11:30.154 INFO:tasks.workunit.client.0.smithi012.stdout:2/453: read d1/f9 [2505717,4839] 0 2023-10-21T17:11:30.154 INFO:tasks.workunit.client.0.smithi012.stdout:2/454: write d1/d4/f5 [381449,36897] 0 2023-10-21T17:11:30.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/381: fdatasync d13/d15/d1d/d24/f45 0 2023-10-21T17:11:30.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/382: fsync f6 0 2023-10-21T17:11:30.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/383: chown d13/d15/f27 1460 1 2023-10-21T17:11:30.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/442: readlink d3/d6/dc/d19/d43/l60 0 2023-10-21T17:11:30.793 INFO:tasks.workunit.client.0.smithi012.stdout:9/390: symlink d0/d4/l82 0 2023-10-21T17:11:30.852 INFO:tasks.workunit.client.0.smithi012.stdout:9/391: dwrite d0/df/f63 [0,4194304] 0 2023-10-21T17:11:30.852 INFO:tasks.workunit.client.0.smithi012.stdout:9/392: chown d0/d4/d4b/d6a/d12/d2a 43 1 2023-10-21T17:11:30.892 INFO:tasks.workunit.client.0.smithi012.stdout:9/393: dread d0/df/f63 [0,4194304] 0 2023-10-21T17:11:30.893 INFO:tasks.workunit.client.0.smithi012.stdout:9/394: stat d0/d4/d4b/d6a/d12/d25/d2f/f65 0 2023-10-21T17:11:30.893 INFO:tasks.workunit.client.0.smithi012.stdout:9/395: dread - d0/d4/d4b/d6a/d12/d25/d39/d3b/f81 zero size 2023-10-21T17:11:31.162 INFO:tasks.workunit.client.0.smithi012.stdout:1/441: sync 2023-10-21T17:11:31.543 INFO:tasks.workunit.client.0.smithi012.stdout:5/380: getdents d2/d2c/d73/d49 0 2023-10-21T17:11:31.676 INFO:tasks.workunit.client.0.smithi012.stdout:2/455: creat d1/d95/f9e x:0 0 0 2023-10-21T17:11:31.743 INFO:tasks.workunit.client.0.smithi012.stdout:6/384: truncate d13/f47 3453120 0 2023-10-21T17:11:31.765 INFO:tasks.workunit.client.0.smithi012.stdout:2/456: dwrite d1/d14/d16/d20/f2e [4194304,4194304] 0 2023-10-21T17:11:32.316 INFO:tasks.workunit.client.0.smithi012.stdout:4/422: rename dc/d15/d2a/d31/d36 to dc/d93 0 2023-10-21T17:11:32.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/423: dwrite dc/d93/f46 [0,4194304] 0 2023-10-21T17:11:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:4/424: dread dc/f42 [0,4194304] 0 2023-10-21T17:11:32.464 INFO:tasks.workunit.client.0.smithi012.stdout:1/442: unlink d5/d32/d1b/d35/d3a/d5c/f5a 0 2023-10-21T17:11:32.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/381: link d2/d6/f54 d2/d1d/d29/d57/d66/f81 0 2023-10-21T17:11:32.756 INFO:tasks.workunit.client.0.smithi012.stdout:5/382: dwrite d2/d4f/f6e [0,4194304] 0 2023-10-21T17:11:33.109 INFO:tasks.workunit.client.0.smithi012.stdout:6/385: mknod d13/d15/c7f 0 2023-10-21T17:11:33.110 INFO:tasks.workunit.client.0.smithi012.stdout:6/386: chown d13/d35/l55 426427 1 2023-10-21T17:11:33.110 INFO:tasks.workunit.client.0.smithi012.stdout:6/387: creat d13/d15/d1d/d28/f80 x:0 0 0 2023-10-21T17:11:33.200 INFO:tasks.workunit.client.0.smithi012.stdout:6/388: dwrite d13/d29/d37/f44 [0,4194304] 0 2023-10-21T17:11:33.314 INFO:tasks.workunit.client.0.smithi012.stdout:2/457: unlink d1/d8/d25/f94 0 2023-10-21T17:11:33.407 INFO:tasks.workunit.client.0.smithi012.stdout:2/458: dwrite d1/d14/d17/f98 [0,4194304] 0 2023-10-21T17:11:33.665 INFO:tasks.workunit.client.0.smithi012.stdout:4/425: creat dc/d1e/d91/f94 x:0 0 0 2023-10-21T17:11:33.703 INFO:tasks.workunit.client.0.smithi012.stdout:4/426: dread dc/f3b [0,4194304] 0 2023-10-21T17:11:33.733 INFO:tasks.workunit.client.0.smithi012.stdout:4/427: dread dc/d15/f32 [0,4194304] 0 2023-10-21T17:11:33.733 INFO:tasks.workunit.client.0.smithi012.stdout:4/428: read dc/d1e/d33/f43 [2401523,3323] 0 2023-10-21T17:11:33.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/443: rmdir d5/d32/d1b/d2c 39 2023-10-21T17:11:33.766 INFO:tasks.workunit.client.0.smithi012.stdout:4/429: dread dc/d93/f46 [0,4194304] 0 2023-10-21T17:11:34.065 INFO:tasks.workunit.client.0.smithi012.stdout:5/383: symlink d2/d4f/d59/d5b/d1e/l82 0 2023-10-21T17:11:34.369 INFO:tasks.workunit.client.0.smithi012.stdout:7/443: rmdir d3/d29 39 2023-10-21T17:11:34.805 INFO:tasks.workunit.client.0.smithi012.stdout:6/389: mknod d13/d42/c81 0 2023-10-21T17:11:34.874 INFO:tasks.workunit.client.0.smithi012.stdout:0/442: dwrite d7/d55/d23/d27/d31/f3c [0,4194304] 0 2023-10-21T17:11:35.032 INFO:tasks.workunit.client.0.smithi012.stdout:3/347: write d0/fd [2508383,62569] 0 2023-10-21T17:11:35.127 INFO:tasks.workunit.client.0.smithi012.stdout:2/459: creat d1/d14/d17/d8a/f9f x:0 0 0 2023-10-21T17:11:35.233 INFO:tasks.workunit.client.0.smithi012.stdout:2/460: dwrite d1/d14/d17/f1f [4194304,4194304] 0 2023-10-21T17:11:35.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:11:35.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:11:35.648 INFO:tasks.workunit.client.0.smithi012.stdout:1/444: rename d5/d32/d1b/d27/d1a/d46/f4d to d5/d32/d1b/d2c/d4b/f94 0 2023-10-21T17:11:35.648 INFO:tasks.workunit.client.0.smithi012.stdout:4/430: mknod dc/d1e/d33/c95 0 2023-10-21T17:11:35.661 INFO:tasks.workunit.client.0.smithi012.stdout:1/445: dread d5/d30/f67 [0,4194304] 0 2023-10-21T17:11:35.661 INFO:tasks.workunit.client.0.smithi012.stdout:1/446: write d5/d32/d1b/d35/d3a/d5c/f85 [228227,112488] 0 2023-10-21T17:11:35.952 INFO:tasks.workunit.client.0.smithi012.stdout:8/360: dwrite d0/fe [0,4194304] 0 2023-10-21T17:11:35.969 INFO:tasks.workunit.client.0.smithi012.stdout:8/361: write d0/d12/d40/d4a/d4e/f55 [303931,68237] 0 2023-10-21T17:11:36.014 INFO:tasks.workunit.client.0.smithi012.stdout:5/384: unlink d2/d4f/d59/d5b/f6d 0 2023-10-21T17:11:36.544 INFO:tasks.workunit.client.0.smithi012.stdout:6/390: dread d13/d15/f2b [0,4194304] 0 2023-10-21T17:11:36.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/391: write d13/f47 [1563173,28749] 0 2023-10-21T17:11:36.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/392: chown f10 80043 1 2023-10-21T17:11:36.970 INFO:tasks.workunit.client.0.smithi012.stdout:3/348: read d0/da/f3d [863174,96309] 0 2023-10-21T17:11:37.157 INFO:tasks.workunit.client.0.smithi012.stdout:0/443: rename d7/d55/d1f/d28/c9c to d7/d55/d23/d27/ca4 0 2023-10-21T17:11:37.157 INFO:tasks.workunit.client.0.smithi012.stdout:0/444: stat d7/d55/d23/d27/d31/d5f 0 2023-10-21T17:11:37.158 INFO:tasks.workunit.client.0.smithi012.stdout:0/445: chown d7/d55/d23/d27/d31/d5f 1545127 1 2023-10-21T17:11:37.158 INFO:tasks.workunit.client.0.smithi012.stdout:0/446: write d7/d55/ff [4638372,90090] 0 2023-10-21T17:11:37.158 INFO:tasks.workunit.client.0.smithi012.stdout:0/447: stat d7/d55/d1f/d28/d9b/f6c 0 2023-10-21T17:11:37.179 INFO:tasks.workunit.client.0.smithi012.stdout:0/448: write d7/d55/f22 [605077,6181] 0 2023-10-21T17:11:37.181 INFO:tasks.workunit.client.0.smithi012.stdout:0/449: read d7/d55/d23/d27/d31/f3e [51970,95953] 0 2023-10-21T17:11:37.276 INFO:tasks.workunit.client.0.smithi012.stdout:4/431: dread f8 [0,4194304] 0 2023-10-21T17:11:37.277 INFO:tasks.workunit.client.0.smithi012.stdout:4/432: creat dc/d15/d18/d4c/d55/d6c/d77/f96 x:0 0 0 2023-10-21T17:11:37.449 INFO:tasks.workunit.client.0.smithi012.stdout:1/447: mkdir d5/d61/d95 0 2023-10-21T17:11:37.719 INFO:tasks.workunit.client.0.smithi012.stdout:8/362: mkdir d0/d62/d7d 0 2023-10-21T17:11:37.821 INFO:tasks.workunit.client.0.smithi012.stdout:5/385: dwrite d2/d1d/f56 [0,4194304] 0 2023-10-21T17:11:38.089 INFO:tasks.workunit.client.0.smithi012.stdout:2/461: rename d1/d8/f28 to d1/d14/d16/d22/d82/d86/fa0 0 2023-10-21T17:11:38.091 INFO:tasks.workunit.client.0.smithi012.stdout:2/462: read d1/d8/f51 [93247,87698] 0 2023-10-21T17:11:38.122 INFO:tasks.workunit.client.0.smithi012.stdout:2/463: dread d1/d14/d16/d20/f2e [0,4194304] 0 2023-10-21T17:11:38.996 INFO:tasks.workunit.client.0.smithi012.stdout:1/448: creat d5/d32/d1b/d35/d3a/d5c/d7c/f96 x:0 0 0 2023-10-21T17:11:39.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/363: dread d0/d12/f22 [0,4194304] 0 2023-10-21T17:11:39.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/393: rename d13/d42/f7e to d13/d35/d4c/f82 0 2023-10-21T17:11:39.148 INFO:tasks.workunit.client.0.smithi012.stdout:1/449: symlink d5/d26/d54/l97 0 2023-10-21T17:11:39.184 INFO:tasks.workunit.client.0.smithi012.stdout:6/394: write d13/d29/d37/f44 [602995,91132] 0 2023-10-21T17:11:39.624 INFO:tasks.workunit.client.0.smithi012.stdout:0/450: rename d7/d52/d53/f97 to d7/d55/d23/d66/d48/fa5 0 2023-10-21T17:11:39.737 INFO:tasks.workunit.client.0.smithi012.stdout:0/451: dwrite d7/d55/d23/d66/d48/fa5 [0,4194304] 0 2023-10-21T17:11:39.777 INFO:tasks.workunit.client.0.smithi012.stdout:0/452: dread d7/d55/ff [0,4194304] 0 2023-10-21T17:11:39.777 INFO:tasks.workunit.client.0.smithi012.stdout:0/453: write d7/f36 [489574,44953] 0 2023-10-21T17:11:39.875 INFO:tasks.workunit.client.0.smithi012.stdout:1/450: truncate d5/d32/f17 665720 0 2023-10-21T17:11:40.048 INFO:tasks.workunit.client.0.smithi012.stdout:6/395: dread d13/d29/f5f [0,4194304] 0 2023-10-21T17:11:40.049 INFO:tasks.workunit.client.0.smithi012.stdout:6/396: write d13/d15/d1d/d28/f7c [337808,95405] 0 2023-10-21T17:11:40.577 INFO:tasks.workunit.client.0.smithi012.stdout:0/454: link d7/d55/d23/d27/d31/d3d/c29 d7/d55/d23/d66/d48/ca6 0 2023-10-21T17:11:40.865 INFO:tasks.workunit.client.0.smithi012.stdout:9/396: unlink d0/d4/d4b/d6a/d12/f58 0 2023-10-21T17:11:41.233 INFO:tasks.workunit.client.0.smithi012.stdout:1/451: symlink d5/d26/l98 0 2023-10-21T17:11:41.337 INFO:tasks.workunit.client.0.smithi012.stdout:6/397: creat d13/d64/d6d/f83 x:0 0 0 2023-10-21T17:11:41.899 INFO:tasks.workunit.client.0.smithi012.stdout:0/455: creat d7/d55/d23/d27/d31/d5f/fa7 x:0 0 0 2023-10-21T17:11:42.002 INFO:tasks.workunit.client.0.smithi012.stdout:3/349: write d0/d32/f4e [6443173,36655] 0 2023-10-21T17:11:42.241 INFO:tasks.workunit.client.0.smithi012.stdout:1/452: rename d5/d32/d62/fe to d5/d32/d1b/d27/d86/f99 0 2023-10-21T17:11:42.242 INFO:tasks.workunit.client.0.smithi012.stdout:6/398: creat d13/d42/f84 x:0 0 0 2023-10-21T17:11:42.593 INFO:tasks.workunit.client.0.smithi012.stdout:0/456: mkdir d7/d55/d23/d66/da8 0 2023-10-21T17:11:42.780 INFO:tasks.workunit.client.0.smithi012.stdout:3/350: truncate d0/fd 2169219 0 2023-10-21T17:11:42.873 INFO:tasks.workunit.client.0.smithi012.stdout:1/453: read d5/d32/d1b/d27/d86/f7a [810948,109650] 0 2023-10-21T17:11:42.873 INFO:tasks.workunit.client.0.smithi012.stdout:1/454: stat d5/d30 0 2023-10-21T17:11:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:0/457: unlink d7/d55/d23/d66/d48/f85 0 2023-10-21T17:11:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:0/458: chown d7/c33 247697194 1 2023-10-21T17:11:43.472 INFO:tasks.workunit.client.0.smithi012.stdout:2/464: truncate d1/d14/d16/d20/f2e 6793472 0 2023-10-21T17:11:43.472 INFO:tasks.workunit.client.0.smithi012.stdout:3/351: symlink d0/d32/d43/d47/d50/l69 0 2023-10-21T17:11:43.472 INFO:tasks.workunit.client.0.smithi012.stdout:2/465: readlink d1/d4/l5e 0 2023-10-21T17:11:43.473 INFO:tasks.workunit.client.0.smithi012.stdout:2/466: creat d1/d8/d19/d34/fa1 x:0 0 0 2023-10-21T17:11:43.473 INFO:tasks.workunit.client.0.smithi012.stdout:2/467: creat d1/d95/fa2 x:0 0 0 2023-10-21T17:11:43.491 INFO:tasks.workunit.client.0.smithi012.stdout:3/352: dread d0/d32/d43/f45 [0,4194304] 0 2023-10-21T17:11:43.491 INFO:tasks.workunit.client.0.smithi012.stdout:3/353: creat d0/d1c/f6a x:0 0 0 2023-10-21T17:11:43.506 INFO:tasks.workunit.client.0.smithi012.stdout:1/455: creat d5/d32/d62/f9a x:0 0 0 2023-10-21T17:11:43.574 INFO:tasks.workunit.client.0.smithi012.stdout:3/354: dwrite d0/d32/d43/d47/d50/d52/f5d [0,4194304] 0 2023-10-21T17:11:43.575 INFO:tasks.workunit.client.0.smithi012.stdout:3/355: write d0/d1c/f6a [893568,70396] 0 2023-10-21T17:11:43.579 INFO:tasks.workunit.client.0.smithi012.stdout:3/356: write d0/d32/d43/f45 [614055,70985] 0 2023-10-21T17:11:43.606 INFO:tasks.workunit.client.0.smithi012.stdout:3/357: write d0/f5 [3303920,49258] 0 2023-10-21T17:11:43.606 INFO:tasks.workunit.client.0.smithi012.stdout:3/358: chown d0/da/d28/c56 6 1 2023-10-21T17:11:43.630 INFO:tasks.workunit.client.0.smithi012.stdout:0/459: mkdir d7/d55/d23/d66/da9 0 2023-10-21T17:11:43.630 INFO:tasks.workunit.client.0.smithi012.stdout:0/460: write d7/d55/f8b [821377,31824] 0 2023-10-21T17:11:43.692 INFO:tasks.workunit.client.0.smithi012.stdout:3/359: dwrite d0/d1c/f60 [0,4194304] 0 2023-10-21T17:11:44.010 INFO:tasks.workunit.client.0.smithi012.stdout:2/468: mkdir d1/d8/d19/d50/da3 0 2023-10-21T17:11:44.010 INFO:tasks.workunit.client.0.smithi012.stdout:2/469: dread - d1/d8/d19/d50/f54 zero size 2023-10-21T17:11:44.011 INFO:tasks.workunit.client.0.smithi012.stdout:2/470: creat d1/d8/d19/d34/fa4 x:0 0 0 2023-10-21T17:11:44.027 INFO:tasks.workunit.client.0.smithi012.stdout:2/471: dread d1/d8/d19/d50/f7a [0,4194304] 0 2023-10-21T17:11:44.057 INFO:tasks.workunit.client.0.smithi012.stdout:2/472: dread d1/d8/d19/d50/f79 [0,4194304] 0 2023-10-21T17:11:44.057 INFO:tasks.workunit.client.0.smithi012.stdout:2/473: chown d1/d8/l96 41011413 1 2023-10-21T17:11:44.115 INFO:tasks.workunit.client.0.smithi012.stdout:2/474: dwrite d1/d4/d3f/d41/d59/f62 [0,4194304] 0 2023-10-21T17:11:44.473 INFO:tasks.workunit.client.0.smithi012.stdout:0/461: symlink d7/d55/d23/d66/d82/d8d/laa 0 2023-10-21T17:11:44.594 INFO:tasks.workunit.client.0.smithi012.stdout:3/360: creat d0/d32/d43/f6b x:0 0 0 2023-10-21T17:11:45.315 INFO:tasks.workunit.client.0.smithi012.stdout:2/475: truncate d1/d14/d16/d22/d82/d86/fa0 292490 0 2023-10-21T17:11:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/433: sync 2023-10-21T17:11:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/444: sync 2023-10-21T17:11:45.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/434: stat dc/d1e/d33/c76 0 2023-10-21T17:11:45.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/445: chown d3/d6/dc/d19/d28/l42 16 1 2023-10-21T17:11:45.375 INFO:tasks.workunit.client.0.smithi012.stdout:4/435: truncate dc/d15/d18/d4c/d55/f90 123920 0 2023-10-21T17:11:45.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/446: dread d3/d16/f67 [0,4194304] 0 2023-10-21T17:11:45.416 INFO:tasks.workunit.client.0.smithi012.stdout:1/456: truncate d5/d26/f40 895843 0 2023-10-21T17:11:45.462 INFO:tasks.workunit.client.0.smithi012.stdout:4/436: dwrite dc/d15/f80 [0,4194304] 0 2023-10-21T17:11:45.527 INFO:tasks.workunit.client.0.smithi012.stdout:4/437: dwrite dc/d15/d18/d4c/d55/d6c/d83/f86 [0,4194304] 0 2023-10-21T17:11:45.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/462: symlink d7/d55/d23/d27/d31/d5f/lab 0 2023-10-21T17:11:45.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/463: stat d7/d55/d23/f8e 0 2023-10-21T17:11:45.740 INFO:tasks.workunit.client.0.smithi012.stdout:0/464: creat d7/d55/d23/d30/d8c/fac x:0 0 0 2023-10-21T17:11:45.740 INFO:tasks.workunit.client.0.smithi012.stdout:0/465: creat d7/d55/d23/d27/d31/d5f/fad x:0 0 0 2023-10-21T17:11:45.740 INFO:tasks.workunit.client.0.smithi012.stdout:0/466: fdatasync d7/d55/d1f/d28/d9b/f6f 0 2023-10-21T17:11:45.790 INFO:tasks.workunit.client.0.smithi012.stdout:9/397: unlink d0/d4/l61 0 2023-10-21T17:11:45.790 INFO:tasks.workunit.client.0.smithi012.stdout:3/361: unlink d0/da/d28/c4c 0 2023-10-21T17:11:46.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/447: symlink d3/d6/dc/d19/d1e/d34/l82 0 2023-10-21T17:11:46.648 INFO:tasks.workunit.client.0.smithi012.stdout:1/457: rename d5/d32/d1b/d35/d3a/d5c/d7c/f96 to d5/d32/d1b/d35/d49/d69/f9b 0 2023-10-21T17:11:46.745 INFO:tasks.workunit.client.0.smithi012.stdout:5/386: mkdir d2/d1d/d83 0 2023-10-21T17:11:47.609 INFO:tasks.workunit.client.0.smithi012.stdout:3/362: mknod d0/da/d28/c6c 0 2023-10-21T17:11:47.715 INFO:tasks.workunit.client.0.smithi012.stdout:9/398: mknod d0/d4/d4b/d6a/d12/d25/d2f/c83 0 2023-10-21T17:11:48.604 INFO:tasks.workunit.client.0.smithi012.stdout:2/476: dread d1/d14/d17/f1f [0,4194304] 0 2023-10-21T17:11:49.129 INFO:tasks.workunit.client.0.smithi012.stdout:5/387: truncate d2/d4f/d59/d5b/f67 136694 0 2023-10-21T17:11:49.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/388: chown d2/c55 11085 1 2023-10-21T17:11:49.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/389: readlink d2/d2c/d73/d49/l6f 0 2023-10-21T17:11:49.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/390: stat d2/d6/l38 0 2023-10-21T17:11:49.232 INFO:tasks.workunit.client.0.smithi012.stdout:4/438: rmdir dc/d15/d18/d4c/d55/d6c/d77 39 2023-10-21T17:11:49.600 INFO:tasks.workunit.client.0.smithi012.stdout:9/399: symlink d0/d4/d4b/d6a/l84 0 2023-10-21T17:11:49.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/400: chown d0/d4/d4b/d6a/d12/d25/f37 44516658 1 2023-10-21T17:11:49.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/401: truncate d0/d5/f32 792138 0 2023-10-21T17:11:50.248 INFO:tasks.workunit.client.0.smithi012.stdout:0/467: link d7/d55/d23/d66/d48/fa5 d7/d55/d23/d66/d63/fae 0 2023-10-21T17:11:50.939 INFO:tasks.workunit.client.0.smithi012.stdout:2/477: rename d1/d8/d19 to d1/d14/d16/d22/da5 0 2023-10-21T17:11:50.939 INFO:tasks.workunit.client.0.smithi012.stdout:2/478: readlink d1/l83 0 2023-10-21T17:11:50.957 INFO:tasks.workunit.client.0.smithi012.stdout:2/479: dread d1/fe [4194304,4194304] 0 2023-10-21T17:11:51.033 INFO:tasks.workunit.client.0.smithi012.stdout:2/480: dwrite d1/f1a [0,4194304] 0 2023-10-21T17:11:51.033 INFO:tasks.workunit.client.0.smithi012.stdout:2/481: truncate d1/d14/d16/d22/da5/d50/f68 563259 0 2023-10-21T17:11:51.377 INFO:tasks.workunit.client.0.smithi012.stdout:0/468: mknod d7/d55/d23/d66/d82/d8d/caf 0 2023-10-21T17:11:51.410 INFO:tasks.workunit.client.0.smithi012.stdout:6/399: rmdir d13/d29/d37 39 2023-10-21T17:11:51.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/400: read d13/d29/f5f [3115958,77825] 0 2023-10-21T17:11:51.750 INFO:tasks.workunit.client.0.smithi012.stdout:8/364: sync 2023-10-21T17:11:51.757 INFO:tasks.workunit.client.0.smithi012.stdout:8/365: dread d0/d12/f22 [0,4194304] 0 2023-10-21T17:11:51.777 INFO:tasks.workunit.client.0.smithi012.stdout:8/366: write d0/d1a/d54/f5f [1685095,25655] 0 2023-10-21T17:11:51.882 INFO:tasks.workunit.client.0.smithi012.stdout:2/482: getdents d1/d14/d16/d22/da5/d50 0 2023-10-21T17:11:51.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/483: dread d1/d8/ff [0,4194304] 0 2023-10-21T17:11:51.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/484: fdatasync d1/d14/d16/d22/da5/d34/f45 0 2023-10-21T17:11:51.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/485: stat d1/d14/d16/d22/da5/d34/f45 0 2023-10-21T17:11:51.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/486: chown d1/d8/c5a 0 1 2023-10-21T17:11:51.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/487: fsync d1/d14/d16/d20/f8c 0 2023-10-21T17:11:52.029 INFO:tasks.workunit.client.0.smithi012.stdout:0/469: rename d7/d55/d1f/f94 to d7/d55/d23/d66/d48/fb0 0 2023-10-21T17:11:52.252 INFO:tasks.workunit.client.0.smithi012.stdout:6/401: symlink d13/d15/l85 0 2023-10-21T17:11:52.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/402: write f6 [3992252,37424] 0 2023-10-21T17:11:52.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/403: fdatasync d13/d15/d1d/d24/f45 0 2023-10-21T17:11:52.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/404: stat d13/d15/d1d/d5d/d66/d70 0 2023-10-21T17:11:52.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/405: chown d13/d29/d78 63423 1 2023-10-21T17:11:52.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/406: chown d13/d15/c7f 0 1 2023-10-21T17:11:52.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/407: creat d13/d64/d6d/f86 x:0 0 0 2023-10-21T17:11:52.288 INFO:tasks.workunit.client.0.smithi012.stdout:6/408: write d13/d64/d6d/f86 [541807,49025] 0 2023-10-21T17:11:52.653 INFO:tasks.workunit.client.0.smithi012.stdout:8/367: symlink d0/d1a/l7e 0 2023-10-21T17:11:52.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/470: symlink d7/d55/d23/d66/da9/lb1 0 2023-10-21T17:11:53.228 INFO:tasks.workunit.client.0.smithi012.stdout:3/363: truncate d0/da/f34 5980437 0 2023-10-21T17:11:53.253 INFO:tasks.workunit.client.0.smithi012.stdout:3/364: dread d0/d32/d43/d47/d50/d52/f5d [0,4194304] 0 2023-10-21T17:11:53.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/409: rename d13/d29/f5a to d13/d15/d1d/d5d/d66/d7a/f87 0 2023-10-21T17:11:53.319 INFO:tasks.workunit.client.0.smithi012.stdout:8/368: unlink d0/d12/d51/f7c 0 2023-10-21T17:11:53.363 INFO:tasks.workunit.client.0.smithi012.stdout:8/369: write d0/f32 [3836197,120399] 0 2023-10-21T17:11:54.549 INFO:tasks.workunit.client.0.smithi012.stdout:3/365: mkdir d0/d32/d43/d47/d50/d52/d6d 0 2023-10-21T17:11:54.846 INFO:tasks.workunit.client.0.smithi012.stdout:5/391: mknod d2/d4f/d59/c84 0 2023-10-21T17:11:54.846 INFO:tasks.workunit.client.0.smithi012.stdout:5/392: creat d2/d1d/d4e/f85 x:0 0 0 2023-10-21T17:11:54.846 INFO:tasks.workunit.client.0.smithi012.stdout:5/393: chown d2/d4f/d59/d5b/c76 499760959 1 2023-10-21T17:11:54.935 INFO:tasks.workunit.client.0.smithi012.stdout:8/370: read d0/d29/f3c [593021,89964] 0 2023-10-21T17:11:54.935 INFO:tasks.workunit.client.0.smithi012.stdout:8/371: fdatasync d0/f16 0 2023-10-21T17:11:54.936 INFO:tasks.workunit.client.0.smithi012.stdout:8/372: readlink d0/d29/l77 0 2023-10-21T17:11:54.936 INFO:tasks.workunit.client.0.smithi012.stdout:8/373: chown d0/cc 349951 1 2023-10-21T17:11:55.040 INFO:tasks.workunit.client.0.smithi012.stdout:3/366: creat d0/d32/f6e x:0 0 0 2023-10-21T17:11:55.114 INFO:tasks.workunit.client.0.smithi012.stdout:3/367: dwrite d0/f14 [0,4194304] 0 2023-10-21T17:11:55.454 INFO:tasks.workunit.client.0.smithi012.stdout:5/394: mknod d2/d1d/d4e/c86 0 2023-10-21T17:11:55.529 INFO:tasks.workunit.client.0.smithi012.stdout:8/374: symlink d0/d12/d6c/l7f 0 2023-10-21T17:11:55.534 INFO:tasks.workunit.client.0.smithi012.stdout:5/395: dwrite d2/d4f/d59/d5b/f64 [0,4194304] 0 2023-10-21T17:11:55.708 INFO:tasks.workunit.client.0.smithi012.stdout:3/368: creat d0/d32/d43/f6f x:0 0 0 2023-10-21T17:11:55.708 INFO:tasks.workunit.client.0.smithi012.stdout:3/369: chown d0/da/d28/f2c 1881 1 2023-10-21T17:11:55.708 INFO:tasks.workunit.client.0.smithi012.stdout:3/370: write d0/da/f26 [1705116,64919] 0 2023-10-21T17:11:55.708 INFO:tasks.workunit.client.0.smithi012.stdout:3/371: write d0/f5 [592393,118594] 0 2023-10-21T17:11:55.709 INFO:tasks.workunit.client.0.smithi012.stdout:3/372: write d0/d32/d43/f6f [642272,66158] 0 2023-10-21T17:11:55.801 INFO:tasks.workunit.client.0.smithi012.stdout:3/373: dwrite d0/f4 [0,4194304] 0 2023-10-21T17:11:55.802 INFO:tasks.workunit.client.0.smithi012.stdout:3/374: truncate d0/d32/d43/f6b 635374 0 2023-10-21T17:11:56.006 INFO:tasks.workunit.client.0.smithi012.stdout:1/458: mknod d5/d32/d1b/d35/d3a/d5c/c9c 0 2023-10-21T17:11:56.065 INFO:tasks.workunit.client.0.smithi012.stdout:1/459: dwrite d5/d32/d1b/d27/d21/f37 [0,4194304] 0 2023-10-21T17:11:56.066 INFO:tasks.workunit.client.0.smithi012.stdout:1/460: stat d5/d32/d62/l16 0 2023-10-21T17:11:56.459 INFO:tasks.workunit.client.0.smithi012.stdout:3/375: dread d0/f2b [4194304,4194304] 0 2023-10-21T17:11:56.497 INFO:tasks.workunit.client.0.smithi012.stdout:3/376: dread d0/f4 [0,4194304] 0 2023-10-21T17:11:56.497 INFO:tasks.workunit.client.0.smithi012.stdout:3/377: readlink d0/d1c/l25 0 2023-10-21T17:11:56.498 INFO:tasks.workunit.client.0.smithi012.stdout:3/378: truncate d0/d1c/f6a 1802930 0 2023-10-21T17:11:56.808 INFO:tasks.workunit.client.0.smithi012.stdout:1/461: symlink d5/d32/d1b/d27/l9d 0 2023-10-21T17:11:57.468 INFO:tasks.workunit.client.0.smithi012.stdout:3/379: link d0/d32/c41 d0/d32/d43/c70 0 2023-10-21T17:11:57.469 INFO:tasks.workunit.client.0.smithi012.stdout:2/488: mkdir d1/d14/d17/da6 0 2023-10-21T17:11:57.739 INFO:tasks.workunit.client.0.smithi012.stdout:1/462: creat d5/d61/f9e x:0 0 0 2023-10-21T17:11:57.739 INFO:tasks.workunit.client.0.smithi012.stdout:1/463: readlink d5/d32/d1b/l25 0 2023-10-21T17:11:57.766 INFO:tasks.workunit.client.0.smithi012.stdout:1/464: dread d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:11:58.057 INFO:tasks.workunit.client.0.smithi012.stdout:2/489: link d1/d8/d25/d5f/f89 d1/d4/d93/fa7 0 2023-10-21T17:11:58.421 INFO:tasks.workunit.client.0.smithi012.stdout:2/490: link d1/d14/d16/d22/da5/d50/d97/l99 d1/d14/d16/d22/d82/d86/la8 0 2023-10-21T17:11:58.591 INFO:tasks.workunit.client.0.smithi012.stdout:6/410: link d13/d15/l56 d13/l88 0 2023-10-21T17:11:58.592 INFO:tasks.workunit.client.0.smithi012.stdout:7/448: sync 2023-10-21T17:11:58.592 INFO:tasks.workunit.client.0.smithi012.stdout:9/402: sync 2023-10-21T17:11:58.592 INFO:tasks.workunit.client.0.smithi012.stdout:4/439: sync 2023-10-21T17:11:58.592 INFO:tasks.workunit.client.0.smithi012.stdout:7/449: fsync d3/d6/f66 0 2023-10-21T17:11:58.592 INFO:tasks.workunit.client.0.smithi012.stdout:9/403: dread - d0/d4/d4b/d6a/d12/d2a/d36/f64 zero size 2023-10-21T17:11:58.593 INFO:tasks.workunit.client.0.smithi012.stdout:6/411: write d13/d15/d1d/d28/f39 [1414594,119620] 0 2023-10-21T17:11:58.593 INFO:tasks.workunit.client.0.smithi012.stdout:6/412: write d13/d15/d1d/d28/f39 [1994565,33511] 0 2023-10-21T17:11:58.657 INFO:tasks.workunit.client.0.smithi012.stdout:4/440: dwrite dc/d93/f5a [0,4194304] 0 2023-10-21T17:11:58.657 INFO:tasks.workunit.client.0.smithi012.stdout:4/441: read - dc/d15/d18/d4c/d55/f7f zero size 2023-10-21T17:11:58.658 INFO:tasks.workunit.client.0.smithi012.stdout:4/442: fsync dc/d15/f6f 0 2023-10-21T17:11:58.814 INFO:tasks.workunit.client.0.smithi012.stdout:0/471: creat d7/d55/fb2 x:0 0 0 2023-10-21T17:11:58.815 INFO:tasks.workunit.client.0.smithi012.stdout:0/472: truncate d7/d55/f5a 132458 0 2023-10-21T17:11:58.815 INFO:tasks.workunit.client.0.smithi012.stdout:0/473: fdatasync d7/d55/d23/d27/d31/f3e 0 2023-10-21T17:11:59.153 INFO:tasks.workunit.client.0.smithi012.stdout:2/491: mkdir d1/d14/d16/d22/da5/d50/da3/da9 0 2023-10-21T17:11:59.233 INFO:tasks.workunit.client.0.smithi012.stdout:7/450: creat d3/f83 x:0 0 0 2023-10-21T17:11:59.286 INFO:tasks.workunit.client.0.smithi012.stdout:7/451: dwrite d3/d6/dc/d19/d28/f6d [0,4194304] 0 2023-10-21T17:11:59.470 INFO:tasks.workunit.client.0.smithi012.stdout:6/413: mkdir d13/d42/d89 0 2023-10-21T17:11:59.544 INFO:tasks.workunit.client.0.smithi012.stdout:3/380: dwrite d0/d32/d43/d47/f48 [0,4194304] 0 2023-10-21T17:11:59.544 INFO:tasks.workunit.client.0.smithi012.stdout:3/381: creat d0/d1c/f71 x:0 0 0 2023-10-21T17:11:59.592 INFO:tasks.workunit.client.0.smithi012.stdout:4/443: link dc/d1e/d33/l40 dc/d15/d18/d4c/d55/d6c/d83/l97 0 2023-10-21T17:11:59.592 INFO:tasks.workunit.client.0.smithi012.stdout:4/444: chown dc/c13 369794767 1 2023-10-21T17:11:59.918 INFO:tasks.workunit.client.0.smithi012.stdout:0/474: fdatasync d7/d55/d23/d66/d63/f6d 0 2023-10-21T17:12:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:7/452: mknod d3/d6/dc/d19/d1e/d7b/c84 0 2023-10-21T17:12:00.241 INFO:tasks.workunit.client.0.smithi012.stdout:8/375: rename d0/d12/d40/d4a/d5b to d0/d12/d80 0 2023-10-21T17:12:00.714 INFO:tasks.workunit.client.0.smithi012.stdout:6/414: unlink d13/d15/d1d/d28/f80 0 2023-10-21T17:12:00.791 INFO:tasks.workunit.client.0.smithi012.stdout:9/404: creat d0/f85 x:0 0 0 2023-10-21T17:12:01.252 INFO:tasks.workunit.client.0.smithi012.stdout:0/475: creat d7/d55/fb3 x:0 0 0 2023-10-21T17:12:01.401 INFO:tasks.workunit.client.0.smithi012.stdout:7/453: write d3/d6/dc/d19/d43/f4e [723676,48156] 0 2023-10-21T17:12:01.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/376: creat d0/d29/d79/f81 x:0 0 0 2023-10-21T17:12:01.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/377: chown d0/d29/l77 0 1 2023-10-21T17:12:01.942 INFO:tasks.workunit.client.0.smithi012.stdout:4/445: getdents dc/d1e/d91 0 2023-10-21T17:12:02.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/476: unlink d7/d55/d1f/d28/d9b/f6c 0 2023-10-21T17:12:02.116 INFO:tasks.workunit.client.0.smithi012.stdout:0/477: fsync d7/d55/d23/d30/d8c/fa0 0 2023-10-21T17:12:03.341 INFO:tasks.workunit.client.0.smithi012.stdout:3/382: write d0/da/d28/f40 [4565814,114026] 0 2023-10-21T17:12:03.342 INFO:tasks.workunit.client.0.smithi012.stdout:3/383: chown d0/d32/d43/f6f 0 1 2023-10-21T17:12:03.665 INFO:tasks.workunit.client.0.smithi012.stdout:5/396: rename d2/d1d/d29 to d2/d4f/d7e/d87 0 2023-10-21T17:12:04.114 INFO:tasks.workunit.client.0.smithi012.stdout:4/446: creat dc/d15/d18/d4c/f98 x:0 0 0 2023-10-21T17:12:04.252 INFO:tasks.workunit.client.0.smithi012.stdout:3/384: mknod d0/d32/c72 0 2023-10-21T17:12:04.253 INFO:tasks.workunit.client.0.smithi012.stdout:3/385: fsync d0/d32/f4e 0 2023-10-21T17:12:04.275 INFO:tasks.workunit.client.0.smithi012.stdout:5/397: dread d2/d2c/f7a [0,4194304] 0 2023-10-21T17:12:04.275 INFO:tasks.workunit.client.0.smithi012.stdout:5/398: chown d2/f18 1587 1 2023-10-21T17:12:04.277 INFO:tasks.workunit.client.0.smithi012.stdout:3/386: write d0/f5 [3674012,58555] 0 2023-10-21T17:12:04.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/387: chown d0/d32/f4e 32716 1 2023-10-21T17:12:04.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/388: dread - d0/d32/d43/d47/d50/d52/f53 zero size 2023-10-21T17:12:04.428 INFO:tasks.workunit.client.0.smithi012.stdout:1/465: rename f1 to d5/d26/d54/f9f 0 2023-10-21T17:12:04.948 INFO:tasks.workunit.client.0.smithi012.stdout:4/447: mkdir dc/d93/d99 0 2023-10-21T17:12:04.974 INFO:tasks.workunit.client.0.smithi012.stdout:4/448: read dc/d15/d18/f82 [684255,7319] 0 2023-10-21T17:12:04.975 INFO:tasks.workunit.client.0.smithi012.stdout:4/449: write dc/d15/d2a/d31/f7e [271479,94669] 0 2023-10-21T17:12:05.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/450: dwrite dc/d15/d18/d4c/f98 [0,4194304] 0 2023-10-21T17:12:05.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:12:05.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:12:05.551 INFO:tasks.workunit.client.0.smithi012.stdout:6/415: symlink d13/d15/l8a 0 2023-10-21T17:12:05.551 INFO:tasks.workunit.client.0.smithi012.stdout:6/416: readlink d13/d15/d1d/d5d/l6e 0 2023-10-21T17:12:05.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/417: fdatasync d13/d35/d4c/f65 0 2023-10-21T17:12:05.552 INFO:tasks.workunit.client.0.smithi012.stdout:2/492: rename d1/d4/d3f/d41/c80 to d1/d4/d93/caa 0 2023-10-21T17:12:05.552 INFO:tasks.workunit.client.0.smithi012.stdout:2/493: creat d1/d14/d17/d8a/fab x:0 0 0 2023-10-21T17:12:05.552 INFO:tasks.workunit.client.0.smithi012.stdout:2/494: write d1/d8/ff [539621,4767] 0 2023-10-21T17:12:05.553 INFO:tasks.workunit.client.0.smithi012.stdout:2/495: truncate d1/d14/f6e 452237 0 2023-10-21T17:12:05.570 INFO:tasks.workunit.client.0.smithi012.stdout:1/466: mkdir d5/d26/d64/d8f/da0 0 2023-10-21T17:12:05.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/399: mknod d2/d1d/d20/c88 0 2023-10-21T17:12:05.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/400: dread - d2/d4f/d59/d5b/f77 zero size 2023-10-21T17:12:05.606 INFO:tasks.workunit.client.0.smithi012.stdout:2/496: dwrite d1/d14/d16/d22/da5/d50/f7a [0,4194304] 0 2023-10-21T17:12:06.526 INFO:tasks.workunit.client.0.smithi012.stdout:8/378: write d0/f4f [1750395,126634] 0 2023-10-21T17:12:06.604 INFO:tasks.workunit.client.0.smithi012.stdout:8/379: dwrite d0/d12/d80/f67 [0,4194304] 0 2023-10-21T17:12:06.736 INFO:tasks.workunit.client.0.smithi012.stdout:9/405: dwrite d0/d5/f69 [4194304,4194304] 0 2023-10-21T17:12:06.736 INFO:tasks.workunit.client.0.smithi012.stdout:9/406: dread - d0/f72 zero size 2023-10-21T17:12:07.045 INFO:tasks.workunit.client.0.smithi012.stdout:2/497: link d1/d4/c61 d1/d4/d65/cac 0 2023-10-21T17:12:07.072 INFO:tasks.workunit.client.0.smithi012.stdout:2/498: write d1/d8/f10 [2529461,59611] 0 2023-10-21T17:12:07.072 INFO:tasks.workunit.client.0.smithi012.stdout:2/499: dread - d1/d14/d16/d22/da5/d50/f54 zero size 2023-10-21T17:12:08.359 INFO:tasks.workunit.client.0.smithi012.stdout:8/380: write d0/d1a/f1d [3005176,86904] 0 2023-10-21T17:12:08.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/407: truncate d0/d5/f22 3102448 0 2023-10-21T17:12:08.396 INFO:tasks.workunit.client.0.smithi012.stdout:9/408: fdatasync d0/df/f43 0 2023-10-21T17:12:09.052 INFO:tasks.workunit.client.0.smithi012.stdout:5/401: creat d2/d4f/d59/f89 x:0 0 0 2023-10-21T17:12:09.074 INFO:tasks.workunit.client.0.smithi012.stdout:5/402: dread d2/d4f/d59/d5b/f41 [0,4194304] 0 2023-10-21T17:12:09.186 INFO:tasks.workunit.client.0.smithi012.stdout:8/381: creat d0/d12/d40/f82 x:0 0 0 2023-10-21T17:12:09.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/403: creat d2/d4f/d7e/f8a x:0 0 0 2023-10-21T17:12:09.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/404: chown d2/d4f/f6e 10756090 1 2023-10-21T17:12:09.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/405: write d2/d6/f54 [2250058,29321] 0 2023-10-21T17:12:09.961 INFO:tasks.workunit.client.0.smithi012.stdout:4/451: write f8 [28835,19989] 0 2023-10-21T17:12:09.997 INFO:tasks.workunit.client.0.smithi012.stdout:1/467: write d5/d26/f40 [1058975,12595] 0 2023-10-21T17:12:09.998 INFO:tasks.workunit.client.0.smithi012.stdout:1/468: creat d5/d32/d1b/d2c/d48/fa1 x:0 0 0 2023-10-21T17:12:10.047 INFO:tasks.workunit.client.0.smithi012.stdout:6/418: mknod d13/c8b 0 2023-10-21T17:12:10.223 INFO:tasks.workunit.client.0.smithi012.stdout:9/409: write d0/d5/f22 [1102164,108736] 0 2023-10-21T17:12:10.379 INFO:tasks.workunit.client.0.smithi012.stdout:5/406: getdents d2/d4f/d7e/d87 0 2023-10-21T17:12:10.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/452: mknod dc/d1e/d33/d7a/c9a 0 2023-10-21T17:12:10.687 INFO:tasks.workunit.client.0.smithi012.stdout:1/469: symlink d5/d32/d1b/d2c/la2 0 2023-10-21T17:12:10.687 INFO:tasks.workunit.client.0.smithi012.stdout:1/470: write d5/d32/d1b/d27/d21/f37 [5035666,28405] 0 2023-10-21T17:12:10.714 INFO:tasks.workunit.client.0.smithi012.stdout:1/471: dread d5/f10 [0,4194304] 0 2023-10-21T17:12:10.788 INFO:tasks.workunit.client.0.smithi012.stdout:1/472: dwrite d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:12:10.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/473: fdatasync d5/d32/d1b/d27/d21/f4e 0 2023-10-21T17:12:10.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/474: chown d5/d26/d54 292003 1 2023-10-21T17:12:10.820 INFO:tasks.workunit.client.0.smithi012.stdout:6/419: creat d13/d42/f8c x:0 0 0 2023-10-21T17:12:10.864 INFO:tasks.workunit.client.0.smithi012.stdout:1/475: dwrite d5/d32/d1b/d35/f3f [0,4194304] 0 2023-10-21T17:12:10.864 INFO:tasks.workunit.client.0.smithi012.stdout:1/476: write d5/d32/d1b/d27/d21/f2b [1027306,106769] 0 2023-10-21T17:12:10.888 INFO:tasks.workunit.client.0.smithi012.stdout:1/477: write d5/d32/d1b/d27/d21/f4e [2135214,15985] 0 2023-10-21T17:12:11.089 INFO:tasks.workunit.client.0.smithi012.stdout:9/410: creat d0/d4/d4b/d6a/d12/d25/d39/f86 x:0 0 0 2023-10-21T17:12:11.165 INFO:tasks.workunit.client.0.smithi012.stdout:9/411: dwrite d0/d4/d4b/d6a/d12/d25/f71 [4194304,4194304] 0 2023-10-21T17:12:11.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/407: mknod d2/d4f/d7e/d87/d57/c8b 0 2023-10-21T17:12:11.408 INFO:tasks.workunit.client.0.smithi012.stdout:4/453: stat dc/d15/d18/d4c/d55/d6c/d83/l97 0 2023-10-21T17:12:11.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/454: dwrite dc/d15/d18/d4c/d55/d6c/d77/f96 [0,4194304] 0 2023-10-21T17:12:11.481 INFO:tasks.workunit.client.0.smithi012.stdout:4/455: write dc/d1e/f5f [1045913,77566] 0 2023-10-21T17:12:11.663 INFO:tasks.workunit.client.0.smithi012.stdout:6/420: mknod d13/d42/c8d 0 2023-10-21T17:12:11.663 INFO:tasks.workunit.client.0.smithi012.stdout:6/421: read d13/d15/f2b [150989,48293] 0 2023-10-21T17:12:11.889 INFO:tasks.workunit.client.0.smithi012.stdout:1/478: mkdir d5/d26/da3 0 2023-10-21T17:12:11.890 INFO:tasks.workunit.client.0.smithi012.stdout:9/412: readlink d0/d4/d4b/l4d 0 2023-10-21T17:12:11.969 INFO:tasks.workunit.client.0.smithi012.stdout:7/454: rename d3/f3f to d3/d6/dc/d19/d1e/d7b/f85 0 2023-10-21T17:12:11.984 INFO:tasks.workunit.client.0.smithi012.stdout:1/479: dwrite d5/d32/d1b/d35/d49/f57 [0,4194304] 0 2023-10-21T17:12:11.984 INFO:tasks.workunit.client.0.smithi012.stdout:5/408: dread d2/d6/f69 [0,4194304] 0 2023-10-21T17:12:11.999 INFO:tasks.workunit.client.0.smithi012.stdout:5/409: dread d2/d1d/d4e/f5c [0,4194304] 0 2023-10-21T17:12:11.999 INFO:tasks.workunit.client.0.smithi012.stdout:5/410: write d2/d4f/d59/d5b/f77 [40475,84818] 0 2023-10-21T17:12:12.110 INFO:tasks.workunit.client.0.smithi012.stdout:3/389: mknod d0/c73 0 2023-10-21T17:12:14.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/422: getdents d13/d15/d1d 0 2023-10-21T17:12:14.313 INFO:tasks.workunit.client.0.smithi012.stdout:6/423: stat d13/d15/d1d/d24/f45 0 2023-10-21T17:12:14.329 INFO:tasks.workunit.client.0.smithi012.stdout:6/424: dread d13/d15/f1a [0,4194304] 0 2023-10-21T17:12:14.401 INFO:tasks.workunit.client.0.smithi012.stdout:9/413: getdents d0/d4/d4b/d6a/d12/d25/d39/d76 0 2023-10-21T17:12:14.521 INFO:tasks.workunit.client.0.smithi012.stdout:0/478: rename d7/d55/d1f/l2b to d7/d81/lb4 0 2023-10-21T17:12:14.522 INFO:tasks.workunit.client.0.smithi012.stdout:0/479: write d7/f7b [1757344,120976] 0 2023-10-21T17:12:14.540 INFO:tasks.workunit.client.0.smithi012.stdout:0/480: dread d7/d55/d23/d66/f1e [0,4194304] 0 2023-10-21T17:12:14.541 INFO:tasks.workunit.client.0.smithi012.stdout:0/481: fdatasync d7/d55/d23/d27/d31/d3d/f6e 0 2023-10-21T17:12:14.541 INFO:tasks.workunit.client.0.smithi012.stdout:0/482: stat d7/l99 0 2023-10-21T17:12:14.566 INFO:tasks.workunit.client.0.smithi012.stdout:0/483: write d7/d55/d23/d66/f57 [6010584,57575] 0 2023-10-21T17:12:15.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/411: mkdir d2/d2c/d8c 0 2023-10-21T17:12:15.367 INFO:tasks.workunit.client.0.smithi012.stdout:6/425: creat d13/d15/d1d/d24/f8e x:0 0 0 2023-10-21T17:12:15.455 INFO:tasks.workunit.client.0.smithi012.stdout:9/414: creat d0/d4/d4b/d6a/d12/d2a/f87 x:0 0 0 2023-10-21T17:12:15.456 INFO:tasks.workunit.client.0.smithi012.stdout:9/415: creat d0/d15/f88 x:0 0 0 2023-10-21T17:12:15.456 INFO:tasks.workunit.client.0.smithi012.stdout:9/416: write d0/df/f11 [4877226,64590] 0 2023-10-21T17:12:15.564 INFO:tasks.workunit.client.0.smithi012.stdout:2/500: rename d1/d4/c61 to d1/d14/d16/d22/da5/d50/d97/cad 0 2023-10-21T17:12:15.564 INFO:tasks.workunit.client.0.smithi012.stdout:2/501: fsync d1/d8/f76 0 2023-10-21T17:12:15.565 INFO:tasks.workunit.client.0.smithi012.stdout:2/502: chown d1/d8/f7c 0 1 2023-10-21T17:12:15.961 INFO:tasks.workunit.client.0.smithi012.stdout:0/484: symlink d7/d55/d23/d66/d48/d88/lb5 0 2023-10-21T17:12:16.097 INFO:tasks.workunit.client.0.smithi012.stdout:5/412: creat d2/d4f/d59/d5b/d15/f8d x:0 0 0 2023-10-21T17:12:16.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/426: link d13/d15/f67 d13/d15/d1d/d28/f8f 0 2023-10-21T17:12:16.264 INFO:tasks.workunit.client.0.smithi012.stdout:6/427: dwrite d13/d42/f84 [0,4194304] 0 2023-10-21T17:12:16.585 INFO:tasks.workunit.client.0.smithi012.stdout:9/417: mkdir d0/d4/d4b/d6a/d89 0 2023-10-21T17:12:16.794 INFO:tasks.workunit.client.0.smithi012.stdout:2/503: mknod d1/d14/d16/d22/da5/d50/da3/da9/cae 0 2023-10-21T17:12:16.795 INFO:tasks.workunit.client.0.smithi012.stdout:2/504: creat d1/d95/faf x:0 0 0 2023-10-21T17:12:17.426 INFO:tasks.workunit.client.0.smithi012.stdout:6/428: symlink d13/d15/d1d/d5d/d66/d70/l90 0 2023-10-21T17:12:17.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/418: mkdir d0/d4/d4b/d6a/d12/d2a/d36/d8a 0 2023-10-21T17:12:17.441 INFO:tasks.workunit.client.0.smithi012.stdout:9/419: chown d0/d5/l6c 33408959 1 2023-10-21T17:12:17.510 INFO:tasks.workunit.client.0.smithi012.stdout:9/420: dwrite d0/df/f42 [0,4194304] 0 2023-10-21T17:12:17.511 INFO:tasks.workunit.client.0.smithi012.stdout:9/421: truncate d0/d4/d4b/d6a/d12/d2a/f87 890620 0 2023-10-21T17:12:17.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/456: sync 2023-10-21T17:12:17.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/457: chown dc/f25 17208783 1 2023-10-21T17:12:17.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/458: readlink dc/d15/d2a/l73 0 2023-10-21T17:12:17.646 INFO:tasks.workunit.client.0.smithi012.stdout:4/459: readlink dc/d28/l70 0 2023-10-21T17:12:17.646 INFO:tasks.workunit.client.0.smithi012.stdout:4/460: readlink l2 0 2023-10-21T17:12:17.870 INFO:tasks.workunit.client.0.smithi012.stdout:2/505: symlink d1/d14/d16/d20/lb0 0 2023-10-21T17:12:18.117 INFO:tasks.workunit.client.0.smithi012.stdout:5/413: link d2/d1d/d20/f2b d2/d1d/f8e 0 2023-10-21T17:12:18.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/414: fdatasync d2/d4f/d7e/d87/d57/f5f 0 2023-10-21T17:12:18.382 INFO:tasks.workunit.client.0.smithi012.stdout:1/480: sync 2023-10-21T17:12:18.382 INFO:tasks.workunit.client.0.smithi012.stdout:7/455: sync 2023-10-21T17:12:18.596 INFO:tasks.workunit.client.0.smithi012.stdout:6/429: mknod d13/d15/d1d/c91 0 2023-10-21T17:12:19.236 INFO:tasks.workunit.client.0.smithi012.stdout:8/382: rename d0/d12/d40/d4a to d0/d62/d83 0 2023-10-21T17:12:19.236 INFO:tasks.workunit.client.0.smithi012.stdout:8/383: chown d0/d46 15 1 2023-10-21T17:12:19.332 INFO:tasks.workunit.client.0.smithi012.stdout:4/461: truncate dc/f67 892739 0 2023-10-21T17:12:19.494 INFO:tasks.workunit.client.0.smithi012.stdout:2/506: creat d1/d14/d16/d22/da5/d34/fb1 x:0 0 0 2023-10-21T17:12:19.494 INFO:tasks.workunit.client.0.smithi012.stdout:2/507: fdatasync d1/d8/f2d 0 2023-10-21T17:12:19.571 INFO:tasks.workunit.client.0.smithi012.stdout:7/456: symlink d3/d29/l86 0 2023-10-21T17:12:19.744 INFO:tasks.workunit.client.0.smithi012.stdout:1/481: creat d5/d32/d1b/d2c/d4b/d8a/fa4 x:0 0 0 2023-10-21T17:12:20.266 INFO:tasks.workunit.client.0.smithi012.stdout:6/430: mkdir d13/d15/d1d/d5d/d92 0 2023-10-21T17:12:20.402 INFO:tasks.workunit.client.0.smithi012.stdout:9/422: getdents d0/d4/d4b/d6a/d12 0 2023-10-21T17:12:20.512 INFO:tasks.workunit.client.0.smithi012.stdout:3/390: rename d0/c5b to d0/d32/c74 0 2023-10-21T17:12:20.752 INFO:tasks.workunit.client.0.smithi012.stdout:4/462: creat dc/d6b/f9b x:0 0 0 2023-10-21T17:12:20.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/508: creat d1/d8/fb2 x:0 0 0 2023-10-21T17:12:20.923 INFO:tasks.workunit.client.0.smithi012.stdout:2/509: chown d1/d8/f8f 25360 1 2023-10-21T17:12:21.095 INFO:tasks.workunit.client.0.smithi012.stdout:7/457: truncate d3/d6/f6f 360054 0 2023-10-21T17:12:21.130 INFO:tasks.workunit.client.0.smithi012.stdout:7/458: read d3/d6/f66 [2130990,50351] 0 2023-10-21T17:12:21.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/459: stat d3/d29/f45 0 2023-10-21T17:12:21.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/460: chown d3/d29/l70 117537930 1 2023-10-21T17:12:21.166 INFO:tasks.workunit.client.0.smithi012.stdout:7/461: dread d3/d16/f32 [0,4194304] 0 2023-10-21T17:12:21.233 INFO:tasks.workunit.client.0.smithi012.stdout:1/482: creat d5/fa5 x:0 0 0 2023-10-21T17:12:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/483: dwrite d5/d26/f40 [0,4194304] 0 2023-10-21T17:12:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/484: write d5/d61/f9e [435619,76706] 0 2023-10-21T17:12:21.434 INFO:tasks.workunit.client.0.smithi012.stdout:1/485: dwrite d5/d32/d1b/d2c/d48/fa1 [0,4194304] 0 2023-10-21T17:12:21.435 INFO:tasks.workunit.client.0.smithi012.stdout:1/486: readlink d5/d26/l98 0 2023-10-21T17:12:21.469 INFO:tasks.workunit.client.0.smithi012.stdout:1/487: dread d5/d26/f40 [0,4194304] 0 2023-10-21T17:12:21.544 INFO:tasks.workunit.client.0.smithi012.stdout:6/431: creat d13/d35/d4c/f93 x:0 0 0 2023-10-21T17:12:21.544 INFO:tasks.workunit.client.0.smithi012.stdout:6/432: fdatasync d13/d15/f67 0 2023-10-21T17:12:21.875 INFO:tasks.workunit.client.0.smithi012.stdout:0/485: rename d7/d55/d23/d27/d40/f87 to d7/d55/d23/d27/fb6 0 2023-10-21T17:12:21.875 INFO:tasks.workunit.client.0.smithi012.stdout:3/391: symlink d0/d32/d43/d47/d50/l75 0 2023-10-21T17:12:21.876 INFO:tasks.workunit.client.0.smithi012.stdout:0/486: dread - d7/d55/d23/d27/d31/d5f/fa7 zero size 2023-10-21T17:12:22.182 INFO:tasks.workunit.client.0.smithi012.stdout:4/463: truncate dc/d1e/f44 753326 0 2023-10-21T17:12:22.183 INFO:tasks.workunit.client.0.smithi012.stdout:4/464: fsync dc/d15/d18/d4c/d55/f7f 0 2023-10-21T17:12:22.208 INFO:tasks.workunit.client.0.smithi012.stdout:4/465: dread dc/d1e/d33/f43 [0,4194304] 0 2023-10-21T17:12:22.209 INFO:tasks.workunit.client.0.smithi012.stdout:4/466: chown dc/d1e/f5f 1291 1 2023-10-21T17:12:22.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/467: dwrite dc/d1e/d2b/f5c [0,4194304] 0 2023-10-21T17:12:22.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/468: chown dc/d1e/d33/c51 8025213 1 2023-10-21T17:12:22.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/469: dread - dc/d15/d18/d4c/d55/f7f zero size 2023-10-21T17:12:22.313 INFO:tasks.workunit.client.0.smithi012.stdout:4/470: dread dc/d93/f46 [0,4194304] 0 2023-10-21T17:12:22.314 INFO:tasks.workunit.client.0.smithi012.stdout:4/471: creat dc/d15/d18/d4c/d55/f9c x:0 0 0 2023-10-21T17:12:22.329 INFO:tasks.workunit.client.0.smithi012.stdout:2/510: mknod d1/d14/d16/d22/da5/d50/da3/cb3 0 2023-10-21T17:12:22.523 INFO:tasks.workunit.client.0.smithi012.stdout:7/462: creat d3/d6/dc/d19/d28/f87 x:0 0 0 2023-10-21T17:12:22.524 INFO:tasks.workunit.client.0.smithi012.stdout:7/463: write d3/f83 [431821,120373] 0 2023-10-21T17:12:23.417 INFO:tasks.workunit.client.0.smithi012.stdout:6/433: creat d13/d29/d78/f94 x:0 0 0 2023-10-21T17:12:23.614 INFO:tasks.workunit.client.0.smithi012.stdout:5/415: rename d2/d4f/d59/d5b/d15/f3d to d2/d1d/d83/f8f 0 2023-10-21T17:12:23.792 INFO:tasks.workunit.client.0.smithi012.stdout:0/487: mkdir d7/d55/d23/d66/d48/db7 0 2023-10-21T17:12:24.154 INFO:tasks.workunit.client.0.smithi012.stdout:2/511: creat d1/d4/d93/fb4 x:0 0 0 2023-10-21T17:12:24.155 INFO:tasks.workunit.client.0.smithi012.stdout:2/512: chown d1/d14/d16/d22/da5/d50/c7d 16865 1 2023-10-21T17:12:24.155 INFO:tasks.workunit.client.0.smithi012.stdout:2/513: dread - d1/d8/d25/f42 zero size 2023-10-21T17:12:24.155 INFO:tasks.workunit.client.0.smithi012.stdout:2/514: write d1/d14/d16/d22/f39 [75054,18759] 0 2023-10-21T17:12:24.751 INFO:tasks.workunit.client.0.smithi012.stdout:6/434: mknod d13/d42/c95 0 2023-10-21T17:12:25.217 INFO:tasks.workunit.client.0.smithi012.stdout:3/392: getdents d0/d32 0 2023-10-21T17:12:25.218 INFO:tasks.workunit.client.0.smithi012.stdout:3/393: write d0/da/f5f [173682,60952] 0 2023-10-21T17:12:25.218 INFO:tasks.workunit.client.0.smithi012.stdout:3/394: readlink d0/d32/d43/l65 0 2023-10-21T17:12:25.333 INFO:tasks.workunit.client.0.smithi012.stdout:9/423: rename d0/d4/d4b/d6a/d12/d2a/d36/f3c to d0/d4/d4b/d6a/d89/f8b 0 2023-10-21T17:12:25.455 INFO:tasks.workunit.client.0.smithi012.stdout:5/416: truncate d2/d4f/d59/d5b/f67 636591 0 2023-10-21T17:12:25.456 INFO:tasks.workunit.client.0.smithi012.stdout:0/488: symlink d7/d55/d23/d27/d31/d3d/lb8 0 2023-10-21T17:12:25.456 INFO:tasks.workunit.client.0.smithi012.stdout:0/489: fsync d7/d52/d90/f95 0 2023-10-21T17:12:25.471 INFO:tasks.workunit.client.0.smithi012.stdout:8/384: write d0/d12/d51/f57 [1600315,4129] 0 2023-10-21T17:12:25.505 INFO:tasks.workunit.client.0.smithi012.stdout:0/490: dread d7/d55/d23/d66/f57 [0,4194304] 0 2023-10-21T17:12:25.505 INFO:tasks.workunit.client.0.smithi012.stdout:0/491: fdatasync d7/f36 0 2023-10-21T17:12:25.505 INFO:tasks.workunit.client.0.smithi012.stdout:0/492: chown d7/f83 58156 1 2023-10-21T17:12:25.543 INFO:tasks.workunit.client.0.smithi012.stdout:5/417: dwrite d2/d4f/d7e/d87/f39 [8388608,4194304] 0 2023-10-21T17:12:25.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/418: write d2/d1d/f56 [50033,7489] 0 2023-10-21T17:12:25.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/464: mknod d3/d6/dc/c88 0 2023-10-21T17:12:25.790 INFO:tasks.workunit.client.0.smithi012.stdout:2/515: creat d1/d4/d3f/d41/d59/fb5 x:0 0 0 2023-10-21T17:12:25.909 INFO:tasks.workunit.client.0.smithi012.stdout:6/435: symlink d13/d35/d4c/l96 0 2023-10-21T17:12:25.909 INFO:tasks.workunit.client.0.smithi012.stdout:6/436: fdatasync ff 0 2023-10-21T17:12:26.133 INFO:tasks.workunit.client.0.smithi012.stdout:3/395: unlink d0/d32/l58 0 2023-10-21T17:12:26.136 INFO:tasks.workunit.client.0.smithi012.stdout:3/396: write d0/da/d28/f40 [4234375,38896] 0 2023-10-21T17:12:26.160 INFO:tasks.workunit.client.0.smithi012.stdout:3/397: dread d0/da/f34 [0,4194304] 0 2023-10-21T17:12:26.161 INFO:tasks.workunit.client.0.smithi012.stdout:3/398: fdatasync d0/f15 0 2023-10-21T17:12:26.578 INFO:tasks.workunit.client.0.smithi012.stdout:1/488: rename d5/d32/d62/f9a to d5/d32/d1b/d27/d1a/d46/d4f/fa6 0 2023-10-21T17:12:26.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/424: mkdir d0/d4/d4b/d6a/d12/d25/d2f/d8c 0 2023-10-21T17:12:26.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/493: creat d7/d55/d23/d66/d82/d8d/fb9 x:0 0 0 2023-10-21T17:12:27.000 INFO:tasks.workunit.client.0.smithi012.stdout:0/494: fsync d7/d55/d23/d27/d31/d5f/fad 0 2023-10-21T17:12:27.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/495: dwrite d7/d55/d23/d66/f57 [0,4194304] 0 2023-10-21T17:12:27.336 INFO:tasks.workunit.client.0.smithi012.stdout:5/419: mknod d2/d2c/d8c/c90 0 2023-10-21T17:12:27.374 INFO:tasks.workunit.client.0.smithi012.stdout:5/420: dread d2/d6/f51 [0,4194304] 0 2023-10-21T17:12:27.374 INFO:tasks.workunit.client.0.smithi012.stdout:5/421: stat d2/d4f/d7e/d87/l3a 0 2023-10-21T17:12:27.488 INFO:tasks.workunit.client.0.smithi012.stdout:2/516: unlink d1/d4/f4c 0 2023-10-21T17:12:27.625 INFO:tasks.workunit.client.0.smithi012.stdout:6/437: mkdir d13/d15/d1d/d5d/d66/d7a/d97 0 2023-10-21T17:12:27.625 INFO:tasks.workunit.client.0.smithi012.stdout:6/438: chown d13/d15/d1d/d28/d5b 12462725 1 2023-10-21T17:12:27.625 INFO:tasks.workunit.client.0.smithi012.stdout:6/439: stat d13/d15/d1d/d5d/d66/d7a 0 2023-10-21T17:12:28.080 INFO:tasks.workunit.client.0.smithi012.stdout:4/472: rename dc/d15/d18/c3d to dc/d1e/d33/d7a/c9d 0 2023-10-21T17:12:28.569 INFO:tasks.workunit.client.0.smithi012.stdout:1/489: link d5/d32/d1b/d35/d3a/d5c/f7e d5/d32/d1b/d35/d3a/d93/fa7 0 2023-10-21T17:12:28.637 INFO:tasks.workunit.client.0.smithi012.stdout:1/490: dwrite d5/d32/d1b/d2c/d48/f74 [0,4194304] 0 2023-10-21T17:12:28.637 INFO:tasks.workunit.client.0.smithi012.stdout:1/491: read - d5/d26/d64/f80 zero size 2023-10-21T17:12:28.765 INFO:tasks.workunit.client.0.smithi012.stdout:5/422: creat d2/d4f/d59/d5b/d1e/f91 x:0 0 0 2023-10-21T17:12:28.766 INFO:tasks.workunit.client.0.smithi012.stdout:5/423: truncate d2/d4f/d7e/f8a 1033034 0 2023-10-21T17:12:28.958 INFO:tasks.workunit.client.0.smithi012.stdout:2/517: creat d1/d14/d17/da6/fb6 x:0 0 0 2023-10-21T17:12:28.959 INFO:tasks.workunit.client.0.smithi012.stdout:2/518: stat d1/d14/d17/f73 0 2023-10-21T17:12:29.277 INFO:tasks.workunit.client.0.smithi012.stdout:3/399: creat d0/d32/d43/d47/d50/d52/f76 x:0 0 0 2023-10-21T17:12:29.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/400: write d0/d1c/f71 [607188,79954] 0 2023-10-21T17:12:29.494 INFO:tasks.workunit.client.0.smithi012.stdout:8/385: rename d0/d62/d83/d4e/c6d to d0/d12/d6a/c84 0 2023-10-21T17:12:29.591 INFO:tasks.workunit.client.0.smithi012.stdout:4/473: mkdir dc/d15/d18/d4c/d55/d6c/d9e 0 2023-10-21T17:12:30.110 INFO:tasks.workunit.client.0.smithi012.stdout:1/492: mknod d5/d32/ca8 0 2023-10-21T17:12:30.480 INFO:tasks.workunit.client.0.smithi012.stdout:2/519: readlink d1/d4/l23 0 2023-10-21T17:12:30.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/520: chown d1/d4/d65/l91 20787 1 2023-10-21T17:12:30.722 INFO:tasks.workunit.client.0.smithi012.stdout:3/401: link d0/d32/d43/d47/d50/d52/f5d d0/da/d28/f77 0 2023-10-21T17:12:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:1/493: mkdir d5/d30/da9 0 2023-10-21T17:12:32.130 INFO:tasks.workunit.client.0.smithi012.stdout:2/521: rmdir d1/d14/d16/d20 39 2023-10-21T17:12:32.131 INFO:tasks.workunit.client.0.smithi012.stdout:2/522: write d1/d4/d93/fa7 [823823,27650] 0 2023-10-21T17:12:32.512 INFO:tasks.workunit.client.0.smithi012.stdout:3/402: creat d0/d32/f78 x:0 0 0 2023-10-21T17:12:32.876 INFO:tasks.workunit.client.0.smithi012.stdout:6/440: write d13/d15/f21 [4187881,78911] 0 2023-10-21T17:12:32.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/494: creat d5/d32/d1b/d35/faa x:0 0 0 2023-10-21T17:12:33.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/441: mkdir d13/d15/d1d/d5d/d66/d70/d74/d98 0 2023-10-21T17:12:33.191 INFO:tasks.workunit.client.0.smithi012.stdout:3/403: dread d0/fd [0,4194304] 0 2023-10-21T17:12:33.203 INFO:tasks.workunit.client.0.smithi012.stdout:1/495: mknod d5/d26/d54/cab 0 2023-10-21T17:12:33.247 INFO:tasks.workunit.client.0.smithi012.stdout:1/496: dread d5/d32/d1b/d27/d1a/d46/f60 [0,4194304] 0 2023-10-21T17:12:33.389 INFO:tasks.workunit.client.0.smithi012.stdout:6/442: link d13/d42/d71/f7d d13/d29/d78/f99 0 2023-10-21T17:12:33.467 INFO:tasks.workunit.client.0.smithi012.stdout:6/443: dwrite f8 [0,4194304] 0 2023-10-21T17:12:34.265 INFO:tasks.workunit.client.0.smithi012.stdout:3/404: creat d0/d32/d43/f79 x:0 0 0 2023-10-21T17:12:34.333 INFO:tasks.workunit.client.0.smithi012.stdout:1/497: truncate d5/d32/d1b/d35/d3a/f3d 1542410 0 2023-10-21T17:12:34.334 INFO:tasks.workunit.client.0.smithi012.stdout:4/474: unlink dc/f3b 0 2023-10-21T17:12:34.334 INFO:tasks.workunit.client.0.smithi012.stdout:7/465: rename d3/d6/dc/d19/f33 to d3/f89 0 2023-10-21T17:12:34.349 INFO:tasks.workunit.client.0.smithi012.stdout:3/405: dwrite d0/d1c/f71 [0,4194304] 0 2023-10-21T17:12:34.390 INFO:tasks.workunit.client.0.smithi012.stdout:4/475: dwrite dc/d15/d18/f71 [0,4194304] 0 2023-10-21T17:12:34.488 INFO:tasks.workunit.client.0.smithi012.stdout:8/386: dwrite d0/d12/d80/f75 [0,4194304] 0 2023-10-21T17:12:34.488 INFO:tasks.workunit.client.0.smithi012.stdout:8/387: write d0/d29/f59 [4885284,40986] 0 2023-10-21T17:12:34.489 INFO:tasks.workunit.client.0.smithi012.stdout:8/388: fsync d0/d62/f6b 0 2023-10-21T17:12:34.489 INFO:tasks.workunit.client.0.smithi012.stdout:8/389: dread - d0/d62/d83/f5e zero size 2023-10-21T17:12:34.489 INFO:tasks.workunit.client.0.smithi012.stdout:8/390: write d0/d62/f68 [714026,84664] 0 2023-10-21T17:12:34.489 INFO:tasks.workunit.client.0.smithi012.stdout:8/391: creat d0/d46/f85 x:0 0 0 2023-10-21T17:12:34.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/424: dwrite d2/d1d/d20/f2b [0,4194304] 0 2023-10-21T17:12:34.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/425: write d2/d4f/d59/d5b/f41 [2265290,58123] 0 2023-10-21T17:12:35.110 INFO:tasks.workunit.client.0.smithi012.stdout:3/406: mknod d0/d1c/c7a 0 2023-10-21T17:12:35.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:12:35.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:12:35.676 INFO:tasks.workunit.client.0.smithi012.stdout:4/476: unlink dc/d1e/d91/f94 0 2023-10-21T17:12:35.676 INFO:tasks.workunit.client.0.smithi012.stdout:4/477: chown dc/d1e/c8c 6498 1 2023-10-21T17:12:37.363 INFO:tasks.workunit.client.0.smithi012.stdout:6/444: unlink c12 0 2023-10-21T17:12:37.363 INFO:tasks.workunit.client.0.smithi012.stdout:6/445: fsync d13/d42/f8c 0 2023-10-21T17:12:37.488 INFO:tasks.workunit.client.0.smithi012.stdout:9/425: rename d0/d4/d4b/d6a/d12/d2a/d36 to d0/df/d8d 0 2023-10-21T17:12:37.890 INFO:tasks.workunit.client.0.smithi012.stdout:3/407: mknod d0/d32/d43/d47/c7b 0 2023-10-21T17:12:37.917 INFO:tasks.workunit.client.0.smithi012.stdout:4/478: rename dc/d1e/f5f to dc/d1e/f9f 0 2023-10-21T17:12:37.917 INFO:tasks.workunit.client.0.smithi012.stdout:4/479: chown dc/d28 793487 1 2023-10-21T17:12:37.978 INFO:tasks.workunit.client.0.smithi012.stdout:7/466: dwrite d3/d29/f27 [4194304,4194304] 0 2023-10-21T17:12:37.978 INFO:tasks.workunit.client.0.smithi012.stdout:7/467: creat d3/d64/f8a x:0 0 0 2023-10-21T17:12:38.306 INFO:tasks.workunit.client.0.smithi012.stdout:0/496: rename d7/d55/d23/d66/d48/f7e to d7/d55/d23/d66/da9/fba 0 2023-10-21T17:12:38.476 INFO:tasks.workunit.client.0.smithi012.stdout:3/408: unlink d0/d32/d43/l4b 0 2023-10-21T17:12:38.524 INFO:tasks.workunit.client.0.smithi012.stdout:3/409: read d0/f2b [2109174,61157] 0 2023-10-21T17:12:38.608 INFO:tasks.workunit.client.0.smithi012.stdout:8/392: dwrite d0/f32 [0,4194304] 0 2023-10-21T17:12:38.621 INFO:tasks.workunit.client.0.smithi012.stdout:4/480: rmdir dc/d15 39 2023-10-21T17:12:38.664 INFO:tasks.workunit.client.0.smithi012.stdout:4/481: read dc/d1e/d2b/f5c [2201093,6080] 0 2023-10-21T17:12:39.085 INFO:tasks.workunit.client.0.smithi012.stdout:2/523: rename d1/d14/d16/d22/da5/d50/d97 to d1/d14/d16/d22/da5/db7 0 2023-10-21T17:12:39.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/497: stat d7/d55/d23/d27/f5d 0 2023-10-21T17:12:39.228 INFO:tasks.workunit.client.0.smithi012.stdout:0/498: read d7/d55/f8b [215164,96990] 0 2023-10-21T17:12:39.367 INFO:tasks.workunit.client.0.smithi012.stdout:9/426: mkdir d0/d4/d4b/d6a/d12/d25/d39/d8e 0 2023-10-21T17:12:39.537 INFO:tasks.workunit.client.0.smithi012.stdout:3/410: symlink d0/d1c/d5e/l7c 0 2023-10-21T17:12:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:3/411: dread d0/f46 [0,4194304] 0 2023-10-21T17:12:39.676 INFO:tasks.workunit.client.0.smithi012.stdout:8/393: dread d0/fb [4194304,4194304] 0 2023-10-21T17:12:39.749 INFO:tasks.workunit.client.0.smithi012.stdout:4/482: rmdir dc/d15/d18/d4c/d55/d6c 39 2023-10-21T17:12:39.846 INFO:tasks.workunit.client.0.smithi012.stdout:4/483: dwrite dc/d15/d18/d57/f61 [0,4194304] 0 2023-10-21T17:12:39.853 INFO:tasks.workunit.client.0.smithi012.stdout:7/468: link d3/d6/dc/d19/d1e/l2f d3/d6/dc/d19/d43/l8b 0 2023-10-21T17:12:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:1/498: rename d5/d32/d1b/d35/d49/f57 to d5/d32/d1b/d27/d1a/d46/d4f/fac 0 2023-10-21T17:12:40.226 INFO:tasks.workunit.client.0.smithi012.stdout:2/524: mknod d1/d14/d16/d22/da5/db7/cb8 0 2023-10-21T17:12:40.589 INFO:tasks.workunit.client.0.smithi012.stdout:3/412: mknod d0/da/d28/c7d 0 2023-10-21T17:12:40.817 INFO:tasks.workunit.client.0.smithi012.stdout:8/394: symlink d0/d62/d7d/l86 0 2023-10-21T17:12:40.840 INFO:tasks.workunit.client.0.smithi012.stdout:4/484: mknod dc/d1e/d91/ca0 0 2023-10-21T17:12:40.866 INFO:tasks.workunit.client.0.smithi012.stdout:4/485: dread dc/d15/d18/f82 [0,4194304] 0 2023-10-21T17:12:41.048 INFO:tasks.workunit.client.0.smithi012.stdout:7/469: dread d3/d16/f50 [0,4194304] 0 2023-10-21T17:12:41.409 INFO:tasks.workunit.client.0.smithi012.stdout:1/499: creat d5/d32/d1b/d27/d1a/d46/fad x:0 0 0 2023-10-21T17:12:41.409 INFO:tasks.workunit.client.0.smithi012.stdout:1/500: readlink d5/d32/d1b/d27/l9d 0 2023-10-21T17:12:41.411 INFO:tasks.workunit.client.0.smithi012.stdout:5/426: sync 2023-10-21T17:12:41.415 INFO:tasks.workunit.client.0.smithi012.stdout:6/446: rename d13/d64/c6f to d13/d29/d77/c9a 0 2023-10-21T17:12:41.533 INFO:tasks.workunit.client.0.smithi012.stdout:2/525: mkdir d1/d14/d17/db9 0 2023-10-21T17:12:41.758 INFO:tasks.workunit.client.0.smithi012.stdout:9/427: getdents d0/d4/d4b/d6a/d12/d2a 0 2023-10-21T17:12:41.772 INFO:tasks.workunit.client.0.smithi012.stdout:3/413: dread d0/d32/d43/f6b [0,4194304] 0 2023-10-21T17:12:42.350 INFO:tasks.workunit.client.0.smithi012.stdout:4/486: creat dc/d15/d18/d4c/d55/d6c/fa1 x:0 0 0 2023-10-21T17:12:42.351 INFO:tasks.workunit.client.0.smithi012.stdout:4/487: chown dc/d1e/d2b 4330 1 2023-10-21T17:12:42.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/427: symlink d2/d4f/d59/d5b/d15/l92 0 2023-10-21T17:12:42.746 INFO:tasks.workunit.client.0.smithi012.stdout:5/428: dwrite d2/d4f/d7e/d87/d57/f5f [0,4194304] 0 2023-10-21T17:12:42.747 INFO:tasks.workunit.client.0.smithi012.stdout:5/429: chown d2/d4f/d59/d5b/d15/c3b 49 1 2023-10-21T17:12:42.747 INFO:tasks.workunit.client.0.smithi012.stdout:5/430: dread - d2/d4f/d59/f89 zero size 2023-10-21T17:12:42.747 INFO:tasks.workunit.client.0.smithi012.stdout:5/431: write d2/d4f/d7e/d87/d57/d66/f7f [5198472,28426] 0 2023-10-21T17:12:43.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/499: rename d7/d52/d53/l93 to d7/d55/d23/d66/d48/db7/lbb 0 2023-10-21T17:12:43.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/500: chown d7/d55/d23/d66 30 1 2023-10-21T17:12:43.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/501: getdents d7/d55/d23/d27/da1 0 2023-10-21T17:12:43.119 INFO:tasks.workunit.client.0.smithi012.stdout:6/447: mknod d13/d64/c9b 0 2023-10-21T17:12:43.120 INFO:tasks.workunit.client.0.smithi012.stdout:6/448: write d13/d35/d4c/f82 [833160,16156] 0 2023-10-21T17:12:43.182 INFO:tasks.workunit.client.0.smithi012.stdout:6/449: dwrite f8 [0,4194304] 0 2023-10-21T17:12:43.243 INFO:tasks.workunit.client.0.smithi012.stdout:2/526: unlink d1/d14/d16/d22/da5/db7/cb8 0 2023-10-21T17:12:43.522 INFO:tasks.workunit.client.0.smithi012.stdout:9/428: fdatasync d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 0 2023-10-21T17:12:44.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/488: mknod dc/d15/d18/d4c/d55/d6c/d83/ca2 0 2023-10-21T17:12:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:7/470: rename d3/d6/dc/l4f to d3/d6/dc/l8c 0 2023-10-21T17:12:44.508 INFO:tasks.workunit.client.0.smithi012.stdout:1/501: mkdir d5/d32/d62/dae 0 2023-10-21T17:12:44.596 INFO:tasks.workunit.client.0.smithi012.stdout:5/432: mkdir d2/d4f/d7e/d87/d93 0 2023-10-21T17:12:44.674 INFO:tasks.workunit.client.0.smithi012.stdout:5/433: dwrite d2/d6/f51 [4194304,4194304] 0 2023-10-21T17:12:45.021 INFO:tasks.workunit.client.0.smithi012.stdout:6/450: mknod d13/d42/d89/c9c 0 2023-10-21T17:12:45.044 INFO:tasks.workunit.client.0.smithi012.stdout:6/451: dread ff [0,4194304] 0 2023-10-21T17:12:45.044 INFO:tasks.workunit.client.0.smithi012.stdout:6/452: fdatasync d13/d15/d1d/f20 0 2023-10-21T17:12:45.044 INFO:tasks.workunit.client.0.smithi012.stdout:6/453: stat d13/d15/d1d/c1e 0 2023-10-21T17:12:45.216 INFO:tasks.workunit.client.0.smithi012.stdout:2/527: mknod d1/d14/d16/d22/da5/d50/da3/cba 0 2023-10-21T17:12:45.261 INFO:tasks.workunit.client.0.smithi012.stdout:2/528: dread d1/d8/f71 [0,4194304] 0 2023-10-21T17:12:45.346 INFO:tasks.workunit.client.0.smithi012.stdout:2/529: dwrite d1/d14/d16/d22/da5/d34/fb1 [0,4194304] 0 2023-10-21T17:12:45.365 INFO:tasks.workunit.client.0.smithi012.stdout:2/530: dread d1/fe [0,4194304] 0 2023-10-21T17:12:45.776 INFO:tasks.workunit.client.0.smithi012.stdout:9/429: mknod d0/d5/c8f 0 2023-10-21T17:12:46.080 INFO:tasks.workunit.client.0.smithi012.stdout:4/489: creat dc/d1e/d2b/fa3 x:0 0 0 2023-10-21T17:12:46.081 INFO:tasks.workunit.client.0.smithi012.stdout:7/471: mknod d3/d29/d7f/c8d 0 2023-10-21T17:12:46.107 INFO:tasks.workunit.client.0.smithi012.stdout:4/490: dread dc/d1e/d33/f52 [0,4194304] 0 2023-10-21T17:12:46.110 INFO:tasks.workunit.client.0.smithi012.stdout:8/395: write d0/d29/f3c [588721,48598] 0 2023-10-21T17:12:46.157 INFO:tasks.workunit.client.0.smithi012.stdout:8/396: read d0/f11 [3914398,73733] 0 2023-10-21T17:12:46.200 INFO:tasks.workunit.client.0.smithi012.stdout:4/491: dwrite dc/d15/d18/d4c/d55/f7f [0,4194304] 0 2023-10-21T17:12:46.200 INFO:tasks.workunit.client.0.smithi012.stdout:4/492: read dc/d1e/d33/f43 [1945905,120896] 0 2023-10-21T17:12:46.518 INFO:tasks.workunit.client.0.smithi012.stdout:1/502: link d5/d32/d1b/d35/d3a/d93/fa7 d5/d32/d1b/d35/d3a/d93/faf 0 2023-10-21T17:12:46.518 INFO:tasks.workunit.client.0.smithi012.stdout:1/503: chown d5/d26/d64/d8f/da0 1656588970 1 2023-10-21T17:12:46.519 INFO:tasks.workunit.client.0.smithi012.stdout:1/504: truncate d5/d32/d1b/d2c/d48/f74 4974630 0 2023-10-21T17:12:46.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/454: rmdir d13/d29/d37 39 2023-10-21T17:12:47.742 INFO:tasks.workunit.client.0.smithi012.stdout:7/472: mkdir d3/d6/d73/d8e 0 2023-10-21T17:12:47.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/397: read d0/f17 [1232793,64648] 0 2023-10-21T17:12:47.806 INFO:tasks.workunit.client.0.smithi012.stdout:4/493: symlink dc/d1e/d65/la4 0 2023-10-21T17:12:47.834 INFO:tasks.workunit.client.0.smithi012.stdout:4/494: dread dc/d15/f80 [0,4194304] 0 2023-10-21T17:12:47.992 INFO:tasks.workunit.client.0.smithi012.stdout:3/414: write d0/da/f26 [899152,113702] 0 2023-10-21T17:12:47.992 INFO:tasks.workunit.client.0.smithi012.stdout:3/415: stat d0/da/d28/c6c 0 2023-10-21T17:12:47.992 INFO:tasks.workunit.client.0.smithi012.stdout:3/416: write d0/da/d28/f77 [840131,91339] 0 2023-10-21T17:12:48.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/455: link d13/d35/l6b d13/d15/d1d/d5d/d66/l9d 0 2023-10-21T17:12:48.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/456: creat d13/d35/d4c/f9e x:0 0 0 2023-10-21T17:12:48.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/457: write d13/d15/d1d/d24/f8e [932270,9147] 0 2023-10-21T17:12:48.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/458: stat d13/d15/d1d/d28/d5b/f68 0 2023-10-21T17:12:48.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/459: chown d13/d64/c9b 37 1 2023-10-21T17:12:48.718 INFO:tasks.workunit.client.0.smithi012.stdout:9/430: symlink d0/d4/d4b/l90 0 2023-10-21T17:12:48.837 INFO:tasks.workunit.client.0.smithi012.stdout:7/473: symlink d3/d6/dc/d19/d28/l8f 0 2023-10-21T17:12:48.838 INFO:tasks.workunit.client.0.smithi012.stdout:7/474: creat d3/d6/dc/d19/d28/f90 x:0 0 0 2023-10-21T17:12:49.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/495: creat dc/d15/d18/d4c/d55/d6c/d77/fa5 x:0 0 0 2023-10-21T17:12:49.688 INFO:tasks.workunit.client.0.smithi012.stdout:3/417: mknod d0/da/d28/c7e 0 2023-10-21T17:12:49.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/502: dwrite d7/d55/d23/d66/d48/f61 [0,4194304] 0 2023-10-21T17:12:49.774 INFO:tasks.workunit.client.0.smithi012.stdout:3/418: dwrite d0/d1c/f5a [0,4194304] 0 2023-10-21T17:12:50.013 INFO:tasks.workunit.client.0.smithi012.stdout:9/431: rmdir d0/d5 39 2023-10-21T17:12:50.283 INFO:tasks.workunit.client.0.smithi012.stdout:7/475: truncate d3/d16/f56 2212637 0 2023-10-21T17:12:50.389 INFO:tasks.workunit.client.0.smithi012.stdout:4/496: getdents dc/d15/d18/d4c/d55/d6c/d83 0 2023-10-21T17:12:50.475 INFO:tasks.workunit.client.0.smithi012.stdout:4/497: dwrite dc/d15/f32 [0,4194304] 0 2023-10-21T17:12:50.477 INFO:tasks.workunit.client.0.smithi012.stdout:4/498: write dc/d1e/d33/f52 [46348,104094] 0 2023-10-21T17:12:51.326 INFO:tasks.workunit.client.0.smithi012.stdout:5/434: write d2/d2c/f7a [1253845,94643] 0 2023-10-21T17:12:51.459 INFO:tasks.workunit.client.0.smithi012.stdout:9/432: getdents d0 0 2023-10-21T17:12:51.772 INFO:tasks.workunit.client.0.smithi012.stdout:7/476: mknod d3/d6/d73/d8e/c91 0 2023-10-21T17:12:51.773 INFO:tasks.workunit.client.0.smithi012.stdout:7/477: readlink d3/d6/dc/d19/l77 0 2023-10-21T17:12:52.049 INFO:tasks.workunit.client.0.smithi012.stdout:4/499: symlink dc/d1e/la6 0 2023-10-21T17:12:52.110 INFO:tasks.workunit.client.0.smithi012.stdout:0/503: getdents d7/d52/d53 0 2023-10-21T17:12:52.110 INFO:tasks.workunit.client.0.smithi012.stdout:0/504: stat d7/d55/fb3 0 2023-10-21T17:12:52.214 INFO:tasks.workunit.client.0.smithi012.stdout:0/505: dwrite d7/d52/d53/f75 [0,4194304] 0 2023-10-21T17:12:52.214 INFO:tasks.workunit.client.0.smithi012.stdout:0/506: write d7/f98 [282787,45189] 0 2023-10-21T17:12:52.214 INFO:tasks.workunit.client.0.smithi012.stdout:0/507: chown d7/d55/d23/d66 0 1 2023-10-21T17:12:52.860 INFO:tasks.workunit.client.0.smithi012.stdout:7/478: mknod d3/d16/c92 0 2023-10-21T17:12:52.860 INFO:tasks.workunit.client.0.smithi012.stdout:4/500: mkdir dc/d1e/da7 0 2023-10-21T17:12:52.861 INFO:tasks.workunit.client.0.smithi012.stdout:4/501: write dc/d15/d18/d4c/d55/d6c/fa1 [376611,120675] 0 2023-10-21T17:12:52.861 INFO:tasks.workunit.client.0.smithi012.stdout:4/502: readlink dc/d15/d2a/l69 0 2023-10-21T17:12:52.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/531: sync 2023-10-21T17:12:52.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/532: dread - d1/d8/d25/f42 zero size 2023-10-21T17:12:52.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/533: creat d1/d14/d16/d22/da5/d34/fbb x:0 0 0 2023-10-21T17:12:52.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/534: readlink d1/d14/d16/l8d 0 2023-10-21T17:12:52.968 INFO:tasks.workunit.client.0.smithi012.stdout:7/479: dwrite d3/d6/dc/d19/f57 [0,4194304] 0 2023-10-21T17:12:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:7/480: dwrite d3/d29/f11 [0,4194304] 0 2023-10-21T17:12:53.072 INFO:tasks.workunit.client.0.smithi012.stdout:7/481: dread d3/d6/f66 [0,4194304] 0 2023-10-21T17:12:53.290 INFO:tasks.workunit.client.0.smithi012.stdout:6/460: getdents d13/d29/d37/d3b 0 2023-10-21T17:12:53.306 INFO:tasks.workunit.client.0.smithi012.stdout:6/461: dread d13/d15/f1a [0,4194304] 0 2023-10-21T17:12:53.306 INFO:tasks.workunit.client.0.smithi012.stdout:6/462: dread - d13/d29/d78/f99 zero size 2023-10-21T17:12:53.447 INFO:tasks.workunit.client.0.smithi012.stdout:4/503: symlink dc/d93/la8 0 2023-10-21T17:12:53.447 INFO:tasks.workunit.client.0.smithi012.stdout:4/504: truncate dc/d15/f6f 1048079 0 2023-10-21T17:12:53.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/505: dread dc/d1e/d65/f68 [0,4194304] 0 2023-10-21T17:12:53.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/506: write dc/d93/f46 [3002348,55907] 0 2023-10-21T17:12:53.605 INFO:tasks.workunit.client.0.smithi012.stdout:2/535: creat d1/d14/d16/d22/da5/d50/da3/fbc x:0 0 0 2023-10-21T17:12:53.637 INFO:tasks.workunit.client.0.smithi012.stdout:2/536: write d1/f1a [3890440,79428] 0 2023-10-21T17:12:53.800 INFO:tasks.workunit.client.0.smithi012.stdout:1/505: sync 2023-10-21T17:12:53.800 INFO:tasks.workunit.client.0.smithi012.stdout:1/506: chown d5/d32/d1b/d35/d49/d69/l6d 18093032 1 2023-10-21T17:12:54.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/482: truncate d3/d6/dc/f54 415339 0 2023-10-21T17:12:54.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/483: chown d3/d29/f45 15703574 1 2023-10-21T17:12:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:4/507: mkdir dc/d15/d2a/da9 0 2023-10-21T17:12:54.438 INFO:tasks.workunit.client.0.smithi012.stdout:2/537: symlink d1/d4/d93/lbd 0 2023-10-21T17:12:54.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/507: unlink d5/d26/d54/l97 0 2023-10-21T17:12:54.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/508: chown d5/d32/d1b/d35/faa 242038640 1 2023-10-21T17:12:54.502 INFO:tasks.workunit.client.0.smithi012.stdout:1/509: fdatasync d5/d32/d1b/d35/f3f 0 2023-10-21T17:12:54.685 INFO:tasks.workunit.client.0.smithi012.stdout:6/463: mkdir d13/d15/d1d/d24/d9f 0 2023-10-21T17:12:54.750 INFO:tasks.workunit.client.0.smithi012.stdout:8/398: dwrite d0/f4c [0,4194304] 0 2023-10-21T17:12:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:1/510: mknod d5/d32/cb0 0 2023-10-21T17:12:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:1/511: chown d5/d32/d1b/d27/d1a/d46/d4f/fa6 1154846 1 2023-10-21T17:12:55.784 INFO:tasks.workunit.client.0.smithi012.stdout:4/508: rename dc/d28/l29 to dc/d15/d2a/da9/laa 0 2023-10-21T17:12:55.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/512: link d5/d32/d1b/d35/d3a/d5c/c9c d5/cb1 0 2023-10-21T17:12:55.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/513: dread d5/d32/d1b/d27/d1a/d46/f88 [0,4194304] 0 2023-10-21T17:12:56.710 INFO:tasks.workunit.client.0.smithi012.stdout:8/399: rename d0/d12/f31 to d0/d29/f87 0 2023-10-21T17:12:56.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/419: sync 2023-10-21T17:12:56.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/420: write d0/d1c/f60 [4578165,48108] 0 2023-10-21T17:12:56.757 INFO:tasks.workunit.client.0.smithi012.stdout:3/421: readlink d0/da/l10 0 2023-10-21T17:12:57.112 INFO:tasks.workunit.client.0.smithi012.stdout:4/509: unlink dc/d15/d2a/d31/l62 0 2023-10-21T17:12:57.291 INFO:tasks.workunit.client.0.smithi012.stdout:1/514: truncate d5/d32/d1b/d27/d21/f31 1299636 0 2023-10-21T17:12:57.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/515: readlink d5/d32/l52 0 2023-10-21T17:12:57.790 INFO:tasks.workunit.client.0.smithi012.stdout:8/400: mknod d0/d46/c88 0 2023-10-21T17:12:58.101 INFO:tasks.workunit.client.0.smithi012.stdout:4/510: mknod dc/d1e/d33/cab 0 2023-10-21T17:12:58.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/401: link d0/d12/l18 d0/d62/d83/l89 0 2023-10-21T17:12:58.378 INFO:tasks.workunit.client.0.smithi012.stdout:8/402: dread d0/d12/f22 [0,4194304] 0 2023-10-21T17:12:58.412 INFO:tasks.workunit.client.0.smithi012.stdout:9/433: dwrite d0/d4/d4b/d6a/d12/d2a/f87 [0,4194304] 0 2023-10-21T17:12:58.743 INFO:tasks.workunit.client.0.smithi012.stdout:5/435: rmdir d2/d4f/d7e/d87 39 2023-10-21T17:12:59.217 INFO:tasks.workunit.client.0.smithi012.stdout:0/508: creat d7/fbc x:0 0 0 2023-10-21T17:12:59.218 INFO:tasks.workunit.client.0.smithi012.stdout:0/509: getdents d7/d55/d23/d27/da1 0 2023-10-21T17:12:59.304 INFO:tasks.workunit.client.0.smithi012.stdout:2/538: dwrite d1/d14/d16/d22/d82/d86/fa0 [0,4194304] 0 2023-10-21T17:12:59.467 INFO:tasks.workunit.client.0.smithi012.stdout:9/434: rename d0/d4/d4b/d6a/d12/d2a/f3a to d0/d4/d4b/d6a/d12/d25/d39/d8e/f91 0 2023-10-21T17:12:59.467 INFO:tasks.workunit.client.0.smithi012.stdout:9/435: chown d0/d4/d4b/d6a/d89 202131 1 2023-10-21T17:12:59.508 INFO:tasks.workunit.client.0.smithi012.stdout:9/436: write d0/d4/d4b/d6a/d12/d2a/f87 [1159837,65343] 0 2023-10-21T17:12:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:9/437: fdatasync d0/d4/d4b/d6a/d12/d25/d39/d3b/f3f 0 2023-10-21T17:12:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:8/403: mknod d0/d1a/d54/c8a 0 2023-10-21T17:12:59.716 INFO:tasks.workunit.client.0.smithi012.stdout:8/404: creat d0/d1a/d54/f8b x:0 0 0 2023-10-21T17:12:59.736 INFO:tasks.workunit.client.0.smithi012.stdout:6/464: dwrite d13/d15/f33 [0,4194304] 0 2023-10-21T17:12:59.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/465: dwrite d13/d35/d4c/f82 [0,4194304] 0 2023-10-21T17:12:59.817 INFO:tasks.workunit.client.0.smithi012.stdout:6/466: read d13/d15/d1d/f20 [105713,95911] 0 2023-10-21T17:12:59.818 INFO:tasks.workunit.client.0.smithi012.stdout:6/467: fsync d13/d64/d6d/f86 0 2023-10-21T17:12:59.836 INFO:tasks.workunit.client.0.smithi012.stdout:0/510: mkdir d7/dbd 0 2023-10-21T17:13:00.264 INFO:tasks.workunit.client.0.smithi012.stdout:2/539: dread - d1/d4/d3f/d41/d59/fb5 zero size 2023-10-21T17:13:02.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/511: rename d7/d55/d23/d27/d31/d3d/f6e to d7/d52/d90/fbe 0 2023-10-21T17:13:02.941 INFO:tasks.workunit.client.0.smithi012.stdout:0/512: mknod d7/d55/d23/d66/da8/cbf 0 2023-10-21T17:13:03.197 INFO:tasks.workunit.client.0.smithi012.stdout:3/422: write d0/da/d28/f38 [938787,88242] 0 2023-10-21T17:13:03.266 INFO:tasks.workunit.client.0.smithi012.stdout:3/423: dwrite d0/d32/d43/d47/d50/d52/f76 [0,4194304] 0 2023-10-21T17:13:03.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/424: dread d0/da/d28/f2c [0,4194304] 0 2023-10-21T17:13:03.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/436: creat d2/d4f/f94 x:0 0 0 2023-10-21T17:13:03.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/437: creat d2/d6/f95 x:0 0 0 2023-10-21T17:13:03.680 INFO:tasks.workunit.client.0.smithi012.stdout:4/511: dwrite dc/d15/d18/d4c/d75/f7c [0,4194304] 0 2023-10-21T17:13:03.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/512: dwrite dc/d15/f5e [0,4194304] 0 2023-10-21T17:13:03.815 INFO:tasks.workunit.client.0.smithi012.stdout:0/513: symlink d7/d55/lc0 0 2023-10-21T17:13:03.914 INFO:tasks.workunit.client.0.smithi012.stdout:0/514: dwrite d7/d55/f24 [0,4194304] 0 2023-10-21T17:13:04.392 INFO:tasks.workunit.client.0.smithi012.stdout:3/425: getdents d0/d32/d43/d47/d50 0 2023-10-21T17:13:04.477 INFO:tasks.workunit.client.0.smithi012.stdout:3/426: dwrite d0/d32/d43/d47/d50/d52/f76 [0,4194304] 0 2023-10-21T17:13:04.921 INFO:tasks.workunit.client.0.smithi012.stdout:6/468: write d13/d15/d1d/d5d/d66/f79 [574178,58801] 0 2023-10-21T17:13:04.922 INFO:tasks.workunit.client.0.smithi012.stdout:5/438: truncate d2/d4f/d7e/d87/d57/d66/f81 1048259 0 2023-10-21T17:13:05.219 INFO:tasks.workunit.client.0.smithi012.stdout:0/515: truncate d7/f36 751632 0 2023-10-21T17:13:05.220 INFO:tasks.workunit.client.0.smithi012.stdout:1/516: creat d5/d32/d1b/d35/fb2 x:0 0 0 2023-10-21T17:13:05.458 INFO:tasks.workunit.client.0.smithi012.stdout:7/484: mknod d3/d6/c93 0 2023-10-21T17:13:05.459 INFO:tasks.workunit.client.0.smithi012.stdout:3/427: rename d0/l4d to d0/d32/d43/l7f 0 2023-10-21T17:13:05.549 INFO:tasks.workunit.client.0.smithi012.stdout:9/438: write d0/d4/d4b/d6a/d12/d25/d39/d8e/f91 [3721408,54761] 0 2023-10-21T17:13:05.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/439: dwrite d0/d4/d4b/d6a/d12/d25/f37 [0,4194304] 0 2023-10-21T17:13:05.638 INFO:tasks.workunit.client.0.smithi012.stdout:9/440: creat d0/d15/f92 x:0 0 0 2023-10-21T17:13:05.676 INFO:tasks.workunit.client.0.smithi012.stdout:9/441: dread d0/f1b [0,4194304] 0 2023-10-21T17:13:05.676 INFO:tasks.workunit.client.0.smithi012.stdout:9/442: fsync d0/d4/d4b/d6a/d12/d25/d39/d3b/f3f 0 2023-10-21T17:13:05.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/443: write d0/f3e [4663500,117396] 0 2023-10-21T17:13:05.678 INFO:tasks.workunit.client.0.smithi012.stdout:9/444: write d0/d15/f57 [740200,75738] 0 2023-10-21T17:13:05.683 INFO:tasks.workunit.client.0.smithi012.stdout:6/469: read d13/d29/d37/f44 [11450,112670] 0 2023-10-21T17:13:05.714 INFO:tasks.workunit.client.0.smithi012.stdout:9/445: write d0/d4/d4b/d6a/d12/f48 [4076926,12246] 0 2023-10-21T17:13:05.725 INFO:tasks.workunit.client.0.smithi012.stdout:6/470: dread d13/d29/d37/d3b/f57 [0,4194304] 0 2023-10-21T17:13:05.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:13:05.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:13:05.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/439: mkdir d2/d2c/d73/d49/d96 0 2023-10-21T17:13:06.062 INFO:tasks.workunit.client.0.smithi012.stdout:1/517: getdents d5/d26 0 2023-10-21T17:13:06.063 INFO:tasks.workunit.client.0.smithi012.stdout:1/518: creat d5/d32/d1b/d35/fb3 x:0 0 0 2023-10-21T17:13:06.063 INFO:tasks.workunit.client.0.smithi012.stdout:1/519: dread - d5/d32/d1b/d35/d49/d69/f9b zero size 2023-10-21T17:13:06.063 INFO:tasks.workunit.client.0.smithi012.stdout:1/520: readlink d5/d32/d1b/l25 0 2023-10-21T17:13:06.113 INFO:tasks.workunit.client.0.smithi012.stdout:7/485: symlink d3/d6/d73/d8e/l94 0 2023-10-21T17:13:06.113 INFO:tasks.workunit.client.0.smithi012.stdout:7/486: chown d3/d29/d7f/c8d 26822 1 2023-10-21T17:13:06.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/428: mkdir d0/d32/d43/d80 0 2023-10-21T17:13:06.791 INFO:tasks.workunit.client.0.smithi012.stdout:9/446: link d0/d4/d4b/l4d d0/d4/d4b/d6a/d12/d25/d39/d3b/l93 0 2023-10-21T17:13:06.935 INFO:tasks.workunit.client.0.smithi012.stdout:6/471: rmdir d13/d29/d37/d3b 39 2023-10-21T17:13:06.936 INFO:tasks.workunit.client.0.smithi012.stdout:5/440: link d2/d1d/d4e/c86 d2/d2c/c97 0 2023-10-21T17:13:07.235 INFO:tasks.workunit.client.0.smithi012.stdout:1/521: rename d5/d32/d1b/d27/d1a/d46/f88 to d5/d30/d51/fb4 0 2023-10-21T17:13:07.236 INFO:tasks.workunit.client.0.smithi012.stdout:1/522: fsync d5/d32/d1b/d2c/d4b/f70 0 2023-10-21T17:13:07.585 INFO:tasks.workunit.client.0.smithi012.stdout:7/487: mknod d3/d6/c95 0 2023-10-21T17:13:07.585 INFO:tasks.workunit.client.0.smithi012.stdout:3/429: rename d0/d32/d43/c44 to d0/d32/d43/c81 0 2023-10-21T17:13:07.894 INFO:tasks.workunit.client.0.smithi012.stdout:4/513: rmdir dc/d6b 39 2023-10-21T17:13:08.074 INFO:tasks.workunit.client.0.smithi012.stdout:5/441: mkdir d2/d4f/d7e/d87/d98 0 2023-10-21T17:13:08.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/447: rename d0/df/f43 to d0/df/d8d/d8a/f94 0 2023-10-21T17:13:08.972 INFO:tasks.workunit.client.0.smithi012.stdout:0/516: creat d7/d52/fc1 x:0 0 0 2023-10-21T17:13:09.509 INFO:tasks.workunit.client.0.smithi012.stdout:2/540: sync 2023-10-21T17:13:09.509 INFO:tasks.workunit.client.0.smithi012.stdout:8/405: sync 2023-10-21T17:13:09.565 INFO:tasks.workunit.client.0.smithi012.stdout:8/406: dwrite d0/d29/d79/f81 [0,4194304] 0 2023-10-21T17:13:09.566 INFO:tasks.workunit.client.0.smithi012.stdout:8/407: fdatasync d0/f27 0 2023-10-21T17:13:09.566 INFO:tasks.workunit.client.0.smithi012.stdout:8/408: truncate d0/d12/d40/f60 29388 0 2023-10-21T17:13:09.722 INFO:tasks.workunit.client.0.smithi012.stdout:4/514: truncate dc/d15/d2a/d31/f49 761677 0 2023-10-21T17:13:09.915 INFO:tasks.workunit.client.0.smithi012.stdout:5/442: mknod d2/d4f/d7e/d87/d57/c99 0 2023-10-21T17:13:10.420 INFO:tasks.workunit.client.0.smithi012.stdout:0/517: symlink d7/d55/d23/d66/d82/d8d/lc2 0 2023-10-21T17:13:10.586 INFO:tasks.workunit.client.0.smithi012.stdout:2/541: mkdir d1/d14/d16/d22/da5/dbe 0 2023-10-21T17:13:11.520 INFO:tasks.workunit.client.0.smithi012.stdout:4/515: truncate dc/d1e/f3e 1193621 0 2023-10-21T17:13:11.834 INFO:tasks.workunit.client.0.smithi012.stdout:2/542: symlink d1/d14/d16/d22/d82/d86/lbf 0 2023-10-21T17:13:11.835 INFO:tasks.workunit.client.0.smithi012.stdout:2/543: write d1/d8/f7c [796642,102597] 0 2023-10-21T17:13:11.835 INFO:tasks.workunit.client.0.smithi012.stdout:2/544: creat d1/d95/fc0 x:0 0 0 2023-10-21T17:13:11.835 INFO:tasks.workunit.client.0.smithi012.stdout:2/545: fsync d1/d14/d16/d58/f66 0 2023-10-21T17:13:11.930 INFO:tasks.workunit.client.0.smithi012.stdout:8/409: unlink d0/l48 0 2023-10-21T17:13:12.250 INFO:tasks.workunit.client.0.smithi012.stdout:4/516: creat dc/d15/d18/d4c/d75/fac x:0 0 0 2023-10-21T17:13:12.279 INFO:tasks.workunit.client.0.smithi012.stdout:4/517: dread dc/d15/d18/d4c/d75/f7c [0,4194304] 0 2023-10-21T17:13:12.279 INFO:tasks.workunit.client.0.smithi012.stdout:4/518: fdatasync dc/d15/f5e 0 2023-10-21T17:13:12.475 INFO:tasks.workunit.client.0.smithi012.stdout:2/546: unlink d1/d8/l96 0 2023-10-21T17:13:12.517 INFO:tasks.workunit.client.0.smithi012.stdout:2/547: dread d1/d14/d17/f98 [0,4194304] 0 2023-10-21T17:13:12.637 INFO:tasks.workunit.client.0.smithi012.stdout:8/410: creat d0/d12/d80/d71/f8c x:0 0 0 2023-10-21T17:13:12.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/411: truncate d0/d1a/d54/f8b 371167 0 2023-10-21T17:13:12.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/412: creat d0/d62/f8d x:0 0 0 2023-10-21T17:13:12.835 INFO:tasks.workunit.client.0.smithi012.stdout:4/519: truncate dc/d15/d2a/f78 562157 0 2023-10-21T17:13:13.106 INFO:tasks.workunit.client.0.smithi012.stdout:2/548: creat d1/d14/d16/d22/da5/d50/da3/da9/fc1 x:0 0 0 2023-10-21T17:13:13.194 INFO:tasks.workunit.client.0.smithi012.stdout:2/549: dwrite d1/d8/f10 [4194304,4194304] 0 2023-10-21T17:13:13.523 INFO:tasks.workunit.client.0.smithi012.stdout:4/520: unlink dc/d15/d2a/d31/l79 0 2023-10-21T17:13:13.875 INFO:tasks.workunit.client.0.smithi012.stdout:2/550: unlink d1/l83 0 2023-10-21T17:13:14.052 INFO:tasks.workunit.client.0.smithi012.stdout:4/521: creat dc/d1e/fad x:0 0 0 2023-10-21T17:13:14.130 INFO:tasks.workunit.client.0.smithi012.stdout:4/522: dwrite dc/d93/f46 [0,4194304] 0 2023-10-21T17:13:14.191 INFO:tasks.workunit.client.0.smithi012.stdout:2/551: mkdir d1/d14/d16/d22/da5/d34/dc2 0 2023-10-21T17:13:14.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/523: dwrite dc/d15/d2a/d31/f87 [0,4194304] 0 2023-10-21T17:13:14.478 INFO:tasks.workunit.client.0.smithi012.stdout:2/552: unlink d1/d14/d16/d58/l6b 0 2023-10-21T17:13:14.915 INFO:tasks.workunit.client.0.smithi012.stdout:1/523: sync 2023-10-21T17:13:14.968 INFO:tasks.workunit.client.0.smithi012.stdout:7/488: dwrite d3/d29/f27 [0,4194304] 0 2023-10-21T17:13:15.015 INFO:tasks.workunit.client.0.smithi012.stdout:1/524: dwrite d5/d32/d1b/d2c/d4b/f70 [0,4194304] 0 2023-10-21T17:13:15.455 INFO:tasks.workunit.client.0.smithi012.stdout:4/524: getdents dc/d15/d18/d4c/d55/d6c 0 2023-10-21T17:13:15.458 INFO:tasks.workunit.client.0.smithi012.stdout:7/489: symlink d3/d6/dc/d19/d1e/d7b/l96 0 2023-10-21T17:13:15.535 INFO:tasks.workunit.client.0.smithi012.stdout:7/490: dwrite d3/d6/dc/d19/f57 [0,4194304] 0 2023-10-21T17:13:15.535 INFO:tasks.workunit.client.0.smithi012.stdout:7/491: fdatasync d3/d29/f7d 0 2023-10-21T17:13:16.145 INFO:tasks.workunit.client.0.smithi012.stdout:1/525: rmdir d5/d32/d1b/d35/d49 39 2023-10-21T17:13:16.208 INFO:tasks.workunit.client.0.smithi012.stdout:4/525: mknod dc/d1e/d33/cae 0 2023-10-21T17:13:16.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/526: creat d5/d30/da9/fb5 x:0 0 0 2023-10-21T17:13:16.790 INFO:tasks.workunit.client.0.smithi012.stdout:1/527: chown d5/d26/f2f 197818 1 2023-10-21T17:13:17.019 INFO:tasks.workunit.client.0.smithi012.stdout:4/526: link dc/d15/d18/d4c/d55/d6c/d77/c8b dc/d1e/d33/caf 0 2023-10-21T17:13:17.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/528: rmdir d5/d32/d1b/d35/d3a 39 2023-10-21T17:13:17.759 INFO:tasks.workunit.client.0.smithi012.stdout:6/472: rename l0 to d13/d15/d1d/d5d/la0 0 2023-10-21T17:13:17.780 INFO:tasks.workunit.client.0.smithi012.stdout:4/527: creat dc/d93/d99/fb0 x:0 0 0 2023-10-21T17:13:17.780 INFO:tasks.workunit.client.0.smithi012.stdout:4/528: write dc/f25 [4514973,79562] 0 2023-10-21T17:13:17.781 INFO:tasks.workunit.client.0.smithi012.stdout:4/529: creat dc/d15/d18/d4c/d55/fb1 x:0 0 0 2023-10-21T17:13:17.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/473: dread d13/d29/d37/f44 [0,4194304] 0 2023-10-21T17:13:17.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/474: read d13/d35/f3a [3144599,105344] 0 2023-10-21T17:13:17.794 INFO:tasks.workunit.client.0.smithi012.stdout:6/475: write ff [369631,73071] 0 2023-10-21T17:13:17.795 INFO:tasks.workunit.client.0.smithi012.stdout:6/476: dread - d13/d64/d6d/f83 zero size 2023-10-21T17:13:18.351 INFO:tasks.workunit.client.0.smithi012.stdout:1/529: getdents d5 0 2023-10-21T17:13:18.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/530: dread - d5/d32/d1b/d35/d3a/d93/fa7 zero size 2023-10-21T17:13:18.691 INFO:tasks.workunit.client.0.smithi012.stdout:6/477: symlink d13/d15/d1d/d5d/la1 0 2023-10-21T17:13:19.494 INFO:tasks.workunit.client.0.smithi012.stdout:1/531: creat d5/d26/da3/fb6 x:0 0 0 2023-10-21T17:13:19.707 INFO:tasks.workunit.client.0.smithi012.stdout:3/430: rename d0/d32/d43/d80 to d0/d82 0 2023-10-21T17:13:20.026 INFO:tasks.workunit.client.0.smithi012.stdout:6/478: symlink d13/d35/d4c/la2 0 2023-10-21T17:13:20.026 INFO:tasks.workunit.client.0.smithi012.stdout:1/532: mkdir d5/d32/d1b/d35/d3a/d5c/d7c/db7 0 2023-10-21T17:13:20.027 INFO:tasks.workunit.client.0.smithi012.stdout:1/533: fdatasync d5/d32/d1b/d35/f3f 0 2023-10-21T17:13:20.103 INFO:tasks.workunit.client.0.smithi012.stdout:1/534: dwrite d5/d26/d54/f65 [0,4194304] 0 2023-10-21T17:13:20.103 INFO:tasks.workunit.client.0.smithi012.stdout:6/479: dwrite d13/d15/d1d/d5d/d66/d7a/f87 [0,4194304] 0 2023-10-21T17:13:20.426 INFO:tasks.workunit.client.0.smithi012.stdout:0/518: sync 2023-10-21T17:13:20.426 INFO:tasks.workunit.client.0.smithi012.stdout:0/519: stat d7/d55/d23/f8e 0 2023-10-21T17:13:20.427 INFO:tasks.workunit.client.0.smithi012.stdout:0/520: fdatasync d7/d55/d23/d27/f5d 0 2023-10-21T17:13:21.293 INFO:tasks.workunit.client.0.smithi012.stdout:1/535: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/fb8 x:0 0 0 2023-10-21T17:13:21.293 INFO:tasks.workunit.client.0.smithi012.stdout:9/448: rename d0/d5/l7d to d0/df/l95 0 2023-10-21T17:13:21.312 INFO:tasks.workunit.client.0.smithi012.stdout:0/521: creat d7/dbd/fc3 x:0 0 0 2023-10-21T17:13:21.345 INFO:tasks.workunit.client.0.smithi012.stdout:9/449: write d0/d4/d4b/d6a/d12/d25/d2f/f62 [1004328,99995] 0 2023-10-21T17:13:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/450: dread - d0/f85 zero size 2023-10-21T17:13:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/451: write d0/d15/f88 [574111,41540] 0 2023-10-21T17:13:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/452: chown d0/d5/l28 186 1 2023-10-21T17:13:21.346 INFO:tasks.workunit.client.0.smithi012.stdout:9/453: dread - d0/d4/d4b/d6a/d12/d25/d39/d3b/f81 zero size 2023-10-21T17:13:21.359 INFO:tasks.workunit.client.0.smithi012.stdout:1/536: dwrite d5/d32/d1b/d35/d3a/d93/fa7 [0,4194304] 0 2023-10-21T17:13:21.379 INFO:tasks.workunit.client.0.smithi012.stdout:9/454: write d0/d4/d4b/d6a/d12/d25/f71 [4270858,99164] 0 2023-10-21T17:13:21.700 INFO:tasks.workunit.client.0.smithi012.stdout:6/480: symlink d13/d15/d1d/d24/la3 0 2023-10-21T17:13:21.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/481: write d13/d15/d1d/d5d/d66/f79 [123860,93170] 0 2023-10-21T17:13:21.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/482: getdents d13/d15/d1d/d28/d5b/d75 0 2023-10-21T17:13:21.730 INFO:tasks.workunit.client.0.smithi012.stdout:6/483: dread d13/f14 [0,4194304] 0 2023-10-21T17:13:21.730 INFO:tasks.workunit.client.0.smithi012.stdout:6/484: chown d13/d15/d1d/c2c 9 1 2023-10-21T17:13:21.730 INFO:tasks.workunit.client.0.smithi012.stdout:6/485: creat d13/d29/d78/fa4 x:0 0 0 2023-10-21T17:13:21.817 INFO:tasks.workunit.client.0.smithi012.stdout:5/443: rename d2/d2c/f42 to d2/d4f/d7e/d87/d57/d66/f9a 0 2023-10-21T17:13:21.964 INFO:tasks.workunit.client.0.smithi012.stdout:0/522: link d7/d55/ff d7/d81/fc4 0 2023-10-21T17:13:22.401 INFO:tasks.workunit.client.0.smithi012.stdout:1/537: mkdir d5/d30/da9/db9 0 2023-10-21T17:13:22.824 INFO:tasks.workunit.client.0.smithi012.stdout:8/413: rename d0/d12/f22 to d0/d62/d83/d72/f8e 0 2023-10-21T17:13:22.824 INFO:tasks.workunit.client.0.smithi012.stdout:8/414: chown d0/d1a/l7e 62425 1 2023-10-21T17:13:22.962 INFO:tasks.workunit.client.0.smithi012.stdout:5/444: creat d2/d4f/d7e/d87/d57/f9b x:0 0 0 2023-10-21T17:13:23.475 INFO:tasks.workunit.client.0.smithi012.stdout:1/538: mknod d5/d32/d1b/d2c/d4b/cba 0 2023-10-21T17:13:23.543 INFO:tasks.workunit.client.0.smithi012.stdout:9/455: symlink d0/d4/d4b/l96 0 2023-10-21T17:13:23.544 INFO:tasks.workunit.client.0.smithi012.stdout:9/456: truncate d0/d15/f57 1567751 0 2023-10-21T17:13:23.762 INFO:tasks.workunit.client.0.smithi012.stdout:6/486: unlink d13/d29/d78/fa4 0 2023-10-21T17:13:23.763 INFO:tasks.workunit.client.0.smithi012.stdout:6/487: fsync d13/d64/d6d/f83 0 2023-10-21T17:13:24.092 INFO:tasks.workunit.client.0.smithi012.stdout:2/553: rename d1/d14/d16/d20/f2e to d1/d4/d65/fc3 0 2023-10-21T17:13:24.092 INFO:tasks.workunit.client.0.smithi012.stdout:7/492: rename d3/d6/dc/d19 to d3/d6/dc/d19/d1e/d7b/d97 22 2023-10-21T17:13:24.093 INFO:tasks.workunit.client.0.smithi012.stdout:4/530: rename dc/d15/d18/d4c/d55/d6c to dc/d15/d18/d4c/d55/d6c/d83/db2 22 2023-10-21T17:13:24.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/493: chown d3/d16/c1c 16098513 1 2023-10-21T17:13:24.368 INFO:tasks.workunit.client.0.smithi012.stdout:5/445: mknod d2/d2c/d8c/c9c 0 2023-10-21T17:13:24.368 INFO:tasks.workunit.client.0.smithi012.stdout:0/523: symlink d7/d55/d23/d66/d63/lc5 0 2023-10-21T17:13:24.369 INFO:tasks.workunit.client.0.smithi012.stdout:5/446: creat d2/d4f/d59/d5b/d15/f9d x:0 0 0 2023-10-21T17:13:24.369 INFO:tasks.workunit.client.0.smithi012.stdout:5/447: chown d2/d4f/d7e/d87/f39 79986 1 2023-10-21T17:13:24.387 INFO:tasks.workunit.client.0.smithi012.stdout:6/488: unlink d13/d42/d71/f7d 0 2023-10-21T17:13:24.550 INFO:tasks.workunit.client.0.smithi012.stdout:2/554: rmdir d1/d14/d16/d22 39 2023-10-21T17:13:24.571 INFO:tasks.workunit.client.0.smithi012.stdout:3/431: sync 2023-10-21T17:13:24.618 INFO:tasks.workunit.client.0.smithi012.stdout:3/432: dread d0/da/d28/f3c [0,4194304] 0 2023-10-21T17:13:24.656 INFO:tasks.workunit.client.0.smithi012.stdout:7/494: truncate d3/d16/f31 5315281 0 2023-10-21T17:13:24.825 INFO:tasks.workunit.client.0.smithi012.stdout:4/531: link dc/d1e/d6e/f84 dc/d15/d18/d4c/fb3 0 2023-10-21T17:13:24.826 INFO:tasks.workunit.client.0.smithi012.stdout:4/532: fdatasync dc/d1e/d65/f66 0 2023-10-21T17:13:24.896 INFO:tasks.workunit.client.0.smithi012.stdout:0/524: mkdir d7/d55/d23/d27/dc6 0 2023-10-21T17:13:25.237 INFO:tasks.workunit.client.0.smithi012.stdout:5/448: mknod d2/d4f/d7e/d87/d93/c9e 0 2023-10-21T17:13:25.238 INFO:tasks.workunit.client.0.smithi012.stdout:5/449: write d2/d1d/f56 [2738961,20498] 0 2023-10-21T17:13:25.238 INFO:tasks.workunit.client.0.smithi012.stdout:5/450: creat d2/d4f/d7e/d87/d57/f9f x:0 0 0 2023-10-21T17:13:25.317 INFO:tasks.workunit.client.0.smithi012.stdout:6/489: truncate f10 950341 0 2023-10-21T17:13:25.849 INFO:tasks.workunit.client.0.smithi012.stdout:7/495: getdents d3/d6/dc 0 2023-10-21T17:13:25.935 INFO:tasks.workunit.client.0.smithi012.stdout:4/533: unlink dc/d1e/d33/l35 0 2023-10-21T17:13:26.169 INFO:tasks.workunit.client.0.smithi012.stdout:0/525: creat d7/d55/d23/d27/fc7 x:0 0 0 2023-10-21T17:13:26.169 INFO:tasks.workunit.client.0.smithi012.stdout:0/526: dread - d7/d52/f77 zero size 2023-10-21T17:13:26.561 INFO:tasks.workunit.client.0.smithi012.stdout:5/451: creat d2/fa0 x:0 0 0 2023-10-21T17:13:26.593 INFO:tasks.workunit.client.0.smithi012.stdout:5/452: dread d2/d1d/f56 [0,4194304] 0 2023-10-21T17:13:26.594 INFO:tasks.workunit.client.0.smithi012.stdout:5/453: write d2/d4f/d7e/d87/d57/d66/f7f [5976601,114700] 0 2023-10-21T17:13:26.594 INFO:tasks.workunit.client.0.smithi012.stdout:5/454: fdatasync d2/d4f/d59/d5b/d15/f8d 0 2023-10-21T17:13:26.595 INFO:tasks.workunit.client.0.smithi012.stdout:5/455: chown d2/d1d/f56 3330222 1 2023-10-21T17:13:26.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/456: write d2/d1d/d20/f2b [1438034,102259] 0 2023-10-21T17:13:26.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/457: chown d2/d4f/d59 219360753 1 2023-10-21T17:13:26.631 INFO:tasks.workunit.client.0.smithi012.stdout:5/458: stat d2/d4f/d7e/d87/l2f 0 2023-10-21T17:13:26.650 INFO:tasks.workunit.client.0.smithi012.stdout:5/459: dread d2/d6/f7 [4194304,4194304] 0 2023-10-21T17:13:26.650 INFO:tasks.workunit.client.0.smithi012.stdout:5/460: chown d2/d4f/f94 384985 1 2023-10-21T17:13:26.650 INFO:tasks.workunit.client.0.smithi012.stdout:5/461: readlink d2/l5a 0 2023-10-21T17:13:26.991 INFO:tasks.workunit.client.0.smithi012.stdout:6/490: symlink d13/d15/d1d/d28/d5b/d75/la5 0 2023-10-21T17:13:27.148 INFO:tasks.workunit.client.0.smithi012.stdout:2/555: getdents d1/d4 0 2023-10-21T17:13:27.149 INFO:tasks.workunit.client.0.smithi012.stdout:2/556: dread - d1/d14/d16/d22/da5/d50/da3/da9/fc1 zero size 2023-10-21T17:13:27.508 INFO:tasks.workunit.client.0.smithi012.stdout:7/496: rename d3/d16/c4d to d3/d6/d6a/c98 0 2023-10-21T17:13:27.508 INFO:tasks.workunit.client.0.smithi012.stdout:7/497: write d3/d6/dc/f63 [5379243,9148] 0 2023-10-21T17:13:27.774 INFO:tasks.workunit.client.0.smithi012.stdout:5/462: symlink d2/d2c/d8c/la1 0 2023-10-21T17:13:27.958 INFO:tasks.workunit.client.0.smithi012.stdout:6/491: symlink d13/d15/d1d/d5d/d66/la6 0 2023-10-21T17:13:28.210 INFO:tasks.workunit.client.0.smithi012.stdout:4/534: rename dc/c4a to dc/d15/d2a/d58/cb4 0 2023-10-21T17:13:28.742 INFO:tasks.workunit.client.0.smithi012.stdout:7/498: creat d3/d6/dc/d19/d1e/d7b/f99 x:0 0 0 2023-10-21T17:13:28.829 INFO:tasks.workunit.client.0.smithi012.stdout:7/499: stat d3/d6/dc 0 2023-10-21T17:13:28.830 INFO:tasks.workunit.client.0.smithi012.stdout:7/500: write d3/f83 [82013,3594] 0 2023-10-21T17:13:29.002 INFO:tasks.workunit.client.0.smithi012.stdout:5/463: truncate d2/d4f/d7e/f8a 1468811 0 2023-10-21T17:13:29.002 INFO:tasks.workunit.client.0.smithi012.stdout:6/492: creat d13/d15/d1d/d24/fa7 x:0 0 0 2023-10-21T17:13:29.157 INFO:tasks.workunit.client.0.smithi012.stdout:4/535: link dc/d1e/d2b/f5c dc/d6b/fb5 0 2023-10-21T17:13:29.327 INFO:tasks.workunit.client.0.smithi012.stdout:2/557: getdents d1/d4/d65 0 2023-10-21T17:13:29.346 INFO:tasks.workunit.client.0.smithi012.stdout:2/558: dread d1/d14/d17/f55 [0,4194304] 0 2023-10-21T17:13:29.494 INFO:tasks.workunit.client.0.smithi012.stdout:8/415: write d0/f32 [1240618,67662] 0 2023-10-21T17:13:29.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/464: dread d2/d6/f54 [0,4194304] 0 2023-10-21T17:13:29.712 INFO:tasks.workunit.client.0.smithi012.stdout:5/465: write d2/d4f/d59/d5b/f41 [1968496,117149] 0 2023-10-21T17:13:29.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/493: truncate d13/d15/f1a 500314 0 2023-10-21T17:13:29.921 INFO:tasks.workunit.client.0.smithi012.stdout:9/457: dwrite d0/df/d44/f51 [0,4194304] 0 2023-10-21T17:13:29.921 INFO:tasks.workunit.client.0.smithi012.stdout:9/458: fdatasync d0/d5/f69 0 2023-10-21T17:13:30.184 INFO:tasks.workunit.client.0.smithi012.stdout:4/536: link dc/d15/d2a/d31/f49 dc/d15/d2a/d31/fb6 0 2023-10-21T17:13:30.184 INFO:tasks.workunit.client.0.smithi012.stdout:2/559: rename d1/d8/f7c to d1/d14/d17/fc4 0 2023-10-21T17:13:30.565 INFO:tasks.workunit.client.0.smithi012.stdout:5/466: mknod d2/d1d/d20/ca2 0 2023-10-21T17:13:31.436 INFO:tasks.workunit.client.0.smithi012.stdout:3/433: write d0/d32/d43/f6b [99408,76884] 0 2023-10-21T17:13:31.436 INFO:tasks.workunit.client.0.smithi012.stdout:3/434: truncate d0/f3b 4365517 0 2023-10-21T17:13:31.784 INFO:tasks.workunit.client.0.smithi012.stdout:9/459: unlink d0/d4/d4b/d6a/d12/d25/d39/d3b/l93 0 2023-10-21T17:13:32.211 INFO:tasks.workunit.client.0.smithi012.stdout:2/560: getdents d1/d4/d3f 0 2023-10-21T17:13:32.238 INFO:tasks.workunit.client.0.smithi012.stdout:5/467: truncate d2/d2c/f7a 182134 0 2023-10-21T17:13:32.239 INFO:tasks.workunit.client.0.smithi012.stdout:5/468: stat d2/d1d/d20/l2d 0 2023-10-21T17:13:32.442 INFO:tasks.workunit.client.0.smithi012.stdout:3/435: unlink d0/da/c23 0 2023-10-21T17:13:32.443 INFO:tasks.workunit.client.0.smithi012.stdout:3/436: write d0/f62 [644152,30899] 0 2023-10-21T17:13:32.510 INFO:tasks.workunit.client.0.smithi012.stdout:9/460: mknod d0/df/d8d/c97 0 2023-10-21T17:13:32.607 INFO:tasks.workunit.client.0.smithi012.stdout:9/461: dwrite d0/df/d44/f51 [0,4194304] 0 2023-10-21T17:13:32.680 INFO:tasks.workunit.client.0.smithi012.stdout:9/462: dwrite d0/f5a [0,4194304] 0 2023-10-21T17:13:32.680 INFO:tasks.workunit.client.0.smithi012.stdout:9/463: chown d0/df/d8d/d8a/f94 122199249 1 2023-10-21T17:13:32.732 INFO:tasks.workunit.client.0.smithi012.stdout:2/561: link d1/c7f d1/d8/cc5 0 2023-10-21T17:13:32.996 INFO:tasks.workunit.client.0.smithi012.stdout:5/469: truncate d2/d6/f54 1142305 0 2023-10-21T17:13:33.064 INFO:tasks.workunit.client.0.smithi012.stdout:5/470: dwrite d2/d2c/f43 [0,4194304] 0 2023-10-21T17:13:33.065 INFO:tasks.workunit.client.0.smithi012.stdout:5/471: write d2/d4f/d7e/d87/d57/f9f [32907,54701] 0 2023-10-21T17:13:33.065 INFO:tasks.workunit.client.0.smithi012.stdout:5/472: chown d2/d2c/d8c 1040869 1 2023-10-21T17:13:33.065 INFO:tasks.workunit.client.0.smithi012.stdout:5/473: chown d2/d4f/d59/c84 222 1 2023-10-21T17:13:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:3/437: creat d0/d32/d43/d47/f83 x:0 0 0 2023-10-21T17:13:33.928 INFO:tasks.workunit.client.0.smithi012.stdout:2/562: truncate d1/d14/d16/d22/da5/d50/f79 802673 0 2023-10-21T17:13:34.276 INFO:tasks.workunit.client.0.smithi012.stdout:3/438: creat d0/d1c/d5e/f84 x:0 0 0 2023-10-21T17:13:34.905 INFO:tasks.workunit.client.0.smithi012.stdout:3/439: link d0/d32/d43/c81 d0/da/d28/c85 0 2023-10-21T17:13:34.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/440: stat d0/da/f54 0 2023-10-21T17:13:34.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/441: truncate d0/d32/f78 507042 0 2023-10-21T17:13:35.475 INFO:tasks.workunit.client.0.smithi012.stdout:7/501: dwrite d3/d16/f56 [0,4194304] 0 2023-10-21T17:13:35.882 INFO:tasks.workunit.client.0.smithi012.stdout:3/442: creat d0/da/f86 x:0 0 0 2023-10-21T17:13:35.883 INFO:tasks.workunit.client.0.smithi012.stdout:3/443: fdatasync d0/da/d28/f77 0 2023-10-21T17:13:35.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:13:35.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:13:36.247 INFO:tasks.workunit.client.0.smithi012.stdout:1/539: creat d5/fbb x:0 0 0 2023-10-21T17:13:36.496 INFO:tasks.workunit.client.0.smithi012.stdout:9/464: dwrite d0/d4/d4b/f4c [0,4194304] 0 2023-10-21T17:13:36.671 INFO:tasks.workunit.client.0.smithi012.stdout:7/502: mknod d3/d6/d73/c9a 0 2023-10-21T17:13:37.028 INFO:tasks.workunit.client.0.smithi012.stdout:3/444: rmdir d0/d32/d43/d47/d50/d52/d6d 0 2023-10-21T17:13:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:1/540: unlink c3 0 2023-10-21T17:13:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:1/541: chown d5/d32/d1b/d2c/d4b/d8a/fa4 104 1 2023-10-21T17:13:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:3/445: write d0/da/f86 [1026063,91099] 0 2023-10-21T17:13:37.120 INFO:tasks.workunit.client.0.smithi012.stdout:1/542: dwrite d5/d32/d1b/d35/d3a/d93/fa7 [0,4194304] 0 2023-10-21T17:13:37.362 INFO:tasks.workunit.client.0.smithi012.stdout:9/465: symlink d0/d4/d4b/d6a/l98 0 2023-10-21T17:13:37.365 INFO:tasks.workunit.client.0.smithi012.stdout:5/474: write d2/d6/f69 [902024,120285] 0 2023-10-21T17:13:37.366 INFO:tasks.workunit.client.0.smithi012.stdout:5/475: fdatasync d2/d4f/d59/d5b/f67 0 2023-10-21T17:13:37.511 INFO:tasks.workunit.client.0.smithi012.stdout:7/503: mkdir d3/d6/dc/d19/d1e/d7b/d9b 0 2023-10-21T17:13:37.527 INFO:tasks.workunit.client.0.smithi012.stdout:7/504: dread d3/d29/f45 [0,4194304] 0 2023-10-21T17:13:37.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/446: mknod d0/da/c87 0 2023-10-21T17:13:37.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/447: stat d0/d32/d43/f59 0 2023-10-21T17:13:37.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/448: fdatasync d0/f46 0 2023-10-21T17:13:37.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/449: chown d0/d32/f78 3 1 2023-10-21T17:13:37.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/450: write d0/da/d28/f2c [71054,76101] 0 2023-10-21T17:13:38.091 INFO:tasks.workunit.client.0.smithi012.stdout:1/543: unlink d5/d32/d1b/d35/d3a/d5c/d7c/db7/fb8 0 2023-10-21T17:13:38.177 INFO:tasks.workunit.client.0.smithi012.stdout:1/544: dwrite d5/d32/d1b/d35/f3f [0,4194304] 0 2023-10-21T17:13:38.178 INFO:tasks.workunit.client.0.smithi012.stdout:1/545: dread - d5/d32/d1b/d27/d1a/f89 zero size 2023-10-21T17:13:38.252 INFO:tasks.workunit.client.0.smithi012.stdout:9/466: creat d0/d4/d4b/f99 x:0 0 0 2023-10-21T17:13:38.561 INFO:tasks.workunit.client.0.smithi012.stdout:5/476: symlink d2/d2c/d73/d49/d96/la3 0 2023-10-21T17:13:39.343 INFO:tasks.workunit.client.0.smithi012.stdout:2/563: dwrite d1/d4/d3f/f4f [0,4194304] 0 2023-10-21T17:13:39.636 INFO:tasks.workunit.client.0.smithi012.stdout:8/416: creat d0/f8f x:0 0 0 2023-10-21T17:13:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:9/467: creat d0/d4/d4b/d6a/d12/d25/d2f/d8c/f9a x:0 0 0 2023-10-21T17:13:40.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/468: write d0/df/f63 [3052694,129601] 0 2023-10-21T17:13:40.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/469: readlink d0/d15/l49 0 2023-10-21T17:13:40.175 INFO:tasks.workunit.client.0.smithi012.stdout:9/470: chown d0/d4/f2e 96 1 2023-10-21T17:13:40.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/451: symlink d0/d32/l88 0 2023-10-21T17:13:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:9/471: mknod d0/d4/d4b/d6a/d12/d25/d39/d76/c9b 0 2023-10-21T17:13:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:9/472: fsync d0/df/d8d/f64 0 2023-10-21T17:13:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:9/473: write d0/d4/d4b/d6a/d12/d25/d2f/f65 [4422067,29635] 0 2023-10-21T17:13:40.597 INFO:tasks.workunit.client.0.smithi012.stdout:9/474: dread d0/d4/d4b/d6a/d12/d25/f37 [0,4194304] 0 2023-10-21T17:13:40.629 INFO:tasks.workunit.client.0.smithi012.stdout:9/475: read d0/d5/f69 [4249115,6877] 0 2023-10-21T17:13:40.899 INFO:tasks.workunit.client.0.smithi012.stdout:0/527: sync 2023-10-21T17:13:41.213 INFO:tasks.workunit.client.0.smithi012.stdout:3/452: unlink d0/d32/d43/d47/d50/l75 0 2023-10-21T17:13:41.304 INFO:tasks.workunit.client.0.smithi012.stdout:9/476: mkdir d0/d5/d9c 0 2023-10-21T17:13:41.657 INFO:tasks.workunit.client.0.smithi012.stdout:3/453: creat d0/d32/d43/f89 x:0 0 0 2023-10-21T17:13:41.685 INFO:tasks.workunit.client.0.smithi012.stdout:3/454: dread d0/da/d28/f77 [0,4194304] 0 2023-10-21T17:13:41.732 INFO:tasks.workunit.client.0.smithi012.stdout:9/477: mkdir d0/d5/d9d 0 2023-10-21T17:13:42.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/537: rename dc/d15/d2a/l69 to dc/lb7 0 2023-10-21T17:13:42.549 INFO:tasks.workunit.client.0.smithi012.stdout:2/564: rename d1/d14/d17/f98 to d1/d14/d16/d22/da5/db7/fc6 0 2023-10-21T17:13:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:4/538: symlink dc/lb8 0 2023-10-21T17:13:42.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/455: getdents d0/da 0 2023-10-21T17:13:43.004 INFO:tasks.workunit.client.0.smithi012.stdout:2/565: creat d1/d4/fc7 x:0 0 0 2023-10-21T17:13:43.004 INFO:tasks.workunit.client.0.smithi012.stdout:2/566: fsync d1/d14/d16/d22/da5/d34/f45 0 2023-10-21T17:13:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/567: dwrite d1/f1c [0,4194304] 0 2023-10-21T17:13:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/568: fdatasync d1/d14/d17/f24 0 2023-10-21T17:13:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:2/569: fdatasync d1/d14/d16/d22/da5/d34/fb1 0 2023-10-21T17:13:43.411 INFO:tasks.workunit.client.0.smithi012.stdout:6/494: sync 2023-10-21T17:13:43.412 INFO:tasks.workunit.client.0.smithi012.stdout:5/477: creat d2/d4f/fa4 x:0 0 0 2023-10-21T17:13:43.412 INFO:tasks.workunit.client.0.smithi012.stdout:6/495: creat d13/d15/d1d/d28/fa8 x:0 0 0 2023-10-21T17:13:43.447 INFO:tasks.workunit.client.0.smithi012.stdout:4/539: creat dc/d1e/d33/d8a/fb9 x:0 0 0 2023-10-21T17:13:43.450 INFO:tasks.workunit.client.0.smithi012.stdout:5/478: dread d2/d1d/f8e [0,4194304] 0 2023-10-21T17:13:43.749 INFO:tasks.workunit.client.0.smithi012.stdout:7/505: dwrite d3/d6/dc/f54 [0,4194304] 0 2023-10-21T17:13:44.004 INFO:tasks.workunit.client.0.smithi012.stdout:2/570: unlink d1/d14/d17/f40 0 2023-10-21T17:13:44.063 INFO:tasks.workunit.client.0.smithi012.stdout:2/571: dwrite d1/d4/d3f/d41/d59/fb5 [0,4194304] 0 2023-10-21T17:13:44.063 INFO:tasks.workunit.client.0.smithi012.stdout:2/572: write d1/d14/d16/d58/f4b [397337,119488] 0 2023-10-21T17:13:44.063 INFO:tasks.workunit.client.0.smithi012.stdout:2/573: stat d1/d14/d16/d22 0 2023-10-21T17:13:44.064 INFO:tasks.workunit.client.0.smithi012.stdout:2/574: readlink d1/d14/d16/d20/lb0 0 2023-10-21T17:13:44.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/575: write d1/d14/d16/d58/f66 [3321999,26044] 0 2023-10-21T17:13:44.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/576: creat d1/d4/d93/fc8 x:0 0 0 2023-10-21T17:13:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:2/577: dwrite d1/d8/f51 [0,4194304] 0 2023-10-21T17:13:44.425 INFO:tasks.workunit.client.0.smithi012.stdout:6/496: dread d13/d15/f2b [0,4194304] 0 2023-10-21T17:13:44.425 INFO:tasks.workunit.client.0.smithi012.stdout:6/497: write d13/d35/d4c/f93 [943244,108569] 0 2023-10-21T17:13:44.426 INFO:tasks.workunit.client.0.smithi012.stdout:6/498: write d13/f36 [325430,66259] 0 2023-10-21T17:13:44.426 INFO:tasks.workunit.client.0.smithi012.stdout:6/499: dread - d13/d29/d37/d3b/f5e zero size 2023-10-21T17:13:44.426 INFO:tasks.workunit.client.0.smithi012.stdout:6/500: chown d13/c8b 3768 1 2023-10-21T17:13:44.894 INFO:tasks.workunit.client.0.smithi012.stdout:8/417: dwrite d0/d62/d83/d72/f8e [0,4194304] 0 2023-10-21T17:13:45.246 INFO:tasks.workunit.client.0.smithi012.stdout:4/540: link dc/lb7 dc/d1e/d33/d8a/lba 0 2023-10-21T17:13:45.247 INFO:tasks.workunit.client.0.smithi012.stdout:0/528: dwrite f6 [0,4194304] 0 2023-10-21T17:13:45.247 INFO:tasks.workunit.client.0.smithi012.stdout:0/529: truncate d7/d55/f8b 1385249 0 2023-10-21T17:13:45.254 INFO:tasks.workunit.client.0.smithi012.stdout:1/546: sync 2023-10-21T17:13:46.143 INFO:tasks.workunit.client.0.smithi012.stdout:2/578: symlink d1/d14/d16/d22/da5/d50/lc9 0 2023-10-21T17:13:46.237 INFO:tasks.workunit.client.0.smithi012.stdout:2/579: dwrite d1/d14/d17/f55 [0,4194304] 0 2023-10-21T17:13:46.237 INFO:tasks.workunit.client.0.smithi012.stdout:2/580: truncate d1/d14/d16/d58/f4b 1435778 0 2023-10-21T17:13:46.343 INFO:tasks.workunit.client.0.smithi012.stdout:6/501: mknod d13/d15/d1d/d5d/d66/d7a/ca9 0 2023-10-21T17:13:46.924 INFO:tasks.workunit.client.0.smithi012.stdout:3/456: write d0/d32/f78 [42334,38404] 0 2023-10-21T17:13:46.924 INFO:tasks.workunit.client.0.smithi012.stdout:3/457: fsync d0/d1c/f71 0 2023-10-21T17:13:46.951 INFO:tasks.workunit.client.0.smithi012.stdout:3/458: write d0/d1c/f5a [3963879,120489] 0 2023-10-21T17:13:46.951 INFO:tasks.workunit.client.0.smithi012.stdout:3/459: stat d0/f3b 0 2023-10-21T17:13:46.969 INFO:tasks.workunit.client.0.smithi012.stdout:3/460: dread d0/da/f34 [4194304,4194304] 0 2023-10-21T17:13:47.570 INFO:tasks.workunit.client.0.smithi012.stdout:4/541: truncate dc/d15/d18/d4c/d75/f7c 268674 0 2023-10-21T17:13:47.570 INFO:tasks.workunit.client.0.smithi012.stdout:4/542: truncate dc/d15/d18/d4c/d55/f9c 366012 0 2023-10-21T17:13:47.571 INFO:tasks.workunit.client.0.smithi012.stdout:4/543: fdatasync dc/d15/d2a/d31/f87 0 2023-10-21T17:13:47.571 INFO:tasks.workunit.client.0.smithi012.stdout:0/530: link d7/d55/d23/d27/d40/c7c d7/d55/d1f/d28/d9b/cc8 0 2023-10-21T17:13:47.572 INFO:tasks.workunit.client.0.smithi012.stdout:0/531: chown d7/d55/d23/d27/d31/d3d/c2f 1 1 2023-10-21T17:13:48.253 INFO:tasks.workunit.client.0.smithi012.stdout:2/581: creat d1/d14/d16/d22/da5/fca x:0 0 0 2023-10-21T17:13:48.344 INFO:tasks.workunit.client.0.smithi012.stdout:5/479: write d2/d1d/d20/f48 [5650865,101003] 0 2023-10-21T17:13:48.344 INFO:tasks.workunit.client.0.smithi012.stdout:5/480: readlink l1 0 2023-10-21T17:13:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:6/502: dread d13/d15/f27 [0,4194304] 0 2023-10-21T17:13:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:6/503: getdents d13/d15/d1d/d5d/d66/d7a/d97 0 2023-10-21T17:13:48.749 INFO:tasks.workunit.client.0.smithi012.stdout:8/418: getdents d0/d12/d80 0 2023-10-21T17:13:48.838 INFO:tasks.workunit.client.0.smithi012.stdout:9/478: rename d0/d4/d4b/d6a/d12/d25/l26 to d0/d4/l9e 0 2023-10-21T17:13:48.893 INFO:tasks.workunit.client.0.smithi012.stdout:7/506: dwrite d3/d16/f1a [0,4194304] 0 2023-10-21T17:13:48.934 INFO:tasks.workunit.client.0.smithi012.stdout:7/507: read d3/d29/f27 [1739601,12737] 0 2023-10-21T17:13:49.015 INFO:tasks.workunit.client.0.smithi012.stdout:7/508: dwrite d3/d29/f11 [4194304,4194304] 0 2023-10-21T17:13:49.518 INFO:tasks.workunit.client.0.smithi012.stdout:6/504: unlink d13/d15/d1d/d5d/d66/la6 0 2023-10-21T17:13:49.691 INFO:tasks.workunit.client.0.smithi012.stdout:8/419: creat d0/f90 x:0 0 0 2023-10-21T17:13:49.691 INFO:tasks.workunit.client.0.smithi012.stdout:8/420: chown d0/d1a/f1d 10622 1 2023-10-21T17:13:49.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/532: rename d7/d52/d53/f75 to d7/d81/fc9 0 2023-10-21T17:13:49.926 INFO:tasks.workunit.client.0.smithi012.stdout:4/544: rmdir dc/d15/d2a/d58 39 2023-10-21T17:13:50.024 INFO:tasks.workunit.client.0.smithi012.stdout:2/582: getdents d1/d14/d16 0 2023-10-21T17:13:50.024 INFO:tasks.workunit.client.0.smithi012.stdout:2/583: write d1/d14/d16/d20/f8c [727216,85604] 0 2023-10-21T17:13:50.024 INFO:tasks.workunit.client.0.smithi012.stdout:2/584: write d1/d14/d16/f72 [957250,42894] 0 2023-10-21T17:13:50.247 INFO:tasks.workunit.client.0.smithi012.stdout:7/509: mkdir d3/d6/dc/d19/d1e/d69/d9c 0 2023-10-21T17:13:50.462 INFO:tasks.workunit.client.0.smithi012.stdout:3/461: rmdir d0/d32/d43/d47 39 2023-10-21T17:13:50.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/462: dread d0/da/f5f [0,4194304] 0 2023-10-21T17:13:50.550 INFO:tasks.workunit.client.0.smithi012.stdout:3/463: dwrite d0/da/f26 [0,4194304] 0 2023-10-21T17:13:50.551 INFO:tasks.workunit.client.0.smithi012.stdout:3/464: read d0/d32/f78 [307771,85354] 0 2023-10-21T17:13:50.634 INFO:tasks.workunit.client.0.smithi012.stdout:3/465: dwrite d0/d32/d43/d47/d50/d52/f76 [0,4194304] 0 2023-10-21T17:13:50.635 INFO:tasks.workunit.client.0.smithi012.stdout:3/466: read - d0/d1c/d5e/f84 zero size 2023-10-21T17:13:50.975 INFO:tasks.workunit.client.0.smithi012.stdout:6/505: mkdir d13/d29/d37/d3b/daa 0 2023-10-21T17:13:50.976 INFO:tasks.workunit.client.0.smithi012.stdout:8/421: dread - d0/d1a/f24 zero size 2023-10-21T17:13:51.207 INFO:tasks.workunit.client.0.smithi012.stdout:9/479: rename d0/df/f11 to d0/d15/f9f 0 2023-10-21T17:13:51.207 INFO:tasks.workunit.client.0.smithi012.stdout:9/480: dread - d0/df/d8d/f64 zero size 2023-10-21T17:13:51.324 INFO:tasks.workunit.client.0.smithi012.stdout:0/533: creat d7/d55/d23/d66/da9/fca x:0 0 0 2023-10-21T17:13:51.357 INFO:tasks.workunit.client.0.smithi012.stdout:0/534: dread d7/d81/fc4 [0,4194304] 0 2023-10-21T17:13:51.586 INFO:tasks.workunit.client.0.smithi012.stdout:4/545: mkdir dc/d15/d18/d4c/d55/d6c/dbb 0 2023-10-21T17:13:51.587 INFO:tasks.workunit.client.0.smithi012.stdout:2/585: symlink d1/d8/d25/lcb 0 2023-10-21T17:13:51.807 INFO:tasks.workunit.client.0.smithi012.stdout:7/510: dread d3/d6/f6f [0,4194304] 0 2023-10-21T17:13:51.835 INFO:tasks.workunit.client.0.smithi012.stdout:7/511: write d3/d6/dc/d19/d28/f3b [2251988,84480] 0 2023-10-21T17:13:51.836 INFO:tasks.workunit.client.0.smithi012.stdout:7/512: write d3/d16/f67 [760925,130735] 0 2023-10-21T17:13:51.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/513: dwrite d3/d6/dc/d19/f57 [4194304,4194304] 0 2023-10-21T17:13:51.957 INFO:tasks.workunit.client.0.smithi012.stdout:7/514: dwrite d3/d16/f56 [0,4194304] 0 2023-10-21T17:13:51.994 INFO:tasks.workunit.client.0.smithi012.stdout:7/515: write d3/f41 [2267150,112996] 0 2023-10-21T17:13:52.370 INFO:tasks.workunit.client.0.smithi012.stdout:3/467: mknod d0/d32/d43/d47/d50/c8a 0 2023-10-21T17:13:52.370 INFO:tasks.workunit.client.0.smithi012.stdout:6/506: symlink d13/d15/d1d/d28/d5b/lab 0 2023-10-21T17:13:52.391 INFO:tasks.workunit.client.0.smithi012.stdout:8/422: truncate d0/fb 5746134 0 2023-10-21T17:13:52.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/423: dwrite d0/d29/f7a [0,4194304] 0 2023-10-21T17:13:52.497 INFO:tasks.workunit.client.0.smithi012.stdout:3/468: dwrite d0/d32/d43/f79 [0,4194304] 0 2023-10-21T17:13:52.497 INFO:tasks.workunit.client.0.smithi012.stdout:3/469: stat d0/d1c/c7a 0 2023-10-21T17:13:52.497 INFO:tasks.workunit.client.0.smithi012.stdout:8/424: read - d0/d62/d83/f5e zero size 2023-10-21T17:13:52.498 INFO:tasks.workunit.client.0.smithi012.stdout:3/470: fdatasync d0/d1c/f71 0 2023-10-21T17:13:52.498 INFO:tasks.workunit.client.0.smithi012.stdout:3/471: dread - d0/d32/d43/d47/f83 zero size 2023-10-21T17:13:52.498 INFO:tasks.workunit.client.0.smithi012.stdout:6/507: dwrite d13/d42/f84 [0,4194304] 0 2023-10-21T17:13:52.545 INFO:tasks.workunit.client.0.smithi012.stdout:8/425: dwrite d0/f35 [0,4194304] 0 2023-10-21T17:13:52.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/481: symlink d0/d4/d4b/d6a/d12/d25/d39/d76/la0 0 2023-10-21T17:13:52.883 INFO:tasks.workunit.client.0.smithi012.stdout:0/535: symlink d7/d55/d1f/d28/d9b/lcb 0 2023-10-21T17:13:53.396 INFO:tasks.workunit.client.0.smithi012.stdout:2/586: truncate d1/d4/d65/fc3 381348 0 2023-10-21T17:13:53.396 INFO:tasks.workunit.client.0.smithi012.stdout:2/587: fdatasync d1/d8/d25/f42 0 2023-10-21T17:13:53.397 INFO:tasks.workunit.client.0.smithi012.stdout:2/588: write d1/d14/d16/d22/da5/d34/fa1 [5452,65517] 0 2023-10-21T17:13:53.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/547: sync 2023-10-21T17:13:53.603 INFO:tasks.workunit.client.0.smithi012.stdout:1/548: stat d5/d32/d1b/d35/d3a/d93/fa7 0 2023-10-21T17:13:53.609 INFO:tasks.workunit.client.0.smithi012.stdout:1/549: dread d5/d32/d1b/d35/d3a/f79 [0,4194304] 0 2023-10-21T17:13:53.778 INFO:tasks.workunit.client.0.smithi012.stdout:7/516: mkdir d3/d6/dc/d19/d1e/d9d 0 2023-10-21T17:13:53.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/481: dwrite d2/d4f/d7e/d87/d57/d66/f81 [0,4194304] 0 2023-10-21T17:13:53.803 INFO:tasks.workunit.client.0.smithi012.stdout:5/482: dread - d2/d4f/d7e/d87/d57/f7d zero size 2023-10-21T17:13:53.803 INFO:tasks.workunit.client.0.smithi012.stdout:5/483: creat d2/d4f/d59/fa5 x:0 0 0 2023-10-21T17:13:53.803 INFO:tasks.workunit.client.0.smithi012.stdout:5/484: chown d2/d2c/d73/d49/l63 74199852 1 2023-10-21T17:13:53.967 INFO:tasks.workunit.client.0.smithi012.stdout:4/546: write dc/d15/d18/d4c/d75/f7c [434789,40085] 0 2023-10-21T17:13:53.999 INFO:tasks.workunit.client.0.smithi012.stdout:4/547: dread dc/d15/d18/d4c/f81 [0,4194304] 0 2023-10-21T17:13:54.937 INFO:tasks.workunit.client.0.smithi012.stdout:6/508: mkdir d13/d29/d37/d3b/daa/dac 0 2023-10-21T17:13:54.952 INFO:tasks.workunit.client.0.smithi012.stdout:8/426: mkdir d0/d12/d40/d91 0 2023-10-21T17:13:54.975 INFO:tasks.workunit.client.0.smithi012.stdout:8/427: read d0/f35 [522208,65079] 0 2023-10-21T17:13:55.146 INFO:tasks.workunit.client.0.smithi012.stdout:0/536: mknod d7/d55/d23/d66/ccc 0 2023-10-21T17:13:55.186 INFO:tasks.workunit.client.0.smithi012.stdout:0/537: dread d7/d55/d23/d66/f37 [0,4194304] 0 2023-10-21T17:13:55.651 INFO:tasks.workunit.client.0.smithi012.stdout:1/550: creat d5/d26/fbc x:0 0 0 2023-10-21T17:13:55.765 INFO:tasks.workunit.client.0.smithi012.stdout:7/517: mknod d3/d6/dc/d19/d1e/d7b/c9e 0 2023-10-21T17:13:55.765 INFO:tasks.workunit.client.0.smithi012.stdout:7/518: stat d3/d6/dc/d19/d1e/d9d 0 2023-10-21T17:13:55.765 INFO:tasks.workunit.client.0.smithi012.stdout:7/519: chown d3/d6/dc/d19/d28/l35 2204 1 2023-10-21T17:13:55.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/520: dwrite d3/d6/dc/f63 [0,4194304] 0 2023-10-21T17:13:55.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/521: fsync d3/d29/f45 0 2023-10-21T17:13:55.855 INFO:tasks.workunit.client.0.smithi012.stdout:7/522: read d3/d6/dc/f54 [2859356,58062] 0 2023-10-21T17:13:56.309 INFO:tasks.workunit.client.0.smithi012.stdout:5/485: symlink d2/d4f/d7e/la6 0 2023-10-21T17:13:56.426 INFO:tasks.workunit.client.0.smithi012.stdout:4/548: link dc/d15/d2a/l73 dc/d1e/d33/d8a/lbc 0 2023-10-21T17:13:56.516 INFO:tasks.workunit.client.0.smithi012.stdout:6/509: rename d13/d15/f33 to d13/d15/d1d/d28/fad 0 2023-10-21T17:13:56.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/510: dread d13/d29/d37/f44 [0,4194304] 0 2023-10-21T17:13:56.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/511: chown d13/d15/d1d/d5d/la0 893717045 1 2023-10-21T17:13:56.693 INFO:tasks.workunit.client.0.smithi012.stdout:9/482: link d0/d5/c8f d0/df/ca1 0 2023-10-21T17:13:56.731 INFO:tasks.workunit.client.0.smithi012.stdout:9/483: dread d0/d4/f2e [0,4194304] 0 2023-10-21T17:13:56.731 INFO:tasks.workunit.client.0.smithi012.stdout:9/484: write d0/f72 [860088,97948] 0 2023-10-21T17:13:56.799 INFO:tasks.workunit.client.0.smithi012.stdout:9/485: dwrite d0/df/d44/f7c [0,4194304] 0 2023-10-21T17:13:56.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/551: mknod d5/d32/d1b/d2c/cbd 0 2023-10-21T17:13:56.852 INFO:tasks.workunit.client.0.smithi012.stdout:1/552: creat d5/d26/fbe x:0 0 0 2023-10-21T17:13:56.874 INFO:tasks.workunit.client.0.smithi012.stdout:1/553: dread d5/d30/d51/fb4 [0,4194304] 0 2023-10-21T17:13:56.875 INFO:tasks.workunit.client.0.smithi012.stdout:1/554: read d5/d32/d1b/d27/d21/f4e [1307341,74879] 0 2023-10-21T17:13:57.023 INFO:tasks.workunit.client.0.smithi012.stdout:7/523: creat d3/d6/d73/d8e/f9f x:0 0 0 2023-10-21T17:13:57.194 INFO:tasks.workunit.client.0.smithi012.stdout:5/486: rename d2/d2c/f7a to d2/d2c/fa7 0 2023-10-21T17:13:57.194 INFO:tasks.workunit.client.0.smithi012.stdout:5/487: readlink d2/d4f/d59/d5b/l12 0 2023-10-21T17:13:57.240 INFO:tasks.workunit.client.0.smithi012.stdout:5/488: dread d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:13:57.464 INFO:tasks.workunit.client.0.smithi012.stdout:4/549: creat dc/d15/d18/d4c/d55/d6c/d83/fbd x:0 0 0 2023-10-21T17:13:57.464 INFO:tasks.workunit.client.0.smithi012.stdout:4/550: chown dc/d1e/da7 2206 1 2023-10-21T17:13:57.464 INFO:tasks.workunit.client.0.smithi012.stdout:4/551: readlink dc/d1e/d65/l8e 0 2023-10-21T17:13:57.650 INFO:tasks.workunit.client.0.smithi012.stdout:8/428: rename d0/d12/d40/l4b to d0/d1a/d54/l92 0 2023-10-21T17:13:57.651 INFO:tasks.workunit.client.0.smithi012.stdout:8/429: chown d0/d29/f7a 499038 1 2023-10-21T17:13:57.681 INFO:tasks.workunit.client.0.smithi012.stdout:8/430: dread d0/d62/f6b [0,4194304] 0 2023-10-21T17:13:57.681 INFO:tasks.workunit.client.0.smithi012.stdout:8/431: write d0/f32 [1025754,81178] 0 2023-10-21T17:13:57.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/538: truncate d7/d55/d1f/f2e 1731675 0 2023-10-21T17:13:59.964 INFO:tasks.workunit.client.0.smithi012.stdout:1/555: mknod d5/d32/d1b/d35/d3a/cbf 0 2023-10-21T17:14:00.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/524: mkdir d3/d6/dc/d19/d28/da0 0 2023-10-21T17:14:00.229 INFO:tasks.workunit.client.0.smithi012.stdout:7/525: dread d3/d16/f56 [0,4194304] 0 2023-10-21T17:14:00.229 INFO:tasks.workunit.client.0.smithi012.stdout:7/526: fdatasync d3/d16/f32 0 2023-10-21T17:14:00.313 INFO:tasks.workunit.client.0.smithi012.stdout:5/489: rmdir d2/d4f/d7e/d87/d98 0 2023-10-21T17:14:00.343 INFO:tasks.workunit.client.0.smithi012.stdout:5/490: write d2/d1d/d20/f48 [483955,118999] 0 2023-10-21T17:14:00.343 INFO:tasks.workunit.client.0.smithi012.stdout:5/491: fdatasync d2/d2c/f43 0 2023-10-21T17:14:00.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/552: rename dc/d15/d2a/c8d to dc/d1e/da7/cbe 0 2023-10-21T17:14:00.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/553: readlink dc/d15/d2a/da9/laa 0 2023-10-21T17:14:00.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/554: write dc/d93/f46 [3493600,5164] 0 2023-10-21T17:14:00.843 INFO:tasks.workunit.client.0.smithi012.stdout:6/512: link le d13/d15/d1d/d28/d5b/d75/lae 0 2023-10-21T17:14:00.843 INFO:tasks.workunit.client.0.smithi012.stdout:6/513: readlink d13/d29/l2d 0 2023-10-21T17:14:00.882 INFO:tasks.workunit.client.0.smithi012.stdout:6/514: dread d13/d15/d1d/d28/fad [0,4194304] 0 2023-10-21T17:14:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:0/539: mknod d7/d55/d23/d66/d82/ccd 0 2023-10-21T17:14:01.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/527: symlink d3/d6/dc/d19/d1e/d69/d9c/la1 0 2023-10-21T17:14:01.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/528: truncate d3/d6/dc/d19/d1e/d7b/f99 253548 0 2023-10-21T17:14:01.844 INFO:tasks.workunit.client.0.smithi012.stdout:4/555: truncate dc/d15/d18/d4c/d55/f7f 2515116 0 2023-10-21T17:14:02.045 INFO:tasks.workunit.client.0.smithi012.stdout:6/515: rename d13/d42/l43 to d13/d64/d6d/d73/laf 0 2023-10-21T17:14:02.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/540: truncate d7/d55/f8b 1843415 0 2023-10-21T17:14:02.268 INFO:tasks.workunit.client.0.smithi012.stdout:5/492: truncate d2/d4f/d7e/f8a 2025996 0 2023-10-21T17:14:02.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/556: mknod dc/d1e/d33/d8a/cbf 0 2023-10-21T17:14:02.807 INFO:tasks.workunit.client.0.smithi012.stdout:6/516: mkdir d13/d15/d1d/d24/d9f/db0 0 2023-10-21T17:14:02.807 INFO:tasks.workunit.client.0.smithi012.stdout:6/517: chown d13/d15 2191 1 2023-10-21T17:14:02.903 INFO:tasks.workunit.client.0.smithi012.stdout:2/589: dwrite d1/d14/d16/d22/da5/f57 [0,4194304] 0 2023-10-21T17:14:02.922 INFO:tasks.workunit.client.0.smithi012.stdout:2/590: dread d1/d14/d16/d20/f8c [0,4194304] 0 2023-10-21T17:14:02.965 INFO:tasks.workunit.client.0.smithi012.stdout:0/541: mkdir d7/d55/d23/dce 0 2023-10-21T17:14:02.966 INFO:tasks.workunit.client.0.smithi012.stdout:0/542: truncate d7/d55/d23/d27/fc7 972855 0 2023-10-21T17:14:03.068 INFO:tasks.workunit.client.0.smithi012.stdout:5/493: creat d2/d1d/fa8 x:0 0 0 2023-10-21T17:14:03.068 INFO:tasks.workunit.client.0.smithi012.stdout:5/494: chown d2/d2c/f43 55289366 1 2023-10-21T17:14:03.068 INFO:tasks.workunit.client.0.smithi012.stdout:5/495: chown d2/d4f/d59/d5b/d15 4480800 1 2023-10-21T17:14:03.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/557: symlink dc/d15/d18/d4c/d75/lc0 0 2023-10-21T17:14:03.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/558: write dc/d15/d18/d4c/d55/d6c/d77/f96 [4949036,36235] 0 2023-10-21T17:14:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:2/591: unlink d1/d14/d17/d8a/f9f 0 2023-10-21T17:14:04.864 INFO:tasks.workunit.client.0.smithi012.stdout:6/518: rename d13/d15/d1d/c1e to d13/d15/d1d/d24/cb1 0 2023-10-21T17:14:05.519 INFO:tasks.workunit.client.0.smithi012.stdout:6/519: truncate d13/f14 1279713 0 2023-10-21T17:14:05.751 INFO:tasks.workunit.client.0.smithi012.stdout:6/520: rmdir d13/d29/d37/d3b/daa 39 2023-10-21T17:14:06.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:14:06.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:14:06.687 INFO:tasks.workunit.client.0.smithi012.stdout:6/521: mknod d13/d42/d71/cb2 0 2023-10-21T17:14:06.712 INFO:tasks.workunit.client.0.smithi012.stdout:1/556: write d5/d32/d1b/d27/d21/f31 [459250,42282] 0 2023-10-21T17:14:06.717 INFO:tasks.workunit.client.0.smithi012.stdout:2/592: read d1/d4/d65/fc3 [319324,122609] 0 2023-10-21T17:14:06.761 INFO:tasks.workunit.client.0.smithi012.stdout:1/557: dwrite d5/d32/d1b/d35/d49/f7b [0,4194304] 0 2023-10-21T17:14:06.761 INFO:tasks.workunit.client.0.smithi012.stdout:1/558: dread - d5/d26/d64/f80 zero size 2023-10-21T17:14:06.829 INFO:tasks.workunit.client.0.smithi012.stdout:1/559: dwrite d5/d32/d1b/d27/d21/f37 [0,4194304] 0 2023-10-21T17:14:07.177 INFO:tasks.workunit.client.0.smithi012.stdout:7/529: write d3/d6/dc/d19/d43/f61 [556393,100541] 0 2023-10-21T17:14:07.243 INFO:tasks.workunit.client.0.smithi012.stdout:7/530: dwrite d3/d29/f7d [0,4194304] 0 2023-10-21T17:14:07.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/531: chown d3/d6/dc/d19/d1e/l76 224 1 2023-10-21T17:14:07.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/532: creat d3/d64/fa2 x:0 0 0 2023-10-21T17:14:07.297 INFO:tasks.workunit.client.0.smithi012.stdout:4/559: write dc/d93/f5a [3968419,65534] 0 2023-10-21T17:14:07.297 INFO:tasks.workunit.client.0.smithi012.stdout:4/560: fdatasync dc/d15/d18/d4c/f98 0 2023-10-21T17:14:07.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/496: truncate d2/d4f/d7e/d87/d57/d66/f81 2470823 0 2023-10-21T17:14:07.604 INFO:tasks.workunit.client.0.smithi012.stdout:5/497: truncate d2/d6/f4b 6354987 0 2023-10-21T17:14:07.604 INFO:tasks.workunit.client.0.smithi012.stdout:5/498: chown d2/d1d/fa8 42154694 1 2023-10-21T17:14:07.642 INFO:tasks.workunit.client.0.smithi012.stdout:5/499: dread d2/d1d/d4e/f78 [0,4194304] 0 2023-10-21T17:14:07.682 INFO:tasks.workunit.client.0.smithi012.stdout:2/593: chown d1/d4/d3f/d41/d59/f62 3880905 1 2023-10-21T17:14:07.682 INFO:tasks.workunit.client.0.smithi012.stdout:2/594: truncate d1/d14/d17/f24 1133369 0 2023-10-21T17:14:07.704 INFO:tasks.workunit.client.0.smithi012.stdout:5/500: dwrite d2/d4f/d59/d5b/d15/f9d [0,4194304] 0 2023-10-21T17:14:08.694 INFO:tasks.workunit.client.0.smithi012.stdout:7/533: dread d3/d6/dc/d19/d28/f3b [0,4194304] 0 2023-10-21T17:14:08.987 INFO:tasks.workunit.client.0.smithi012.stdout:6/522: rename ff to d13/d29/d78/fb3 0 2023-10-21T17:14:08.987 INFO:tasks.workunit.client.0.smithi012.stdout:2/595: mkdir d1/d8/d25/dcc 0 2023-10-21T17:14:08.987 INFO:tasks.workunit.client.0.smithi012.stdout:2/596: chown d1/d14/d17 32476470 1 2023-10-21T17:14:08.987 INFO:tasks.workunit.client.0.smithi012.stdout:2/597: fdatasync d1/d4/d93/fc8 0 2023-10-21T17:14:09.502 INFO:tasks.workunit.client.0.smithi012.stdout:5/501: truncate d2/d1d/d20/f2b 4689145 0 2023-10-21T17:14:09.503 INFO:tasks.workunit.client.0.smithi012.stdout:7/534: rmdir d3/d6/dc/d19/d1e/d69/d9c 39 2023-10-21T17:14:09.503 INFO:tasks.workunit.client.0.smithi012.stdout:3/472: rmdir d0/da 39 2023-10-21T17:14:09.503 INFO:tasks.workunit.client.0.smithi012.stdout:7/535: dread - d3/d6/dc/f79 zero size 2023-10-21T17:14:09.505 INFO:tasks.workunit.client.0.smithi012.stdout:9/486: sync 2023-10-21T17:14:09.609 INFO:tasks.workunit.client.0.smithi012.stdout:3/473: dwrite d0/da/f5f [0,4194304] 0 2023-10-21T17:14:10.410 INFO:tasks.workunit.client.0.smithi012.stdout:6/523: symlink d13/d42/d89/lb4 0 2023-10-21T17:14:10.411 INFO:tasks.workunit.client.0.smithi012.stdout:6/524: write d13/d35/d4c/f9e [407939,98040] 0 2023-10-21T17:14:10.922 INFO:tasks.workunit.client.0.smithi012.stdout:8/432: unlink d0/l39 0 2023-10-21T17:14:10.922 INFO:tasks.workunit.client.0.smithi012.stdout:8/433: write d0/d62/d83/f5e [76928,107262] 0 2023-10-21T17:14:11.001 INFO:tasks.workunit.client.0.smithi012.stdout:5/502: mkdir d2/d2c/d73/d49/da9 0 2023-10-21T17:14:11.057 INFO:tasks.workunit.client.0.smithi012.stdout:5/503: dwrite d2/d1d/fa8 [0,4194304] 0 2023-10-21T17:14:11.170 INFO:tasks.workunit.client.0.smithi012.stdout:7/536: unlink d3/d6/dc/d19/d1e/c2a 0 2023-10-21T17:14:11.171 INFO:tasks.workunit.client.0.smithi012.stdout:7/537: write d3/d6/dc/f54 [3551152,115524] 0 2023-10-21T17:14:11.258 INFO:tasks.workunit.client.0.smithi012.stdout:7/538: dwrite d3/d29/f7d [0,4194304] 0 2023-10-21T17:14:11.287 INFO:tasks.workunit.client.0.smithi012.stdout:9/487: dread d0/df/d8d/f38 [0,4194304] 0 2023-10-21T17:14:11.303 INFO:tasks.workunit.client.0.smithi012.stdout:7/539: read d3/d6/dc/f63 [1902051,27419] 0 2023-10-21T17:14:11.317 INFO:tasks.workunit.client.0.smithi012.stdout:7/540: dread d3/d6/dc/d19/f22 [0,4194304] 0 2023-10-21T17:14:11.318 INFO:tasks.workunit.client.0.smithi012.stdout:7/541: write d3/d6/f81 [544385,73925] 0 2023-10-21T17:14:11.568 INFO:tasks.workunit.client.0.smithi012.stdout:3/474: creat d0/d32/f8b x:0 0 0 2023-10-21T17:14:11.679 INFO:tasks.workunit.client.0.smithi012.stdout:1/560: rename d5/d32/d1b/d35/d3a/f79 to d5/d32/d1b/d35/d3a/d93/fc0 0 2023-10-21T17:14:11.935 INFO:tasks.workunit.client.0.smithi012.stdout:6/525: creat d13/d15/d1d/d5d/d66/d70/d74/d98/fb5 x:0 0 0 2023-10-21T17:14:12.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/434: mknod d0/d62/d7d/c93 0 2023-10-21T17:14:12.147 INFO:tasks.workunit.client.0.smithi012.stdout:4/561: dwrite dc/d1e/f44 [0,4194304] 0 2023-10-21T17:14:12.205 INFO:tasks.workunit.client.0.smithi012.stdout:4/562: dwrite dc/d1e/d2b/f5c [0,4194304] 0 2023-10-21T17:14:12.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/563: chown dc/d28/l72 1048 1 2023-10-21T17:14:12.428 INFO:tasks.workunit.client.0.smithi012.stdout:5/504: rmdir d2/d4f/d7e/d87 39 2023-10-21T17:14:12.713 INFO:tasks.workunit.client.0.smithi012.stdout:7/542: link d3/d6/dc/c88 d3/d6/dc/d19/d1e/ca3 0 2023-10-21T17:14:12.714 INFO:tasks.workunit.client.0.smithi012.stdout:7/543: write d3/d6/dc/f79 [987344,82513] 0 2023-10-21T17:14:13.047 INFO:tasks.workunit.client.0.smithi012.stdout:3/475: rename d0/da/d28/c7e to d0/d32/d43/d47/c8c 0 2023-10-21T17:14:13.048 INFO:tasks.workunit.client.0.smithi012.stdout:1/561: symlink d5/d32/d1b/d2c/d4b/d8a/lc1 0 2023-10-21T17:14:13.158 INFO:tasks.workunit.client.0.smithi012.stdout:6/526: rmdir d13/d15/d1d/d28/d5b/d75 39 2023-10-21T17:14:13.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/527: write d13/d35/d4c/f82 [3281435,931] 0 2023-10-21T17:14:13.296 INFO:tasks.workunit.client.0.smithi012.stdout:8/435: truncate d0/d29/f7a 2442119 0 2023-10-21T17:14:13.784 INFO:tasks.workunit.client.0.smithi012.stdout:4/564: link dc/lb8 dc/d15/d18/d4c/d55/d6c/d83/lc1 0 2023-10-21T17:14:13.785 INFO:tasks.workunit.client.0.smithi012.stdout:4/565: dread - dc/d15/d18/d4c/d55/fb1 zero size 2023-10-21T17:14:13.785 INFO:tasks.workunit.client.0.smithi012.stdout:4/566: dread - dc/d15/d18/d4c/d55/d6c/d83/fbd zero size 2023-10-21T17:14:13.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/505: mkdir d2/d4f/d7e/d87/d57/d66/daa 0 2023-10-21T17:14:14.210 INFO:tasks.workunit.client.0.smithi012.stdout:9/488: getdents d0/d4/d4b/d6a/d12/d25/d2f/d8c 0 2023-10-21T17:14:14.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/544: rmdir d3/d6/dc 39 2023-10-21T17:14:14.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/545: write d3/d16/f67 [159688,32866] 0 2023-10-21T17:14:14.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/546: creat d3/d6/dc/d19/d1e/d7b/fa4 x:0 0 0 2023-10-21T17:14:14.549 INFO:tasks.workunit.client.0.smithi012.stdout:1/562: truncate d5/d26/d64/f83 584148 0 2023-10-21T17:14:14.550 INFO:tasks.workunit.client.0.smithi012.stdout:1/563: chown d5/d26/fbe 10471366 1 2023-10-21T17:14:14.641 INFO:tasks.workunit.client.0.smithi012.stdout:1/564: dwrite d5/d32/d1b/d35/f3f [4194304,4194304] 0 2023-10-21T17:14:14.937 INFO:tasks.workunit.client.0.smithi012.stdout:2/598: sync 2023-10-21T17:14:14.937 INFO:tasks.workunit.client.0.smithi012.stdout:0/543: sync 2023-10-21T17:14:14.953 INFO:tasks.workunit.client.0.smithi012.stdout:2/599: dread d1/d14/d16/d20/f8c [0,4194304] 0 2023-10-21T17:14:14.973 INFO:tasks.workunit.client.0.smithi012.stdout:8/436: creat d0/d12/f94 x:0 0 0 2023-10-21T17:14:15.503 INFO:tasks.workunit.client.0.smithi012.stdout:4/567: symlink dc/d93/d99/lc2 0 2023-10-21T17:14:15.551 INFO:tasks.workunit.client.0.smithi012.stdout:5/506: truncate d2/d1d/d20/f4d 1939539 0 2023-10-21T17:14:16.764 INFO:tasks.workunit.client.0.smithi012.stdout:3/476: getdents d0/da/d28 0 2023-10-21T17:14:16.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/565: mknod d5/d32/d1b/d27/d47/cc2 0 2023-10-21T17:14:16.826 INFO:tasks.workunit.client.0.smithi012.stdout:1/566: dread d5/d32/d1b/d2c/d4b/f94 [0,4194304] 0 2023-10-21T17:14:16.934 INFO:tasks.workunit.client.0.smithi012.stdout:1/567: dwrite d5/f8d [0,4194304] 0 2023-10-21T17:14:16.949 INFO:tasks.workunit.client.0.smithi012.stdout:1/568: dread d5/f14 [0,4194304] 0 2023-10-21T17:14:17.453 INFO:tasks.workunit.client.0.smithi012.stdout:0/544: mkdir d7/d55/d23/d27/dcf 0 2023-10-21T17:14:17.453 INFO:tasks.workunit.client.0.smithi012.stdout:2/600: mkdir d1/d14/d16/d22/da5/d50/da3/da9/dcd 0 2023-10-21T17:14:17.472 INFO:tasks.workunit.client.0.smithi012.stdout:8/437: mknod d0/d62/d83/d72/c95 0 2023-10-21T17:14:18.294 INFO:tasks.workunit.client.0.smithi012.stdout:3/477: creat d0/d32/d43/d47/d50/f8d x:0 0 0 2023-10-21T17:14:18.294 INFO:tasks.workunit.client.0.smithi012.stdout:3/478: fdatasync d0/d32/d43/f45 0 2023-10-21T17:14:18.887 INFO:tasks.workunit.client.0.smithi012.stdout:6/528: dwrite d13/f14 [0,4194304] 0 2023-10-21T17:14:18.956 INFO:tasks.workunit.client.0.smithi012.stdout:0/545: stat d7/l17 0 2023-10-21T17:14:18.956 INFO:tasks.workunit.client.0.smithi012.stdout:0/546: rename d7/d55/d23/d27/dcf to d7/d55/d23/d27/dcf/dd0 22 2023-10-21T17:14:18.956 INFO:tasks.workunit.client.0.smithi012.stdout:0/547: readlink d7/l13 0 2023-10-21T17:14:18.983 INFO:tasks.workunit.client.0.smithi012.stdout:0/548: read d7/d55/d23/d27/d31/f91 [3410309,2156] 0 2023-10-21T17:14:19.119 INFO:tasks.workunit.client.0.smithi012.stdout:2/601: unlink d1/d8/f76 0 2023-10-21T17:14:19.119 INFO:tasks.workunit.client.0.smithi012.stdout:2/602: fdatasync d1/d8/ff 0 2023-10-21T17:14:19.140 INFO:tasks.workunit.client.0.smithi012.stdout:2/603: write d1/f2a [1484293,25686] 0 2023-10-21T17:14:19.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/438: creat d0/d62/d83/d72/f96 x:0 0 0 2023-10-21T17:14:19.499 INFO:tasks.workunit.client.0.smithi012.stdout:9/489: symlink d0/d4/la2 0 2023-10-21T17:14:19.571 INFO:tasks.workunit.client.0.smithi012.stdout:9/490: dwrite d0/d4/d4b/d6a/d12/d25/d2f/f62 [0,4194304] 0 2023-10-21T17:14:19.588 INFO:tasks.workunit.client.0.smithi012.stdout:4/568: link dc/d15/d2a/d31/f7e dc/d1e/d2b/fc3 0 2023-10-21T17:14:19.588 INFO:tasks.workunit.client.0.smithi012.stdout:4/569: fsync dc/d15/f80 0 2023-10-21T17:14:19.665 INFO:tasks.workunit.client.0.smithi012.stdout:5/507: getdents d2/d4f/d7e/d87/d57 0 2023-10-21T17:14:19.665 INFO:tasks.workunit.client.0.smithi012.stdout:5/508: read d2/d1d/f56 [2731859,7330] 0 2023-10-21T17:14:19.792 INFO:tasks.workunit.client.0.smithi012.stdout:3/479: read d0/d32/d43/f6f [454721,23438] 0 2023-10-21T17:14:19.792 INFO:tasks.workunit.client.0.smithi012.stdout:3/480: chown d0/d32/d43/c70 7682945 1 2023-10-21T17:14:20.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/547: dwrite d3/f89 [0,4194304] 0 2023-10-21T17:14:20.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/548: chown d3/d6/dc/d19/d1e/d7b 26 1 2023-10-21T17:14:20.454 INFO:tasks.workunit.client.0.smithi012.stdout:7/549: dwrite d3/d6/dc/f79 [0,4194304] 0 2023-10-21T17:14:20.455 INFO:tasks.workunit.client.0.smithi012.stdout:7/550: read - d3/d64/fa2 zero size 2023-10-21T17:14:20.541 INFO:tasks.workunit.client.0.smithi012.stdout:0/549: creat d7/d55/d23/d66/da8/fd1 x:0 0 0 2023-10-21T17:14:20.541 INFO:tasks.workunit.client.0.smithi012.stdout:0/550: fsync d7/d55/d23/d27/d31/f3e 0 2023-10-21T17:14:20.900 INFO:tasks.workunit.client.0.smithi012.stdout:2/604: symlink d1/d14/d16/d20/lce 0 2023-10-21T17:14:20.901 INFO:tasks.workunit.client.0.smithi012.stdout:2/605: stat d1/l78 0 2023-10-21T17:14:20.901 INFO:tasks.workunit.client.0.smithi012.stdout:2/606: fsync d1/d14/d16/d22/da5/d50/f9c 0 2023-10-21T17:14:20.909 INFO:tasks.workunit.client.0.smithi012.stdout:2/607: write d1/d8/d25/d5f/f90 [211842,117491] 0 2023-10-21T17:14:21.641 INFO:tasks.workunit.client.0.smithi012.stdout:9/491: mknod d0/d4/d4b/d6a/d12/d25/d39/d8e/ca3 0 2023-10-21T17:14:21.641 INFO:tasks.workunit.client.0.smithi012.stdout:4/570: mknod dc/d1e/d65/cc4 0 2023-10-21T17:14:21.710 INFO:tasks.workunit.client.0.smithi012.stdout:5/509: rename d2/d4f/f6e to d2/d2c/fab 0 2023-10-21T17:14:21.791 INFO:tasks.workunit.client.0.smithi012.stdout:3/481: truncate d0/d1c/f6a 2638653 0 2023-10-21T17:14:21.791 INFO:tasks.workunit.client.0.smithi012.stdout:3/482: fsync d0/d1c/f71 0 2023-10-21T17:14:21.814 INFO:tasks.workunit.client.0.smithi012.stdout:5/510: dwrite d2/d1d/d4e/f65 [0,4194304] 0 2023-10-21T17:14:21.898 INFO:tasks.workunit.client.0.smithi012.stdout:5/511: dwrite d2/d4f/d59/d5b/d15/f9d [0,4194304] 0 2023-10-21T17:14:22.074 INFO:tasks.workunit.client.0.smithi012.stdout:6/529: getdents d13/d15/d1d/d5d/d66/d70/d74/d98 0 2023-10-21T17:14:22.318 INFO:tasks.workunit.client.0.smithi012.stdout:7/551: symlink d3/d6/d6a/la5 0 2023-10-21T17:14:22.318 INFO:tasks.workunit.client.0.smithi012.stdout:7/552: chown d3/c40 68597759 1 2023-10-21T17:14:22.354 INFO:tasks.workunit.client.0.smithi012.stdout:7/553: dread d3/d6/dc/d19/d28/f6d [0,4194304] 0 2023-10-21T17:14:22.900 INFO:tasks.workunit.client.0.smithi012.stdout:9/492: creat d0/d4/fa4 x:0 0 0 2023-10-21T17:14:22.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/571: symlink dc/d15/d2a/d58/lc5 0 2023-10-21T17:14:22.943 INFO:tasks.workunit.client.0.smithi012.stdout:9/493: dread d0/f5a [0,4194304] 0 2023-10-21T17:14:22.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/483: creat d0/d32/d43/d47/d50/d52/f8e x:0 0 0 2023-10-21T17:14:22.947 INFO:tasks.workunit.client.0.smithi012.stdout:6/530: symlink d13/d15/d1d/d28/d5b/lb6 0 2023-10-21T17:14:22.977 INFO:tasks.workunit.client.0.smithi012.stdout:9/494: dread d0/d15/f9f [0,4194304] 0 2023-10-21T17:14:23.485 INFO:tasks.workunit.client.0.smithi012.stdout:4/572: link dc/d1e/d2b/fc3 dc/d15/d18/fc6 0 2023-10-21T17:14:23.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/573: dread dc/f42 [0,4194304] 0 2023-10-21T17:14:23.649 INFO:tasks.workunit.client.0.smithi012.stdout:3/484: truncate d0/f3b 1783831 0 2023-10-21T17:14:23.771 INFO:tasks.workunit.client.0.smithi012.stdout:6/531: mkdir d13/d35/db7 0 2023-10-21T17:14:23.902 INFO:tasks.workunit.client.0.smithi012.stdout:9/495: mkdir d0/d4/d4b/d6a/d12/d25/d39/d3b/d67/da5 0 2023-10-21T17:14:24.067 INFO:tasks.workunit.client.0.smithi012.stdout:4/574: mkdir dc/d1e/dc7 0 2023-10-21T17:14:24.210 INFO:tasks.workunit.client.0.smithi012.stdout:3/485: symlink d0/d32/d43/l8f 0 2023-10-21T17:14:24.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/486: dwrite d0/f46 [0,4194304] 0 2023-10-21T17:14:24.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/487: fdatasync d0/da/f26 0 2023-10-21T17:14:24.341 INFO:tasks.workunit.client.0.smithi012.stdout:6/532: rmdir d13/d15/d1d/d24/d9f/db0 0 2023-10-21T17:14:24.858 INFO:tasks.workunit.client.0.smithi012.stdout:1/569: write d5/d26/d54/f63 [1101964,3736] 0 2023-10-21T17:14:24.859 INFO:tasks.workunit.client.0.smithi012.stdout:1/570: write d5/d32/d1b/d35/d49/d69/f9b [22897,57083] 0 2023-10-21T17:14:25.143 INFO:tasks.workunit.client.0.smithi012.stdout:8/439: write d0/fb [6749125,74103] 0 2023-10-21T17:14:25.143 INFO:tasks.workunit.client.0.smithi012.stdout:8/440: write d0/d12/d40/f82 [799166,40184] 0 2023-10-21T17:14:25.562 INFO:tasks.workunit.client.0.smithi012.stdout:1/571: write d5/d32/d1b/d35/d3a/d5c/f85 [614891,115652] 0 2023-10-21T17:14:26.237 INFO:tasks.workunit.client.0.smithi012.stdout:1/572: creat d5/d32/d1b/d35/d3a/d5c/fc3 x:0 0 0 2023-10-21T17:14:26.522 INFO:tasks.workunit.client.0.smithi012.stdout:2/608: sync 2023-10-21T17:14:26.523 INFO:tasks.workunit.client.0.smithi012.stdout:2/609: fsync d1/d4/d65/fc3 0 2023-10-21T17:14:26.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/488: dwrite d0/f2b [0,4194304] 0 2023-10-21T17:14:26.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/489: fdatasync d0/d32/d43/d47/d50/d52/f53 0 2023-10-21T17:14:26.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/490: readlink d0/l30 0 2023-10-21T17:14:26.805 INFO:tasks.workunit.client.0.smithi012.stdout:3/491: chown d0/d1c/l2e 120783608 1 2023-10-21T17:14:26.895 INFO:tasks.workunit.client.0.smithi012.stdout:0/551: rename d7/l17 to d7/d55/d23/d27/dc6/ld2 0 2023-10-21T17:14:27.227 INFO:tasks.workunit.client.0.smithi012.stdout:2/610: stat d1/d4/d3f/d41/d59/c7e 0 2023-10-21T17:14:27.258 INFO:tasks.workunit.client.0.smithi012.stdout:2/611: write d1/f30 [1286091,53884] 0 2023-10-21T17:14:27.259 INFO:tasks.workunit.client.0.smithi012.stdout:2/612: write d1/d14/d16/d22/da5/d34/fbb [525957,75125] 0 2023-10-21T17:14:27.723 INFO:tasks.workunit.client.0.smithi012.stdout:0/552: mkdir d7/d52/dd3 0 2023-10-21T17:14:27.724 INFO:tasks.workunit.client.0.smithi012.stdout:0/553: dread - d7/d52/f77 zero size 2023-10-21T17:14:27.786 INFO:tasks.workunit.client.0.smithi012.stdout:2/613: truncate d1/d8/ff 3667503 0 2023-10-21T17:14:27.786 INFO:tasks.workunit.client.0.smithi012.stdout:2/614: dread - d1/d8/fb2 zero size 2023-10-21T17:14:27.787 INFO:tasks.workunit.client.0.smithi012.stdout:2/615: chown d1/d14/d16/d22/da5/db7/fc6 0 1 2023-10-21T17:14:28.103 INFO:tasks.workunit.client.0.smithi012.stdout:7/554: creat d3/d6/dc/fa6 x:0 0 0 2023-10-21T17:14:28.103 INFO:tasks.workunit.client.0.smithi012.stdout:3/492: link d0/f4 d0/d32/f90 0 2023-10-21T17:14:28.103 INFO:tasks.workunit.client.0.smithi012.stdout:9/496: rename d0/df/ca1 to d0/d4/d4b/ca6 0 2023-10-21T17:14:28.147 INFO:tasks.workunit.client.0.smithi012.stdout:3/493: write d0/f2b [4994552,86825] 0 2023-10-21T17:14:28.206 INFO:tasks.workunit.client.0.smithi012.stdout:8/441: dwrite d0/f17 [0,4194304] 0 2023-10-21T17:14:28.206 INFO:tasks.workunit.client.0.smithi012.stdout:8/442: dread - d0/d12/f94 zero size 2023-10-21T17:14:28.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/554: getdents d7/d55/d23/d66/d48/db7 0 2023-10-21T17:14:28.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/555: creat d7/d55/d1f/d28/fd4 x:0 0 0 2023-10-21T17:14:28.303 INFO:tasks.workunit.client.0.smithi012.stdout:8/443: dwrite d0/d62/f73 [0,4194304] 0 2023-10-21T17:14:28.330 INFO:tasks.workunit.client.0.smithi012.stdout:8/444: read d0/fe [756621,122430] 0 2023-10-21T17:14:28.452 INFO:tasks.workunit.client.0.smithi012.stdout:1/573: rmdir d5/d32/d1b/d27 39 2023-10-21T17:14:28.452 INFO:tasks.workunit.client.0.smithi012.stdout:1/574: fsync d5/d61/f9e 0 2023-10-21T17:14:28.975 INFO:tasks.workunit.client.0.smithi012.stdout:9/497: dread d0/d4/d4b/d6a/d12/d25/d39/f5b [0,4194304] 0 2023-10-21T17:14:29.046 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:47:55.029 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.047 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:47:55.131 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.048 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:47:55.133 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.050 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:47:55.135 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.053 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:47:55.137 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.064 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:47:55.047 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/494: creat d0/d32/d43/d47/f91 x:0 0 0 2023-10-21T17:14:29.108 INFO:tasks.workunit.client.0.smithi012.stdout:3/495: write d0/da/d28/f3c [1711718,91784] 0 2023-10-21T17:14:29.129 INFO:tasks.workunit.client.0.smithi012.stdout:3/496: dread d0/da/f86 [0,4194304] 0 2023-10-21T17:14:29.157 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:47:55.242 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.162 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:47:55.246 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.233 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:47:55.216 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:14:29.307 INFO:tasks.workunit.client.0.smithi012.stdout:5/512: sync 2023-10-21T17:14:29.374 INFO:tasks.workunit.client.0.smithi012.stdout:5/513: dwrite d2/d4f/fa4 [0,4194304] 0 2023-10-21T17:14:29.410 INFO:tasks.workunit.client.0.smithi012.stdout:5/514: write d2/d4f/d7e/d87/f6b [2462861,128327] 0 2023-10-21T17:14:29.410 INFO:tasks.workunit.client.0.smithi012.stdout:5/515: getdents d2/d4f/d7e/d87/d57/d66/daa 0 2023-10-21T17:14:29.410 INFO:tasks.workunit.client.0.smithi012.stdout:5/516: chown d2/d4f/d59/d5b 23 1 2023-10-21T17:14:29.435 INFO:tasks.workunit.client.0.smithi012.stdout:5/517: dread d2/d1d/fa8 [0,4194304] 0 2023-10-21T17:14:30.022 INFO:tasks.workunit.client.0.smithi012.stdout:3/497: symlink d0/d32/d43/d47/d50/d52/l92 0 2023-10-21T17:14:30.163 INFO:tasks.workunit.client.0.smithi012.stdout:9/498: mkdir d0/da7 0 2023-10-21T17:14:30.690 INFO:tasks.workunit.client.0.smithi012.stdout:4/575: sync 2023-10-21T17:14:31.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/616: write d1/d14/d16/d22/da5/d50/f79 [572936,112398] 0 2023-10-21T17:14:31.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/518: creat d2/d2c/d73/d49/fac x:0 0 0 2023-10-21T17:14:31.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/519: write d2/d2c/fab [5200088,23741] 0 2023-10-21T17:14:31.697 INFO:tasks.workunit.client.0.smithi012.stdout:7/555: dwrite d3/d16/f1a [0,4194304] 0 2023-10-21T17:14:31.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/533: rename d13/d15/d1d/d24 to d13/d42/d89/db8 0 2023-10-21T17:14:31.875 INFO:tasks.workunit.client.0.smithi012.stdout:6/534: dwrite d13/d15/d1d/f20 [0,4194304] 0 2023-10-21T17:14:31.960 INFO:tasks.workunit.client.0.smithi012.stdout:3/498: unlink d0/d32/l88 0 2023-10-21T17:14:32.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/617: link d1/d14/d16/f72 d1/d14/d16/d22/da5/d50/da3/da9/dcd/fcf 0 2023-10-21T17:14:32.719 INFO:tasks.workunit.client.0.smithi012.stdout:4/576: truncate dc/d93/f5a 2804037 0 2023-10-21T17:14:32.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/618: dread d1/d14/d16/f72 [0,4194304] 0 2023-10-21T17:14:32.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/619: chown d1/d14/d16/f72 349703 1 2023-10-21T17:14:32.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/620: truncate d1/d4/d93/fb4 403333 0 2023-10-21T17:14:32.737 INFO:tasks.workunit.client.0.smithi012.stdout:2/621: fdatasync d1/d14/d17/f92 0 2023-10-21T17:14:32.737 INFO:tasks.workunit.client.0.smithi012.stdout:2/622: chown d1/d14/d16/d22/da5/d34 0 1 2023-10-21T17:14:32.910 INFO:tasks.workunit.client.0.smithi012.stdout:5/520: getdents d2/d4f/d59/d5b 0 2023-10-21T17:14:32.984 INFO:tasks.workunit.client.0.smithi012.stdout:5/521: dwrite d2/d1d/d4e/f78 [0,4194304] 0 2023-10-21T17:14:33.101 INFO:tasks.workunit.client.0.smithi012.stdout:0/556: rename d7/d55/d23/d30/d8c/fac to d7/d81/fd5 0 2023-10-21T17:14:33.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/499: creat d0/d4/d4b/d6a/d12/d25/fa8 x:0 0 0 2023-10-21T17:14:33.735 INFO:tasks.workunit.client.0.smithi012.stdout:9/500: chown d0/d15/f92 104493 1 2023-10-21T17:14:33.735 INFO:tasks.workunit.client.0.smithi012.stdout:9/501: readlink d0/df/l1f 0 2023-10-21T17:14:33.735 INFO:tasks.workunit.client.0.smithi012.stdout:9/502: chown d0/d4/c5f 14807868 1 2023-10-21T17:14:33.918 INFO:tasks.workunit.client.0.smithi012.stdout:4/577: creat dc/d1e/d91/fc8 x:0 0 0 2023-10-21T17:14:34.063 INFO:tasks.workunit.client.0.smithi012.stdout:2/623: mkdir d1/d14/d17/da6/dd0 0 2023-10-21T17:14:34.063 INFO:tasks.workunit.client.0.smithi012.stdout:2/624: write d1/d14/d16/d22/d82/d86/fa0 [5125773,38311] 0 2023-10-21T17:14:34.465 INFO:tasks.workunit.client.0.smithi012.stdout:8/445: rename d0/d12/d40/f82 to d0/d29/d79/f97 0 2023-10-21T17:14:34.507 INFO:tasks.workunit.client.0.smithi012.stdout:8/446: dread d0/d29/f59 [0,4194304] 0 2023-10-21T17:14:34.693 INFO:tasks.workunit.client.0.smithi012.stdout:0/557: creat d7/d55/d23/d66/d63/fd6 x:0 0 0 2023-10-21T17:14:34.694 INFO:tasks.workunit.client.0.smithi012.stdout:6/535: getdents d13/d64/d6d 0 2023-10-21T17:14:34.722 INFO:tasks.workunit.client.0.smithi012.stdout:0/558: dread d7/d55/d23/d66/f37 [0,4194304] 0 2023-10-21T17:14:34.722 INFO:tasks.workunit.client.0.smithi012.stdout:0/559: dread - d7/d55/d23/f46 zero size 2023-10-21T17:14:34.762 INFO:tasks.workunit.client.0.smithi012.stdout:9/503: symlink d0/la9 0 2023-10-21T17:14:34.763 INFO:tasks.workunit.client.0.smithi012.stdout:9/504: readlink d0/df/l95 0 2023-10-21T17:14:34.794 INFO:tasks.workunit.client.0.smithi012.stdout:9/505: read d0/df/d8d/f38 [1075888,41527] 0 2023-10-21T17:14:34.833 INFO:tasks.workunit.client.0.smithi012.stdout:9/506: dread d0/d4/d4b/d6a/d12/f55 [0,4194304] 0 2023-10-21T17:14:34.918 INFO:tasks.workunit.client.0.smithi012.stdout:4/578: symlink dc/d6b/lc9 0 2023-10-21T17:14:34.921 INFO:tasks.workunit.client.0.smithi012.stdout:4/579: write dc/d15/d18/fc6 [200162,64485] 0 2023-10-21T17:14:35.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/625: mkdir d1/d8/d25/d5f/dd1 0 2023-10-21T17:14:35.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/626: chown d1/d8/cc5 429891 1 2023-10-21T17:14:35.909 INFO:tasks.workunit.client.0.smithi012.stdout:1/575: rename d5/d32/d1b/d2c/l53 to d5/d32/d1b/d27/d1a/lc4 0 2023-10-21T17:14:35.986 INFO:tasks.workunit.client.0.smithi012.stdout:1/576: dwrite d5/f11 [0,4194304] 0 2023-10-21T17:14:35.986 INFO:tasks.workunit.client.0.smithi012.stdout:1/577: readlink d5/d32/d1b/d27/d21/l24 0 2023-10-21T17:14:35.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/578: stat d5/d32/d1b/d35/faa 0 2023-10-21T17:14:36.004 INFO:tasks.workunit.client.0.smithi012.stdout:1/579: dread d5/d32/d1b/d35/d3a/d5c/f85 [0,4194304] 0 2023-10-21T17:14:36.088 INFO:tasks.workunit.client.0.smithi012.stdout:8/447: dread d0/d1a/f33 [0,4194304] 0 2023-10-21T17:14:36.213 INFO:tasks.workunit.client.0.smithi012.stdout:6/536: rmdir d13/d15/d1d/d5d 39 2023-10-21T17:14:36.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:14:36.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:14:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:0/560: mkdir d7/d55/d23/d27/da1/dd7 0 2023-10-21T17:14:36.470 INFO:tasks.workunit.client.0.smithi012.stdout:9/507: getdents d0/d4/d4b/d6a/d12/d25/d39/d3b/d67 0 2023-10-21T17:14:36.503 INFO:tasks.workunit.client.0.smithi012.stdout:9/508: dread d0/f3e [0,4194304] 0 2023-10-21T17:14:36.503 INFO:tasks.workunit.client.0.smithi012.stdout:9/509: fdatasync d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 0 2023-10-21T17:14:36.532 INFO:tasks.workunit.client.0.smithi012.stdout:9/510: dread d0/d15/f88 [0,4194304] 0 2023-10-21T17:14:36.532 INFO:tasks.workunit.client.0.smithi012.stdout:9/511: creat d0/d15/faa x:0 0 0 2023-10-21T17:14:36.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/512: chown d0/d4/d4b/d6a/d12/d25/d2f/d8c/f9a 24797 1 2023-10-21T17:14:36.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/513: read - d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 zero size 2023-10-21T17:14:36.658 INFO:tasks.workunit.client.0.smithi012.stdout:4/580: mknod dc/d15/d18/cca 0 2023-10-21T17:14:37.022 INFO:tasks.workunit.client.0.smithi012.stdout:3/499: rename d0/da/d28/c55 to d0/d1c/c93 0 2023-10-21T17:14:37.518 INFO:tasks.workunit.client.0.smithi012.stdout:8/448: getdents d0/d12/d6c 0 2023-10-21T17:14:37.607 INFO:tasks.workunit.client.0.smithi012.stdout:8/449: dwrite d0/d62/f6b [0,4194304] 0 2023-10-21T17:14:37.693 INFO:tasks.workunit.client.0.smithi012.stdout:8/450: dwrite d0/f4 [0,4194304] 0 2023-10-21T17:14:37.806 INFO:tasks.workunit.client.0.smithi012.stdout:6/537: creat d13/d42/d89/db8/fb9 x:0 0 0 2023-10-21T17:14:37.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/514: getdents d0/df/d44 0 2023-10-21T17:14:37.859 INFO:tasks.workunit.client.0.smithi012.stdout:4/581: creat dc/d15/d18/d4c/d55/d6c/dbb/fcb x:0 0 0 2023-10-21T17:14:38.199 INFO:tasks.workunit.client.0.smithi012.stdout:5/522: rename d2/d4f/d59/d5b/f64 to d2/d4f/d7e/d87/d57/fad 0 2023-10-21T17:14:38.229 INFO:tasks.workunit.client.0.smithi012.stdout:5/523: write d2/d2c/f43 [2957793,49812] 0 2023-10-21T17:14:38.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/451: mknod d0/d12/d40/d91/c98 0 2023-10-21T17:14:38.559 INFO:tasks.workunit.client.0.smithi012.stdout:8/452: dwrite d0/d62/d83/d72/f96 [0,4194304] 0 2023-10-21T17:14:38.619 INFO:tasks.workunit.client.0.smithi012.stdout:6/538: link d13/d15/d1d/d28/l3d d13/d15/d1d/lba 0 2023-10-21T17:14:38.669 INFO:tasks.workunit.client.0.smithi012.stdout:9/515: getdents d0/d4/d4b/d6a/d12/d25/d39 0 2023-10-21T17:14:38.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/582: mkdir dc/d1e/dc7/dcc 0 2023-10-21T17:14:38.869 INFO:tasks.workunit.client.0.smithi012.stdout:4/583: creat dc/d15/d18/d4c/d75/fcd x:0 0 0 2023-10-21T17:14:39.112 INFO:tasks.workunit.client.0.smithi012.stdout:1/580: rename d5/d32/d1b/d2c/d4b/cba to d5/d26/cc5 0 2023-10-21T17:14:39.364 INFO:tasks.workunit.client.0.smithi012.stdout:5/524: read d2/d4f/d7e/d87/f6b [4135316,23308] 0 2023-10-21T17:14:39.808 INFO:tasks.workunit.client.0.smithi012.stdout:2/627: truncate d1/d14/d16/d22/d82/d86/fa0 4259330 0 2023-10-21T17:14:39.808 INFO:tasks.workunit.client.0.smithi012.stdout:8/453: symlink d0/d12/d80/l99 0 2023-10-21T17:14:39.871 INFO:tasks.workunit.client.0.smithi012.stdout:2/628: dread d1/d4/d3f/d41/d59/fb5 [0,4194304] 0 2023-10-21T17:14:39.908 INFO:tasks.workunit.client.0.smithi012.stdout:8/454: dwrite d0/f4 [0,4194304] 0 2023-10-21T17:14:39.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/455: creat d0/d46/f9a x:0 0 0 2023-10-21T17:14:39.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/456: write d0/d46/f9a [1004808,49253] 0 2023-10-21T17:14:39.939 INFO:tasks.workunit.client.0.smithi012.stdout:6/539: mkdir d13/d42/d71/dbb 0 2023-10-21T17:14:40.172 INFO:tasks.workunit.client.0.smithi012.stdout:9/516: truncate d0/f5a 2470186 0 2023-10-21T17:14:40.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/584: mkdir dc/d15/d2a/dce 0 2023-10-21T17:14:40.424 INFO:tasks.workunit.client.0.smithi012.stdout:4/585: write dc/d15/f80 [2145794,97923] 0 2023-10-21T17:14:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:7/556: mkdir d3/da7 0 2023-10-21T17:14:40.532 INFO:tasks.workunit.client.0.smithi012.stdout:7/557: chown d3/d6/dc/d19/l6e 50198432 1 2023-10-21T17:14:40.619 INFO:tasks.workunit.client.0.smithi012.stdout:5/525: rename d2/d6/f6a to d2/d1d/d4e/fae 0 2023-10-21T17:14:41.317 INFO:tasks.workunit.client.0.smithi012.stdout:3/500: rmdir d0 39 2023-10-21T17:14:41.579 INFO:tasks.workunit.client.0.smithi012.stdout:6/540: rmdir d13/d35/db7 0 2023-10-21T17:14:41.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/517: truncate d0/d4/d4b/d6a/d12/f55 4003631 0 2023-10-21T17:14:41.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/518: getdents d0/d5/d9c 0 2023-10-21T17:14:41.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/519: truncate d0/d4/d4b/d6a/d12/d25/d2f/d8c/f9a 51846 0 2023-10-21T17:14:41.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/520: dread - d0/f78 zero size 2023-10-21T17:14:41.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/521: write d0/d4/d4b/f4c [4239098,71667] 0 2023-10-21T17:14:41.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/522: dread - d0/d4/d4b/f99 zero size 2023-10-21T17:14:42.016 INFO:tasks.workunit.client.0.smithi012.stdout:4/586: link dc/f25 dc/d15/d18/d57/fcf 0 2023-10-21T17:14:42.189 INFO:tasks.workunit.client.0.smithi012.stdout:7/558: mkdir d3/d6/dc/d19/d1e/d34/da8 0 2023-10-21T17:14:42.486 INFO:tasks.workunit.client.0.smithi012.stdout:8/457: rename d0/d1a/d54/l74 to d0/d12/d80/l9b 0 2023-10-21T17:14:42.486 INFO:tasks.workunit.client.0.smithi012.stdout:8/458: chown d0/f36 17 1 2023-10-21T17:14:42.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/526: dread d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:14:42.686 INFO:tasks.workunit.client.0.smithi012.stdout:5/527: write d2/d4f/d59/f89 [809236,93794] 0 2023-10-21T17:14:42.686 INFO:tasks.workunit.client.0.smithi012.stdout:5/528: fdatasync d2/d1d/f8e 0 2023-10-21T17:14:42.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/529: readlink d2/d4f/d59/d5b/l12 0 2023-10-21T17:14:42.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/530: truncate d2/d4f/d7e/d87/d57/f9f 569889 0 2023-10-21T17:14:42.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/531: write d2/fa0 [527601,85709] 0 2023-10-21T17:14:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:0/561: dwrite d7/d55/d1f/f2e [0,4194304] 0 2023-10-21T17:14:43.078 INFO:tasks.workunit.client.0.smithi012.stdout:0/562: dread d7/d55/d23/d66/d63/fae [0,4194304] 0 2023-10-21T17:14:43.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/541: getdents d13/d29/d77 0 2023-10-21T17:14:43.406 INFO:tasks.workunit.client.0.smithi012.stdout:9/523: symlink d0/d4/d4b/d6a/d12/d25/lab 0 2023-10-21T17:14:43.407 INFO:tasks.workunit.client.0.smithi012.stdout:9/524: chown d0/df/d44 119551 1 2023-10-21T17:14:43.680 INFO:tasks.workunit.client.0.smithi012.stdout:4/587: link dc/d15/d2a/d58/f92 dc/d15/d18/d4c/d75/fd0 0 2023-10-21T17:14:43.681 INFO:tasks.workunit.client.0.smithi012.stdout:4/588: readlink dc/d93/l56 0 2023-10-21T17:14:43.681 INFO:tasks.workunit.client.0.smithi012.stdout:4/589: truncate dc/d6b/f9b 161670 0 2023-10-21T17:14:43.681 INFO:tasks.workunit.client.0.smithi012.stdout:4/590: readlink dc/d15/d2a/d58/lc5 0 2023-10-21T17:14:43.682 INFO:tasks.workunit.client.0.smithi012.stdout:4/591: truncate dc/d15/d18/fc6 898419 0 2023-10-21T17:14:43.923 INFO:tasks.workunit.client.0.smithi012.stdout:7/559: link d3/d29/f52 d3/d6/dc/d19/d28/da0/fa9 0 2023-10-21T17:14:43.923 INFO:tasks.workunit.client.0.smithi012.stdout:7/560: write d3/f83 [404167,123676] 0 2023-10-21T17:14:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:8/459: link d0/d29/f87 d0/d46/f9c 0 2023-10-21T17:14:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:8/460: fdatasync d0/d62/f68 0 2023-10-21T17:14:44.495 INFO:tasks.workunit.client.0.smithi012.stdout:5/532: mkdir d2/d4f/d7e/daf 0 2023-10-21T17:14:44.495 INFO:tasks.workunit.client.0.smithi012.stdout:5/533: dread - d2/d4f/d7e/d87/d57/f9b zero size 2023-10-21T17:14:44.591 INFO:tasks.workunit.client.0.smithi012.stdout:5/534: dwrite d2/d4f/f94 [0,4194304] 0 2023-10-21T17:14:45.165 INFO:tasks.workunit.client.0.smithi012.stdout:9/525: mknod d0/d4/d4b/d6a/d12/d25/d39/d3b/d67/cac 0 2023-10-21T17:14:45.165 INFO:tasks.workunit.client.0.smithi012.stdout:9/526: chown d0/d5/l1e 226 1 2023-10-21T17:14:45.467 INFO:tasks.workunit.client.0.smithi012.stdout:4/592: symlink dc/d1e/d33/d8a/ld1 0 2023-10-21T17:14:45.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/593: chown dc/d1e/d65/f66 54 1 2023-10-21T17:14:45.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/594: chown dc/d15/d18/f71 14739 1 2023-10-21T17:14:45.814 INFO:tasks.workunit.client.0.smithi012.stdout:7/561: symlink d3/d6/dc/d19/d1e/d7b/laa 0 2023-10-21T17:14:45.815 INFO:tasks.workunit.client.0.smithi012.stdout:7/562: chown d3/d6/dc/d19/d28/l8f 1561694 1 2023-10-21T17:14:45.939 INFO:tasks.workunit.client.0.smithi012.stdout:1/581: dwrite d5/d32/d1b/d27/d1a/d46/f60 [4194304,4194304] 0 2023-10-21T17:14:46.507 INFO:tasks.workunit.client.0.smithi012.stdout:5/535: dread d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:14:46.853 INFO:tasks.workunit.client.0.smithi012.stdout:9/527: creat d0/df/d8d/fad x:0 0 0 2023-10-21T17:14:47.234 INFO:tasks.workunit.client.0.smithi012.stdout:4/595: mknod dc/d15/d18/d4c/d55/d6c/d83/cd2 0 2023-10-21T17:14:47.235 INFO:tasks.workunit.client.0.smithi012.stdout:4/596: creat dc/d15/d18/d4c/d55/d6c/d83/fd3 x:0 0 0 2023-10-21T17:14:47.969 INFO:tasks.workunit.client.0.smithi012.stdout:7/563: creat d3/d6/dc/d19/d1e/d34/da8/fab x:0 0 0 2023-10-21T17:14:48.000 INFO:tasks.workunit.client.0.smithi012.stdout:3/501: symlink d0/l94 0 2023-10-21T17:14:48.604 INFO:tasks.workunit.client.0.smithi012.stdout:0/563: rmdir d7/d81 39 2023-10-21T17:14:48.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/528: rename d0/df/d8d/d8a/f94 to d0/d4/d4b/d6a/fae 0 2023-10-21T17:14:48.905 INFO:tasks.workunit.client.0.smithi012.stdout:2/629: sync 2023-10-21T17:14:49.061 INFO:tasks.workunit.client.0.smithi012.stdout:4/597: rmdir dc/d15/d2a/d58 39 2023-10-21T17:14:49.641 INFO:tasks.workunit.client.0.smithi012.stdout:0/564: mknod d7/d55/da2/cd8 0 2023-10-21T17:14:49.642 INFO:tasks.workunit.client.0.smithi012.stdout:0/565: write d7/d52/f77 [354972,44655] 0 2023-10-21T17:14:49.805 INFO:tasks.workunit.client.0.smithi012.stdout:8/461: link d0/l25 d0/d1a/l9d 0 2023-10-21T17:14:50.082 INFO:tasks.workunit.client.0.smithi012.stdout:9/529: link d0/d4/d4b/l90 d0/d4/d4b/d6a/d89/laf 0 2023-10-21T17:14:50.284 INFO:tasks.workunit.client.0.smithi012.stdout:2/630: symlink d1/d8/ld2 0 2023-10-21T17:14:50.475 INFO:tasks.workunit.client.0.smithi012.stdout:4/598: link dc/d15/d18/d4c/d55/d6c/dbb/fcb dc/d15/d18/d4c/fd4 0 2023-10-21T17:14:50.476 INFO:tasks.workunit.client.0.smithi012.stdout:4/599: write dc/d15/d18/d4c/fb3 [252492,34849] 0 2023-10-21T17:14:50.476 INFO:tasks.workunit.client.0.smithi012.stdout:4/600: chown dc/d1e/f3e 5 1 2023-10-21T17:14:50.650 INFO:tasks.workunit.client.0.smithi012.stdout:0/566: mknod d7/d52/cd9 0 2023-10-21T17:14:50.723 INFO:tasks.workunit.client.0.smithi012.stdout:8/462: symlink d0/d29/l9e 0 2023-10-21T17:14:50.824 INFO:tasks.workunit.client.0.smithi012.stdout:8/463: dwrite d0/f27 [0,4194304] 0 2023-10-21T17:14:50.918 INFO:tasks.workunit.client.0.smithi012.stdout:3/502: rename d0/d32/c72 to d0/d32/d43/c95 0 2023-10-21T17:14:50.918 INFO:tasks.workunit.client.0.smithi012.stdout:3/503: chown d0/d32/d43/f6f 18271807 1 2023-10-21T17:14:50.919 INFO:tasks.workunit.client.0.smithi012.stdout:3/504: stat d0/d32/f90 0 2023-10-21T17:14:50.992 INFO:tasks.workunit.client.0.smithi012.stdout:3/505: dwrite d0/d32/d43/d47/f91 [0,4194304] 0 2023-10-21T17:14:51.015 INFO:tasks.workunit.client.0.smithi012.stdout:3/506: dread d0/da/d28/f3c [0,4194304] 0 2023-10-21T17:14:51.015 INFO:tasks.workunit.client.0.smithi012.stdout:3/507: read - d0/d1c/d5e/f84 zero size 2023-10-21T17:14:51.556 INFO:tasks.workunit.client.0.smithi012.stdout:6/542: write d13/d15/f1a [1152914,29376] 0 2023-10-21T17:14:51.632 INFO:tasks.workunit.client.0.smithi012.stdout:6/543: dwrite d13/d35/d4c/f65 [0,4194304] 0 2023-10-21T17:14:51.633 INFO:tasks.workunit.client.0.smithi012.stdout:0/567: rename d7/d55/d23/d27/d31/d3d/lb8 to d7/d55/d23/d27/d31/d3d/lda 0 2023-10-21T17:14:51.699 INFO:tasks.workunit.client.0.smithi012.stdout:0/568: dwrite d7/d55/f14 [0,4194304] 0 2023-10-21T17:14:51.699 INFO:tasks.workunit.client.0.smithi012.stdout:0/569: dread - d7/d52/fc1 zero size 2023-10-21T17:14:51.770 INFO:tasks.workunit.client.0.smithi012.stdout:8/464: rmdir d0/d12/d51 39 2023-10-21T17:14:51.784 INFO:tasks.workunit.client.0.smithi012.stdout:0/570: dwrite d7/f98 [0,4194304] 0 2023-10-21T17:14:52.577 INFO:tasks.workunit.client.0.smithi012.stdout:8/465: creat d0/d62/d83/d4e/f9f x:0 0 0 2023-10-21T17:14:52.787 INFO:tasks.workunit.client.0.smithi012.stdout:0/571: creat d7/d52/dd3/fdb x:0 0 0 2023-10-21T17:14:52.831 INFO:tasks.workunit.client.0.smithi012.stdout:0/572: dread d7/f10 [0,4194304] 0 2023-10-21T17:14:52.992 INFO:tasks.workunit.client.0.smithi012.stdout:3/508: mkdir d0/d96 0 2023-10-21T17:14:52.993 INFO:tasks.workunit.client.0.smithi012.stdout:3/509: fsync d0/da/f5f 0 2023-10-21T17:14:53.270 INFO:tasks.workunit.client.0.smithi012.stdout:0/573: mkdir d7/d55/d23/dce/ddc 0 2023-10-21T17:14:53.386 INFO:tasks.workunit.client.0.smithi012.stdout:3/510: mkdir d0/d96/d97 0 2023-10-21T17:14:53.418 INFO:tasks.workunit.client.0.smithi012.stdout:3/511: write d0/d32/d43/f79 [2459374,30820] 0 2023-10-21T17:14:53.419 INFO:tasks.workunit.client.0.smithi012.stdout:3/512: chown d0/d32/d43/d47/d50/d52/f76 34 1 2023-10-21T17:14:53.478 INFO:tasks.workunit.client.0.smithi012.stdout:3/513: dwrite d0/d32/d43/d47/f91 [0,4194304] 0 2023-10-21T17:14:53.479 INFO:tasks.workunit.client.0.smithi012.stdout:3/514: readlink d0/da/l10 0 2023-10-21T17:14:53.519 INFO:tasks.workunit.client.0.smithi012.stdout:3/515: dread d0/f46 [0,4194304] 0 2023-10-21T17:14:53.957 INFO:tasks.workunit.client.0.smithi012.stdout:1/582: sync 2023-10-21T17:14:53.965 INFO:tasks.workunit.client.0.smithi012.stdout:7/564: write d3/d16/f31 [4714816,95000] 0 2023-10-21T17:14:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:0/574: creat d7/d52/d53/fdd x:0 0 0 2023-10-21T17:14:55.291 INFO:tasks.workunit.client.0.smithi012.stdout:0/575: mkdir d7/d55/d23/d27/d31/d5f/dde 0 2023-10-21T17:14:55.292 INFO:tasks.workunit.client.0.smithi012.stdout:0/576: chown d7/d55/d1f 226568552 1 2023-10-21T17:14:55.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/565: rmdir d3/d6/dc/d19/d1e/d7b 39 2023-10-21T17:14:55.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/566: dread - d3/d64/f71 zero size 2023-10-21T17:14:55.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/567: fsync d3/d6/dc/f54 0 2023-10-21T17:14:55.614 INFO:tasks.workunit.client.0.smithi012.stdout:0/577: mknod d7/d55/da2/cdf 0 2023-10-21T17:14:55.614 INFO:tasks.workunit.client.0.smithi012.stdout:0/578: write d7/d55/d23/d27/d31/f32 [3785114,59325] 0 2023-10-21T17:14:55.796 INFO:tasks.workunit.client.0.smithi012.stdout:7/568: unlink d3/d6/dc/d19/d28/l35 0 2023-10-21T17:14:55.814 INFO:tasks.workunit.client.0.smithi012.stdout:7/569: dread d3/d6/dc/d19/d43/f61 [0,4194304] 0 2023-10-21T17:14:55.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/570: write d3/f89 [3825963,45492] 0 2023-10-21T17:14:55.880 INFO:tasks.workunit.client.0.smithi012.stdout:7/571: read d3/d6/dc/d19/d28/f6d [3837160,74859] 0 2023-10-21T17:14:56.317 INFO:tasks.workunit.client.0.smithi012.stdout:8/466: write d0/d12/d40/f60 [818072,107980] 0 2023-10-21T17:14:56.528 INFO:tasks.workunit.client.0.smithi012.stdout:5/536: creat d2/d4f/fb0 x:0 0 0 2023-10-21T17:14:56.528 INFO:tasks.workunit.client.0.smithi012.stdout:0/579: symlink d7/d55/d23/d66/d82/le0 0 2023-10-21T17:14:56.528 INFO:tasks.workunit.client.0.smithi012.stdout:5/537: fdatasync d2/d6/f4b 0 2023-10-21T17:14:56.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/580: creat d7/d52/d90/fe1 x:0 0 0 2023-10-21T17:14:56.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/581: fsync d7/d55/d23/f8e 0 2023-10-21T17:14:56.719 INFO:tasks.workunit.client.0.smithi012.stdout:7/572: mknod d3/d6/dc/d19/d28/cac 0 2023-10-21T17:14:57.209 INFO:tasks.workunit.client.0.smithi012.stdout:3/516: write d0/f3b [497525,124682] 0 2023-10-21T17:14:57.210 INFO:tasks.workunit.client.0.smithi012.stdout:3/517: chown d0/da/fe 0 1 2023-10-21T17:14:57.294 INFO:tasks.workunit.client.0.smithi012.stdout:1/583: dwrite d5/d32/f17 [0,4194304] 0 2023-10-21T17:14:57.295 INFO:tasks.workunit.client.0.smithi012.stdout:1/584: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/fc6 x:0 0 0 2023-10-21T17:14:57.339 INFO:tasks.workunit.client.0.smithi012.stdout:8/467: mknod d0/d12/d40/d91/ca0 0 2023-10-21T17:14:57.339 INFO:tasks.workunit.client.0.smithi012.stdout:8/468: write d0/d12/d80/f67 [1479599,25764] 0 2023-10-21T17:14:58.276 INFO:tasks.workunit.client.0.smithi012.stdout:5/538: dread d2/d2c/fa7 [0,4194304] 0 2023-10-21T17:14:58.276 INFO:tasks.workunit.client.0.smithi012.stdout:5/539: fsync d2/d2c/f43 0 2023-10-21T17:14:58.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/631: sync 2023-10-21T17:14:58.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/632: creat d1/d14/d16/d22/da5/d50/da3/fd3 x:0 0 0 2023-10-21T17:14:58.332 INFO:tasks.workunit.client.0.smithi012.stdout:2/633: read d1/d14/d16/d58/f66 [1126330,111521] 0 2023-10-21T17:14:58.332 INFO:tasks.workunit.client.0.smithi012.stdout:2/634: dread - d1/d8/f2d zero size 2023-10-21T17:14:58.434 INFO:tasks.workunit.client.0.smithi012.stdout:0/582: mkdir d7/d55/d23/d66/d48/de2 0 2023-10-21T17:14:58.435 INFO:tasks.workunit.client.0.smithi012.stdout:0/583: getdents d7/d55/d23/d66/d48/de2 0 2023-10-21T17:14:58.435 INFO:tasks.workunit.client.0.smithi012.stdout:0/584: dread - d7/d55/d23/d27/d31/d5f/fa7 zero size 2023-10-21T17:14:58.435 INFO:tasks.workunit.client.0.smithi012.stdout:0/585: stat d7/d55/d23/d30/l84 0 2023-10-21T17:14:58.435 INFO:tasks.workunit.client.0.smithi012.stdout:0/586: chown d7/d55/d23/d66/d48/f68 9 1 2023-10-21T17:14:58.537 INFO:tasks.workunit.client.0.smithi012.stdout:7/573: truncate d3/d16/f1a 1184305 0 2023-10-21T17:14:58.634 INFO:tasks.workunit.client.0.smithi012.stdout:3/518: readlink d0/d32/l35 0 2023-10-21T17:14:58.736 INFO:tasks.workunit.client.0.smithi012.stdout:3/519: dwrite d0/d32/d43/f6b [0,4194304] 0 2023-10-21T17:14:59.173 INFO:tasks.workunit.client.0.smithi012.stdout:8/469: symlink d0/d12/d80/la1 0 2023-10-21T17:14:59.282 INFO:tasks.workunit.client.0.smithi012.stdout:8/470: dwrite d0/f35 [4194304,4194304] 0 2023-10-21T17:14:59.932 INFO:tasks.workunit.client.0.smithi012.stdout:2/635: mknod d1/d14/d16/d22/da5/db7/cd4 0 2023-10-21T17:14:59.933 INFO:tasks.workunit.client.0.smithi012.stdout:0/587: getdents d7/d81 0 2023-10-21T17:15:00.000 INFO:tasks.workunit.client.0.smithi012.stdout:2/636: dwrite d1/d4/d3f/d41/d59/fb5 [4194304,4194304] 0 2023-10-21T17:15:00.012 INFO:tasks.workunit.client.0.smithi012.stdout:0/588: dwrite d7/d55/d1f/d28/d9b/f6f [0,4194304] 0 2023-10-21T17:15:00.073 INFO:tasks.workunit.client.0.smithi012.stdout:7/574: mknod d3/d6/dc/d19/d1e/d69/cad 0 2023-10-21T17:15:00.149 INFO:tasks.workunit.client.0.smithi012.stdout:7/575: dwrite d3/d29/f7d [0,4194304] 0 2023-10-21T17:15:00.351 INFO:tasks.workunit.client.0.smithi012.stdout:1/585: truncate d5/d32/d62/f3b 774147 0 2023-10-21T17:15:00.351 INFO:tasks.workunit.client.0.smithi012.stdout:1/586: dread - d5/d32/d1b/d2c/d4b/f5d zero size 2023-10-21T17:15:00.444 INFO:tasks.workunit.client.0.smithi012.stdout:5/540: truncate d2/d6/f7 5067287 0 2023-10-21T17:15:00.457 INFO:tasks.workunit.client.0.smithi012.stdout:5/541: dread d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:15:00.458 INFO:tasks.workunit.client.0.smithi012.stdout:5/542: write d2/d1d/d83/f8f [1015577,15139] 0 2023-10-21T17:15:00.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/543: dread d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:15:00.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/544: readlink d2/d4f/d59/d5b/l45 0 2023-10-21T17:15:00.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/545: fdatasync d2/d4f/d7e/d87/d57/f7d 0 2023-10-21T17:15:00.870 INFO:tasks.workunit.client.0.smithi012.stdout:9/530: rename d0/d4/fa4 to d0/fb0 0 2023-10-21T17:15:00.870 INFO:tasks.workunit.client.0.smithi012.stdout:2/637: link d1/d14/d16/d22/da5/d50/da3/da9/fc1 d1/d14/d16/d22/d82/d86/fd5 0 2023-10-21T17:15:01.348 INFO:tasks.workunit.client.0.smithi012.stdout:0/589: rmdir d7/d55/d23/d66/da9 39 2023-10-21T17:15:01.377 INFO:tasks.workunit.client.0.smithi012.stdout:0/590: write d7/d55/d23/d66/d48/fa5 [4031933,74802] 0 2023-10-21T17:15:01.821 INFO:tasks.workunit.client.0.smithi012.stdout:1/587: creat d5/d32/d1b/d27/d1a/fc7 x:0 0 0 2023-10-21T17:15:02.016 INFO:tasks.workunit.client.0.smithi012.stdout:5/546: symlink d2/d1d/d83/lb1 0 2023-10-21T17:15:02.159 INFO:tasks.workunit.client.0.smithi012.stdout:8/471: symlink d0/d1a/la2 0 2023-10-21T17:15:02.159 INFO:tasks.workunit.client.0.smithi012.stdout:8/472: chown d0/f4c 85 1 2023-10-21T17:15:02.226 INFO:tasks.workunit.client.0.smithi012.stdout:4/601: rename dc/d6b/lc9 to dc/d1e/dc7/dcc/ld5 0 2023-10-21T17:15:02.256 INFO:tasks.workunit.client.0.smithi012.stdout:8/473: dwrite d0/d62/f8d [0,4194304] 0 2023-10-21T17:15:02.257 INFO:tasks.workunit.client.0.smithi012.stdout:8/474: truncate d0/d62/f6b 4336857 0 2023-10-21T17:15:02.316 INFO:tasks.workunit.client.0.smithi012.stdout:4/602: dwrite dc/d1e/d65/f68 [0,4194304] 0 2023-10-21T17:15:02.344 INFO:tasks.workunit.client.0.smithi012.stdout:4/603: dread dc/d15/d18/d4c/f98 [0,4194304] 0 2023-10-21T17:15:02.446 INFO:tasks.workunit.client.0.smithi012.stdout:9/531: mknod d0/d4/d4b/d6a/d12/d25/d39/cb1 0 2023-10-21T17:15:02.477 INFO:tasks.workunit.client.0.smithi012.stdout:9/532: dread d0/d4/d4b/f50 [0,4194304] 0 2023-10-21T17:15:02.478 INFO:tasks.workunit.client.0.smithi012.stdout:9/533: write d0/f14 [1291668,101416] 0 2023-10-21T17:15:02.558 INFO:tasks.workunit.client.0.smithi012.stdout:0/591: mkdir d7/d55/d23/d27/de3 0 2023-10-21T17:15:02.626 INFO:tasks.workunit.client.0.smithi012.stdout:9/534: dwrite d0/f78 [0,4194304] 0 2023-10-21T17:15:02.671 INFO:tasks.workunit.client.0.smithi012.stdout:0/592: dwrite d7/d55/d23/d66/f49 [0,4194304] 0 2023-10-21T17:15:02.671 INFO:tasks.workunit.client.0.smithi012.stdout:0/593: creat d7/d55/d1f/fe4 x:0 0 0 2023-10-21T17:15:03.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/588: mknod d5/d61/cc8 0 2023-10-21T17:15:03.523 INFO:tasks.workunit.client.0.smithi012.stdout:5/547: creat d2/d4f/d7e/d87/d57/d66/daa/fb2 x:0 0 0 2023-10-21T17:15:03.620 INFO:tasks.workunit.client.0.smithi012.stdout:5/548: dwrite d2/d4f/d59/fa5 [0,4194304] 0 2023-10-21T17:15:03.771 INFO:tasks.workunit.client.0.smithi012.stdout:6/544: rename d13/d29/l49 to d13/d15/d1d/d5d/d66/d70/d74/lbc 0 2023-10-21T17:15:03.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/545: write d13/d29/d78/fb3 [1167314,38231] 0 2023-10-21T17:15:03.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/546: chown d13/d15/d1d/d28/c31 41110738 1 2023-10-21T17:15:03.838 INFO:tasks.workunit.client.0.smithi012.stdout:6/547: dwrite d13/d35/d4c/f9e [0,4194304] 0 2023-10-21T17:15:03.838 INFO:tasks.workunit.client.0.smithi012.stdout:6/548: dread - d13/d15/d1d/d5d/d66/d70/d74/d98/fb5 zero size 2023-10-21T17:15:03.839 INFO:tasks.workunit.client.0.smithi012.stdout:6/549: readlink d13/d42/d89/db8/la3 0 2023-10-21T17:15:04.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/604: mkdir dc/d1e/dd6 0 2023-10-21T17:15:04.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/605: getdents dc/d15/d18/d4c/d55/d6c/d9e 0 2023-10-21T17:15:04.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/606: truncate dc/d15/d18/d4c/d75/fac 452731 0 2023-10-21T17:15:04.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/607: getdents dc/d1e/dd6 0 2023-10-21T17:15:05.884 INFO:tasks.workunit.client.0.smithi012.stdout:1/589: creat d5/d32/d1b/d35/d49/d69/fc9 x:0 0 0 2023-10-21T17:15:05.967 INFO:tasks.workunit.client.0.smithi012.stdout:1/590: dwrite d5/d32/d1b/d2c/d48/f6c [0,4194304] 0 2023-10-21T17:15:06.342 INFO:tasks.workunit.client.0.smithi012.stdout:5/549: mkdir d2/d2c/d8c/db3 0 2023-10-21T17:15:06.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:15:06.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:15:06.453 INFO:tasks.workunit.client.0.smithi012.stdout:3/520: rename d0/d32/d43/d47/c7b to d0/d96/c98 0 2023-10-21T17:15:07.042 INFO:tasks.workunit.client.0.smithi012.stdout:6/550: mknod d13/d29/d37/d3b/daa/cbd 0 2023-10-21T17:15:07.086 INFO:tasks.workunit.client.0.smithi012.stdout:6/551: dread d13/f14 [0,4194304] 0 2023-10-21T17:15:07.128 INFO:tasks.workunit.client.0.smithi012.stdout:6/552: dread d13/d29/f5f [0,4194304] 0 2023-10-21T17:15:07.128 INFO:tasks.workunit.client.0.smithi012.stdout:6/553: chown d13/d35/c46 283 1 2023-10-21T17:15:07.128 INFO:tasks.workunit.client.0.smithi012.stdout:6/554: readlink d13/d15/l85 0 2023-10-21T17:15:07.175 INFO:tasks.workunit.client.0.smithi012.stdout:8/475: fdatasync d0/d12/d51/f58 0 2023-10-21T17:15:07.457 INFO:tasks.workunit.client.0.smithi012.stdout:1/591: mknod d5/d32/d1b/d2c/cca 0 2023-10-21T17:15:07.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/592: fdatasync d5/d32/d62/f3b 0 2023-10-21T17:15:07.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/593: dread - d5/d32/d62/f82 zero size 2023-10-21T17:15:07.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/594: getdents d5/d26/d64/d8f/da0 0 2023-10-21T17:15:07.554 INFO:tasks.workunit.client.0.smithi012.stdout:5/550: unlink d2/d1d/d83/f8f 0 2023-10-21T17:15:07.554 INFO:tasks.workunit.client.0.smithi012.stdout:5/551: fsync d2/d4f/d59/d5b/d1e/f26 0 2023-10-21T17:15:07.554 INFO:tasks.workunit.client.0.smithi012.stdout:5/552: chown d2/d4f/d7e/d87/d57/f7d 807659 1 2023-10-21T17:15:07.581 INFO:tasks.workunit.client.0.smithi012.stdout:5/553: dread d2/d4f/d7e/d87/d57/f5f [0,4194304] 0 2023-10-21T17:15:07.981 INFO:tasks.workunit.client.0.smithi012.stdout:7/576: write d3/d6/dc/d19/d1e/d7b/f85 [619912,33832] 0 2023-10-21T17:15:07.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/638: rename d1/d14/d16/d20 to d1/d14/d17/db9/dd6 0 2023-10-21T17:15:07.982 INFO:tasks.workunit.client.0.smithi012.stdout:7/577: stat d3/d6/dc/d19/d28/f87 0 2023-10-21T17:15:07.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/639: readlink d1/d14/d16/d58/l6f 0 2023-10-21T17:15:07.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/640: chown d1/d14/d16/d22/da5/d50/da3/da9/dcd 89 1 2023-10-21T17:15:07.983 INFO:tasks.workunit.client.0.smithi012.stdout:7/578: truncate d3/d29/f45 158096 0 2023-10-21T17:15:07.983 INFO:tasks.workunit.client.0.smithi012.stdout:2/641: dread - d1/d14/d16/d22/da5/d50/da3/da9/fc1 zero size 2023-10-21T17:15:08.045 INFO:tasks.workunit.client.0.smithi012.stdout:2/642: dwrite d1/d14/d16/d22/da5/f57 [4194304,4194304] 0 2023-10-21T17:15:08.546 INFO:tasks.workunit.client.0.smithi012.stdout:8/476: mkdir d0/d62/d7d/da3 0 2023-10-21T17:15:08.654 INFO:tasks.workunit.client.0.smithi012.stdout:8/477: dwrite d0/d1a/f1d [4194304,4194304] 0 2023-10-21T17:15:08.832 INFO:tasks.workunit.client.0.smithi012.stdout:1/595: symlink d5/d32/d62/dae/lcb 0 2023-10-21T17:15:08.832 INFO:tasks.workunit.client.0.smithi012.stdout:1/596: write d5/d32/d1b/d35/d49/d69/f9b [942523,50996] 0 2023-10-21T17:15:09.239 INFO:tasks.workunit.client.0.smithi012.stdout:5/554: rename d2/d2c/c32 to d2/d4f/d59/d5b/d1e/cb4 0 2023-10-21T17:15:09.239 INFO:tasks.workunit.client.0.smithi012.stdout:7/579: creat d3/d6/fae x:0 0 0 2023-10-21T17:15:09.240 INFO:tasks.workunit.client.0.smithi012.stdout:5/555: fdatasync d2/d4f/d59/f89 0 2023-10-21T17:15:09.559 INFO:tasks.workunit.client.0.smithi012.stdout:8/478: unlink d0/d29/f87 0 2023-10-21T17:15:09.559 INFO:tasks.workunit.client.0.smithi012.stdout:8/479: truncate d0/d62/d83/d4e/f9f 865234 0 2023-10-21T17:15:09.729 INFO:tasks.workunit.client.0.smithi012.stdout:2/643: rename d1/d14/d16/d22/da5/d50/f6a to d1/d14/d17/d8a/fd7 0 2023-10-21T17:15:09.734 INFO:tasks.workunit.client.0.smithi012.stdout:7/580: mkdir d3/da7/daf 0 2023-10-21T17:15:09.996 INFO:tasks.workunit.client.0.smithi012.stdout:8/480: link d0/d62/f8d d0/d12/d6a/fa4 0 2023-10-21T17:15:10.074 INFO:tasks.workunit.client.0.smithi012.stdout:1/597: link d5/d32/d62/f3b d5/d32/d62/fcc 0 2023-10-21T17:15:10.301 INFO:tasks.workunit.client.0.smithi012.stdout:2/644: mknod d1/d14/d17/da6/cd8 0 2023-10-21T17:15:10.301 INFO:tasks.workunit.client.0.smithi012.stdout:7/581: creat d3/d6/dc/d19/d1e/d9d/fb0 x:0 0 0 2023-10-21T17:15:10.516 INFO:tasks.workunit.client.0.smithi012.stdout:8/481: dread d0/d1a/f41 [0,4194304] 0 2023-10-21T17:15:10.696 INFO:tasks.workunit.client.0.smithi012.stdout:1/598: truncate d5/f11 3672146 0 2023-10-21T17:15:11.102 INFO:tasks.workunit.client.0.smithi012.stdout:8/482: getdents d0/d1a 0 2023-10-21T17:15:11.182 INFO:tasks.workunit.client.0.smithi012.stdout:9/535: sync 2023-10-21T17:15:11.182 INFO:tasks.workunit.client.0.smithi012.stdout:0/594: sync 2023-10-21T17:15:11.229 INFO:tasks.workunit.client.0.smithi012.stdout:1/599: creat d5/d32/d1b/d27/fcd x:0 0 0 2023-10-21T17:15:11.260 INFO:tasks.workunit.client.0.smithi012.stdout:1/600: write d5/d32/d1b/d2c/d48/f6c [3765284,68127] 0 2023-10-21T17:15:11.726 INFO:tasks.workunit.client.0.smithi012.stdout:8/483: dread d0/f32 [0,4194304] 0 2023-10-21T17:15:11.726 INFO:tasks.workunit.client.0.smithi012.stdout:8/484: read - d0/f8f zero size 2023-10-21T17:15:12.112 INFO:tasks.workunit.client.0.smithi012.stdout:4/608: write dc/d15/d18/d4c/d55/f90 [464309,65992] 0 2023-10-21T17:15:12.113 INFO:tasks.workunit.client.0.smithi012.stdout:4/609: creat dc/d15/d18/d4c/d55/d6c/d83/fd7 x:0 0 0 2023-10-21T17:15:12.163 INFO:tasks.workunit.client.0.smithi012.stdout:1/601: chown d5/d32/d1b/d27/d1a/d46/d4f 6 1 2023-10-21T17:15:12.385 INFO:tasks.workunit.client.0.smithi012.stdout:0/595: truncate d7/d55/d23/d66/da9/fca 173950 0 2023-10-21T17:15:12.890 INFO:tasks.workunit.client.0.smithi012.stdout:1/602: rmdir d5/d30/da9 39 2023-10-21T17:15:12.891 INFO:tasks.workunit.client.0.smithi012.stdout:1/603: chown d5/d32/d1b/d35 102 1 2023-10-21T17:15:12.891 INFO:tasks.workunit.client.0.smithi012.stdout:1/604: write d5/d26/fbc [260470,126541] 0 2023-10-21T17:15:12.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/605: dread d5/d32/f17 [0,4194304] 0 2023-10-21T17:15:12.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/606: readlink d5/d32/d1b/d35/d49/l4c 0 2023-10-21T17:15:13.130 INFO:tasks.workunit.client.0.smithi012.stdout:0/596: symlink d7/d55/d23/d27/d31/le5 0 2023-10-21T17:15:13.131 INFO:tasks.workunit.client.0.smithi012.stdout:0/597: creat d7/d55/d23/d30/d8c/fe6 x:0 0 0 2023-10-21T17:15:13.436 INFO:tasks.workunit.client.0.smithi012.stdout:3/521: symlink d0/d32/d43/l99 0 2023-10-21T17:15:13.437 INFO:tasks.workunit.client.0.smithi012.stdout:3/522: chown d0/d32/d43/f6f 0 1 2023-10-21T17:15:13.656 INFO:tasks.workunit.client.0.smithi012.stdout:0/598: creat d7/d55/d23/dce/fe7 x:0 0 0 2023-10-21T17:15:13.697 INFO:tasks.workunit.client.0.smithi012.stdout:0/599: dread d7/d55/d23/d27/d31/f91 [0,4194304] 0 2023-10-21T17:15:13.698 INFO:tasks.workunit.client.0.smithi012.stdout:0/600: creat d7/d52/d90/fe8 x:0 0 0 2023-10-21T17:15:13.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/555: dwrite d13/d15/d1d/d28/f7c [0,4194304] 0 2023-10-21T17:15:14.042 INFO:tasks.workunit.client.0.smithi012.stdout:0/601: symlink d7/d55/d1f/le9 0 2023-10-21T17:15:14.222 INFO:tasks.workunit.client.0.smithi012.stdout:5/556: mkdir d2/db5 0 2023-10-21T17:15:14.233 INFO:tasks.workunit.client.0.smithi012.stdout:5/557: read d2/d1d/d20/f4d [343883,17336] 0 2023-10-21T17:15:14.233 INFO:tasks.workunit.client.0.smithi012.stdout:5/558: chown d2/d4f/d59/d5b/d15/f8d 447 1 2023-10-21T17:15:14.233 INFO:tasks.workunit.client.0.smithi012.stdout:5/559: readlink d2/d4f/d59/d5b/d1e/l82 0 2023-10-21T17:15:14.233 INFO:tasks.workunit.client.0.smithi012.stdout:5/560: write d2/d1d/d20/f2b [1667085,7027] 0 2023-10-21T17:15:14.234 INFO:tasks.workunit.client.0.smithi012.stdout:5/561: chown d2/d4f/d59 430267399 1 2023-10-21T17:15:14.539 INFO:tasks.workunit.client.0.smithi012.stdout:0/602: mkdir d7/d55/d23/d66/d82/d8d/dea 0 2023-10-21T17:15:14.611 INFO:tasks.workunit.client.0.smithi012.stdout:0/603: dwrite d7/d55/ff [0,4194304] 0 2023-10-21T17:15:14.612 INFO:tasks.workunit.client.0.smithi012.stdout:0/604: chown d7/d55/d23/dce/ddc 59 1 2023-10-21T17:15:15.190 INFO:tasks.workunit.client.0.smithi012.stdout:9/536: mknod d0/cb2 0 2023-10-21T17:15:15.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/537: dread d0/d5/f69 [4194304,4194304] 0 2023-10-21T17:15:15.281 INFO:tasks.workunit.client.0.smithi012.stdout:9/538: dwrite d0/d15/f88 [0,4194304] 0 2023-10-21T17:15:15.282 INFO:tasks.workunit.client.0.smithi012.stdout:9/539: readlink d0/d4/d4b/d6a/d12/d25/d2f/l45 0 2023-10-21T17:15:17.048 INFO:tasks.workunit.client.0.smithi012.stdout:7/582: creat d3/fb1 x:0 0 0 2023-10-21T17:15:17.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/523: getdents d0/d32/d43 0 2023-10-21T17:15:17.153 INFO:tasks.workunit.client.0.smithi012.stdout:4/610: dwrite dc/d15/d2a/d31/fb6 [0,4194304] 0 2023-10-21T17:15:17.692 INFO:tasks.workunit.client.0.smithi012.stdout:6/556: write d13/d15/f27 [2130296,98531] 0 2023-10-21T17:15:17.693 INFO:tasks.workunit.client.0.smithi012.stdout:6/557: fdatasync d13/d64/d6d/f86 0 2023-10-21T17:15:17.827 INFO:tasks.workunit.client.0.smithi012.stdout:9/540: unlink d0/d4/c2b 0 2023-10-21T17:15:17.828 INFO:tasks.workunit.client.0.smithi012.stdout:2/645: rmdir d1/d14 39 2023-10-21T17:15:17.828 INFO:tasks.workunit.client.0.smithi012.stdout:8/485: rename d0/l1e to d0/d12/d40/la5 0 2023-10-21T17:15:17.828 INFO:tasks.workunit.client.0.smithi012.stdout:8/486: chown d0/l7 2 1 2023-10-21T17:15:17.955 INFO:tasks.workunit.client.0.smithi012.stdout:1/607: mkdir d5/d32/dce 0 2023-10-21T17:15:18.064 INFO:tasks.workunit.client.0.smithi012.stdout:3/524: link d0/f15 d0/d96/d97/f9a 0 2023-10-21T17:15:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:3/525: dwrite d0/d1c/f71 [0,4194304] 0 2023-10-21T17:15:18.228 INFO:tasks.workunit.client.0.smithi012.stdout:3/526: dwrite d0/d32/f78 [0,4194304] 0 2023-10-21T17:15:18.228 INFO:tasks.workunit.client.0.smithi012.stdout:3/527: read d0/da/d28/f38 [658489,122930] 0 2023-10-21T17:15:19.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/558: creat d13/d15/d1d/d5d/d66/d70/d74/d98/fbe x:0 0 0 2023-10-21T17:15:19.578 INFO:tasks.workunit.client.0.smithi012.stdout:9/541: mknod d0/d4/d4b/d6a/d12/d25/d39/d3b/cb3 0 2023-10-21T17:15:19.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/646: mkdir d1/d14/d16/d22/da5/d34/dc2/dd9 0 2023-10-21T17:15:19.737 INFO:tasks.workunit.client.0.smithi012.stdout:2/647: chown d1/d8/f10 32 1 2023-10-21T17:15:20.096 INFO:tasks.workunit.client.0.smithi012.stdout:1/608: creat d5/d32/d1b/d35/d3a/d93/fcf x:0 0 0 2023-10-21T17:15:20.610 INFO:tasks.workunit.client.0.smithi012.stdout:3/528: mkdir d0/d96/d97/d9b 0 2023-10-21T17:15:20.610 INFO:tasks.workunit.client.0.smithi012.stdout:3/529: chown d0/d1c/l25 176 1 2023-10-21T17:15:20.759 INFO:tasks.workunit.client.0.smithi012.stdout:6/559: symlink d13/d29/d77/lbf 0 2023-10-21T17:15:20.875 INFO:tasks.workunit.client.0.smithi012.stdout:9/542: symlink d0/df/d44/lb4 0 2023-10-21T17:15:21.225 INFO:tasks.workunit.client.0.smithi012.stdout:8/487: unlink d0/d46/f85 0 2023-10-21T17:15:21.226 INFO:tasks.workunit.client.0.smithi012.stdout:8/488: fsync d0/d1a/d54/f5f 0 2023-10-21T17:15:21.321 INFO:tasks.workunit.client.0.smithi012.stdout:3/530: symlink d0/da/d28/l9c 0 2023-10-21T17:15:21.322 INFO:tasks.workunit.client.0.smithi012.stdout:3/531: readlink d0/d32/d43/d47/d50/d52/l5c 0 2023-10-21T17:15:21.854 INFO:tasks.workunit.client.0.smithi012.stdout:9/543: creat d0/d5/d9d/fb5 x:0 0 0 2023-10-21T17:15:21.855 INFO:tasks.workunit.client.0.smithi012.stdout:5/562: rename d2/d1d/d83 to d2/d2c/db6 0 2023-10-21T17:15:21.855 INFO:tasks.workunit.client.0.smithi012.stdout:9/544: fsync d0/df/d8d/f38 0 2023-10-21T17:15:22.117 INFO:tasks.workunit.client.0.smithi012.stdout:8/489: truncate d0/d12/d6a/fa4 3306160 0 2023-10-21T17:15:22.117 INFO:tasks.workunit.client.0.smithi012.stdout:8/490: creat d0/d1a/d54/fa6 x:0 0 0 2023-10-21T17:15:22.200 INFO:tasks.workunit.client.0.smithi012.stdout:7/583: sync 2023-10-21T17:15:22.201 INFO:tasks.workunit.client.0.smithi012.stdout:4/611: sync 2023-10-21T17:15:22.543 INFO:tasks.workunit.client.0.smithi012.stdout:0/605: rename d7/d55/d23/d30/c79 to d7/d55/d23/d66/d48/db7/ceb 0 2023-10-21T17:15:23.027 INFO:tasks.workunit.client.0.smithi012.stdout:9/545: rmdir d0/d4/d4b/d6a/d12/d25/d39/d3b/d67/da5 0 2023-10-21T17:15:23.107 INFO:tasks.workunit.client.0.smithi012.stdout:9/546: dwrite d0/d5/f69 [4194304,4194304] 0 2023-10-21T17:15:23.133 INFO:tasks.workunit.client.0.smithi012.stdout:9/547: dread d0/df/d44/f51 [0,4194304] 0 2023-10-21T17:15:23.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/491: write d0/d46/f9a [1631193,82524] 0 2023-10-21T17:15:23.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/492: chown d0/d1a/d54/l63 125 1 2023-10-21T17:15:23.293 INFO:tasks.workunit.client.0.smithi012.stdout:8/493: dwrite d0/f4c [4194304,4194304] 0 2023-10-21T17:15:23.466 INFO:tasks.workunit.client.0.smithi012.stdout:7/584: mknod d3/d6/dc/d19/d1e/d7b/cb2 0 2023-10-21T17:15:23.557 INFO:tasks.workunit.client.0.smithi012.stdout:3/532: mkdir d0/d9d 0 2023-10-21T17:15:23.557 INFO:tasks.workunit.client.0.smithi012.stdout:3/533: read d0/f3b [614425,73975] 0 2023-10-21T17:15:23.611 INFO:tasks.workunit.client.0.smithi012.stdout:7/585: dwrite d3/d6/fae [0,4194304] 0 2023-10-21T17:15:23.622 INFO:tasks.workunit.client.0.smithi012.stdout:3/534: dwrite d0/da/f5f [4194304,4194304] 0 2023-10-21T17:15:24.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/494: truncate d0/f26 496841 0 2023-10-21T17:15:24.415 INFO:tasks.workunit.client.0.smithi012.stdout:7/586: rmdir d3/d6/dc/d19/d1e/d7b/d9b 0 2023-10-21T17:15:24.428 INFO:tasks.workunit.client.0.smithi012.stdout:7/587: dread d3/d16/f50 [0,4194304] 0 2023-10-21T17:15:24.613 INFO:tasks.workunit.client.0.smithi012.stdout:3/535: creat d0/da/d28/f9e x:0 0 0 2023-10-21T17:15:24.613 INFO:tasks.workunit.client.0.smithi012.stdout:3/536: readlink d0/d32/d43/l7f 0 2023-10-21T17:15:25.074 INFO:tasks.workunit.client.0.smithi012.stdout:0/606: getdents d7/d55/d23/d66/d48/db7 0 2023-10-21T17:15:25.074 INFO:tasks.workunit.client.0.smithi012.stdout:0/607: read - d7/d55/d23/d27/d31/d5f/fad zero size 2023-10-21T17:15:25.074 INFO:tasks.workunit.client.0.smithi012.stdout:0/608: getdents d7/d55/d23/d27/da1/dd7 0 2023-10-21T17:15:25.075 INFO:tasks.workunit.client.0.smithi012.stdout:0/609: chown d7/d52/d53/fdd 8 1 2023-10-21T17:15:25.075 INFO:tasks.workunit.client.0.smithi012.stdout:0/610: fsync d7/d55/d1f/d28/f59 0 2023-10-21T17:15:25.075 INFO:tasks.workunit.client.0.smithi012.stdout:0/611: fdatasync d7/d55/d23/d27/fb6 0 2023-10-21T17:15:25.077 INFO:tasks.workunit.client.0.smithi012.stdout:6/560: sync 2023-10-21T17:15:25.077 INFO:tasks.workunit.client.0.smithi012.stdout:6/561: dread - d13/d42/d89/db8/fa7 zero size 2023-10-21T17:15:25.105 INFO:tasks.workunit.client.0.smithi012.stdout:0/612: write f6 [2145056,43299] 0 2023-10-21T17:15:25.292 INFO:tasks.workunit.client.0.smithi012.stdout:5/563: sync 2023-10-21T17:15:25.537 INFO:tasks.workunit.client.0.smithi012.stdout:8/495: creat d0/d12/d6a/fa7 x:0 0 0 2023-10-21T17:15:25.537 INFO:tasks.workunit.client.0.smithi012.stdout:8/496: creat d0/d29/d79/fa8 x:0 0 0 2023-10-21T17:15:25.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/612: dwrite dc/d15/d18/d57/f61 [4194304,4194304] 0 2023-10-21T17:15:26.885 INFO:tasks.workunit.client.0.smithi012.stdout:6/562: creat d13/d15/d1d/d28/d5b/d75/fc0 x:0 0 0 2023-10-21T17:15:26.978 INFO:tasks.workunit.client.0.smithi012.stdout:0/613: mknod d7/d55/d23/d27/dc6/cec 0 2023-10-21T17:15:26.978 INFO:tasks.workunit.client.0.smithi012.stdout:0/614: dread - d7/d52/d90/fe1 zero size 2023-10-21T17:15:26.978 INFO:tasks.workunit.client.0.smithi012.stdout:0/615: readlink d7/d55/d23/d27/d31/d5f/l58 0 2023-10-21T17:15:28.127 INFO:tasks.workunit.client.0.smithi012.stdout:5/564: rmdir d2/d1d/d4e 39 2023-10-21T17:15:28.369 INFO:tasks.workunit.client.0.smithi012.stdout:2/648: rename d1/d14/d16/d22/da5/db7 to d1/d14/d17/d8a/dda 0 2023-10-21T17:15:28.404 INFO:tasks.workunit.client.0.smithi012.stdout:2/649: dread d1/d8/f10 [0,4194304] 0 2023-10-21T17:15:28.732 INFO:tasks.workunit.client.0.smithi012.stdout:2/650: creat d1/d14/d17/db9/dd6/fdb x:0 0 0 2023-10-21T17:15:28.733 INFO:tasks.workunit.client.0.smithi012.stdout:2/651: readlink d1/d14/d17/db9/dd6/lce 0 2023-10-21T17:15:29.006 INFO:tasks.workunit.client.0.smithi012.stdout:4/613: write dc/d15/d18/d4c/d75/fac [533560,110036] 0 2023-10-21T17:15:29.347 INFO:tasks.workunit.client.0.smithi012.stdout:6/563: dwrite d13/d29/f5f [0,4194304] 0 2023-10-21T17:15:29.522 INFO:tasks.workunit.client.0.smithi012.stdout:1/609: rename d5/d32/cb0 to d5/d32/d1b/cd0 0 2023-10-21T17:15:29.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/610: truncate d5/d32/d1b/d2c/d4b/f70 4894123 0 2023-10-21T17:15:29.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/611: truncate d5/d32/d1b/d35/d3a/d5c/fc3 2247 0 2023-10-21T17:15:29.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/612: fsync d5/d32/d1b/d2c/d48/f74 0 2023-10-21T17:15:29.523 INFO:tasks.workunit.client.0.smithi012.stdout:3/537: sync 2023-10-21T17:15:29.524 INFO:tasks.workunit.client.0.smithi012.stdout:7/588: sync 2023-10-21T17:15:29.524 INFO:tasks.workunit.client.0.smithi012.stdout:3/538: stat d0/d96/d97 0 2023-10-21T17:15:29.524 INFO:tasks.workunit.client.0.smithi012.stdout:3/539: truncate d0/f62 715217 0 2023-10-21T17:15:29.527 INFO:tasks.workunit.client.0.smithi012.stdout:7/589: read d3/d6/dc/f63 [4944682,89282] 0 2023-10-21T17:15:29.540 INFO:tasks.workunit.client.0.smithi012.stdout:3/540: dread d0/d32/d43/f6f [0,4194304] 0 2023-10-21T17:15:29.927 INFO:tasks.workunit.client.0.smithi012.stdout:9/548: rename d0/f5a to d0/d4/d4b/d6a/d12/d25/d2f/d8c/fb6 0 2023-10-21T17:15:29.927 INFO:tasks.workunit.client.0.smithi012.stdout:1/613: mkdir d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1 0 2023-10-21T17:15:30.158 INFO:tasks.workunit.client.0.smithi012.stdout:7/590: mkdir d3/d6/dc/d19/d1e/d69/db3 0 2023-10-21T17:15:30.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/541: creat d0/d82/f9f x:0 0 0 2023-10-21T17:15:30.179 INFO:tasks.workunit.client.0.smithi012.stdout:8/497: rename d0/d62/d83/d4e/f9f to d0/d12/d40/d91/fa9 0 2023-10-21T17:15:30.179 INFO:tasks.workunit.client.0.smithi012.stdout:9/549: rmdir d0/d4/d4b/d6a/d12/d25/d39/d8e 39 2023-10-21T17:15:30.211 INFO:tasks.workunit.client.0.smithi012.stdout:8/498: dread d0/f4 [0,4194304] 0 2023-10-21T17:15:30.266 INFO:tasks.workunit.client.0.smithi012.stdout:9/550: dwrite d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 [0,4194304] 0 2023-10-21T17:15:30.488 INFO:tasks.workunit.client.0.smithi012.stdout:2/652: sync 2023-10-21T17:15:30.638 INFO:tasks.workunit.client.0.smithi012.stdout:6/564: sync 2023-10-21T17:15:30.889 INFO:tasks.workunit.client.0.smithi012.stdout:7/591: mkdir d3/d6/dc/d19/d1e/d34/da8/db4 0 2023-10-21T17:15:31.135 INFO:tasks.workunit.client.0.smithi012.stdout:0/616: rename d7/d55/d23/d66/ca to d7/d55/d23/d66/d48/de2/ced 0 2023-10-21T17:15:31.248 INFO:tasks.workunit.client.0.smithi012.stdout:0/617: dwrite d7/d81/fc9 [0,4194304] 0 2023-10-21T17:15:31.466 INFO:tasks.workunit.client.0.smithi012.stdout:8/499: chown d0/d46/c88 0 1 2023-10-21T17:15:31.891 INFO:tasks.workunit.client.0.smithi012.stdout:9/551: mknod d0/d4/d4b/d6a/d12/d25/d2f/d8c/cb7 0 2023-10-21T17:15:31.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/614: sync 2023-10-21T17:15:32.198 INFO:tasks.workunit.client.0.smithi012.stdout:7/592: symlink d3/d6/dc/d19/lb5 0 2023-10-21T17:15:32.224 INFO:tasks.workunit.client.0.smithi012.stdout:3/542: write d0/d32/d43/d47/f91 [1457641,24148] 0 2023-10-21T17:15:32.503 INFO:tasks.workunit.client.0.smithi012.stdout:5/565: rename d2/d1d/d20/l6c to d2/d4f/d7e/d87/lb7 0 2023-10-21T17:15:32.520 INFO:tasks.workunit.client.0.smithi012.stdout:5/566: dread d2/d6/f69 [0,4194304] 0 2023-10-21T17:15:32.601 INFO:tasks.workunit.client.0.smithi012.stdout:0/618: mknod d7/d55/d23/d27/d31/cee 0 2023-10-21T17:15:33.276 INFO:tasks.workunit.client.0.smithi012.stdout:2/653: sync 2023-10-21T17:15:33.277 INFO:tasks.workunit.client.0.smithi012.stdout:6/565: sync 2023-10-21T17:15:33.277 INFO:tasks.workunit.client.0.smithi012.stdout:6/566: chown d13/f54 13 1 2023-10-21T17:15:33.305 INFO:tasks.workunit.client.0.smithi012.stdout:2/654: dread d1/d4/d3f/f4f [0,4194304] 0 2023-10-21T17:15:33.366 INFO:tasks.workunit.client.0.smithi012.stdout:6/567: dwrite d13/d29/d78/fb3 [0,4194304] 0 2023-10-21T17:15:33.385 INFO:tasks.workunit.client.0.smithi012.stdout:7/593: creat d3/d6/dc/d19/d28/da0/fb6 x:0 0 0 2023-10-21T17:15:33.386 INFO:tasks.workunit.client.0.smithi012.stdout:7/594: creat d3/d6/dc/d19/d28/da0/fb7 x:0 0 0 2023-10-21T17:15:33.386 INFO:tasks.workunit.client.0.smithi012.stdout:7/595: dread - d3/d29/f52 zero size 2023-10-21T17:15:33.456 INFO:tasks.workunit.client.0.smithi012.stdout:3/543: mkdir d0/d96/da0 0 2023-10-21T17:15:33.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/596: dwrite d3/d64/f8a [0,4194304] 0 2023-10-21T17:15:33.489 INFO:tasks.workunit.client.0.smithi012.stdout:7/597: dread d3/d6/dc/d19/d28/f6d [0,4194304] 0 2023-10-21T17:15:33.981 INFO:tasks.workunit.client.0.smithi012.stdout:0/619: symlink d7/d55/d23/dce/ddc/lef 0 2023-10-21T17:15:33.981 INFO:tasks.workunit.client.0.smithi012.stdout:0/620: fsync d7/d52/d90/fe1 0 2023-10-21T17:15:34.077 INFO:tasks.workunit.client.0.smithi012.stdout:8/500: link d0/d46/c88 d0/caa 0 2023-10-21T17:15:34.233 INFO:tasks.workunit.client.0.smithi012.stdout:9/552: link d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 d0/d4/d4b/d6a/d12/fb8 0 2023-10-21T17:15:34.397 INFO:tasks.workunit.client.0.smithi012.stdout:2/655: rmdir d1/d8/d25/d5f/dd1 0 2023-10-21T17:15:34.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/568: symlink d13/d29/d37/d3b/daa/dac/lc1 0 2023-10-21T17:15:34.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/569: fsync d13/d42/d89/db8/fb9 0 2023-10-21T17:15:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:4/614: rename dc/d15/d18/d4c/d55/d6c/d77/fa5 to dc/d28/fd8 0 2023-10-21T17:15:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:4/615: chown dc/c16 576 1 2023-10-21T17:15:35.806 INFO:tasks.workunit.client.0.smithi012.stdout:5/567: getdents d2/d6 0 2023-10-21T17:15:36.344 INFO:tasks.workunit.client.0.smithi012.stdout:8/501: symlink d0/d1a/d54/lab 0 2023-10-21T17:15:36.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/553: mknod d0/d4/d4b/d6a/d12/d25/d2f/d8c/cb9 0 2023-10-21T17:15:36.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:15:36.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:15:36.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/656: mkdir d1/d14/d16/d22/da5/dbe/ddc 0 2023-10-21T17:15:36.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/657: write d1/d14/d16/d22/da5/d50/da3/da9/dcd/fcf [725240,43115] 0 2023-10-21T17:15:36.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/658: write d1/d8/f8f [206582,9363] 0 2023-10-21T17:15:36.740 INFO:tasks.workunit.client.0.smithi012.stdout:2/659: chown d1/d14/d16/d22/da5/d34/fbb 14247 1 2023-10-21T17:15:36.763 INFO:tasks.workunit.client.0.smithi012.stdout:0/621: sync 2023-10-21T17:15:36.763 INFO:tasks.workunit.client.0.smithi012.stdout:0/622: chown d7/d55/d23/f2a 5 1 2023-10-21T17:15:36.764 INFO:tasks.workunit.client.0.smithi012.stdout:0/623: creat d7/d55/d23/d27/d31/d5f/ff0 x:0 0 0 2023-10-21T17:15:37.172 INFO:tasks.workunit.client.0.smithi012.stdout:3/544: getdents d0/d1c/d5e 0 2023-10-21T17:15:37.172 INFO:tasks.workunit.client.0.smithi012.stdout:3/545: creat d0/d32/d43/d47/d50/d52/fa1 x:0 0 0 2023-10-21T17:15:37.186 INFO:tasks.workunit.client.0.smithi012.stdout:6/570: dread d13/f16 [0,4194304] 0 2023-10-21T17:15:37.199 INFO:tasks.workunit.client.0.smithi012.stdout:7/598: mknod d3/d6/dc/d19/d43/cb8 0 2023-10-21T17:15:37.199 INFO:tasks.workunit.client.0.smithi012.stdout:1/615: rename d5/d32/d1b/d27/d21/f4e to d5/d32/d1b/d27/d1a/d46/d4f/fd2 0 2023-10-21T17:15:37.200 INFO:tasks.workunit.client.0.smithi012.stdout:1/616: readlink d5/d32/d62/dae/lcb 0 2023-10-21T17:15:37.219 INFO:tasks.workunit.client.0.smithi012.stdout:4/616: creat dc/d1e/d33/fd9 x:0 0 0 2023-10-21T17:15:37.219 INFO:tasks.workunit.client.0.smithi012.stdout:5/568: mknod d2/d2c/d73/d49/cb8 0 2023-10-21T17:15:37.247 INFO:tasks.workunit.client.0.smithi012.stdout:8/502: creat d0/d12/d40/fac x:0 0 0 2023-10-21T17:15:37.279 INFO:tasks.workunit.client.0.smithi012.stdout:3/546: dwrite d0/d96/d97/f9a [0,4194304] 0 2023-10-21T17:15:37.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/599: dwrite d3/d6/dc/f79 [0,4194304] 0 2023-10-21T17:15:37.291 INFO:tasks.workunit.client.0.smithi012.stdout:7/600: chown d3/d29/d7f 469 1 2023-10-21T17:15:37.307 INFO:tasks.workunit.client.0.smithi012.stdout:3/547: dread d0/da/f26 [0,4194304] 0 2023-10-21T17:15:37.384 INFO:tasks.workunit.client.0.smithi012.stdout:3/548: dwrite d0/d32/d43/f45 [0,4194304] 0 2023-10-21T17:15:37.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/554: creat d0/d4/d4b/fba x:0 0 0 2023-10-21T17:15:37.544 INFO:tasks.workunit.client.0.smithi012.stdout:2/660: creat d1/d4/d3f/d41/fdd x:0 0 0 2023-10-21T17:15:37.545 INFO:tasks.workunit.client.0.smithi012.stdout:2/661: chown d1/d8/d25/lcb 759 1 2023-10-21T17:15:37.723 INFO:tasks.workunit.client.0.smithi012.stdout:0/624: truncate d7/d55/ff 2329021 0 2023-10-21T17:15:37.724 INFO:tasks.workunit.client.0.smithi012.stdout:6/571: truncate d13/d35/f3a 2495209 0 2023-10-21T17:15:37.743 INFO:tasks.workunit.client.0.smithi012.stdout:0/625: read d7/f10 [2787509,91615] 0 2023-10-21T17:15:38.077 INFO:tasks.workunit.client.0.smithi012.stdout:5/569: truncate d2/d4f/d59/d5b/f41 3618097 0 2023-10-21T17:15:38.077 INFO:tasks.workunit.client.0.smithi012.stdout:5/570: chown d2/d1d/d4e/f5c 158784 1 2023-10-21T17:15:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/503: creat d0/d12/d40/fad x:0 0 0 2023-10-21T17:15:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/504: fdatasync d0/fe 0 2023-10-21T17:15:38.667 INFO:tasks.workunit.client.0.smithi012.stdout:7/601: creat d3/d6/dc/d19/fb9 x:0 0 0 2023-10-21T17:15:39.808 INFO:tasks.workunit.client.0.smithi012.stdout:2/662: creat d1/d14/d16/d22/da5/d50/da3/da9/dcd/fde x:0 0 0 2023-10-21T17:15:39.809 INFO:tasks.workunit.client.0.smithi012.stdout:2/663: read - d1/d8/fb2 zero size 2023-10-21T17:15:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:2/664: dwrite d1/d14/d16/d58/f66 [0,4194304] 0 2023-10-21T17:15:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:2/665: fsync d1/d8/ff 0 2023-10-21T17:15:40.511 INFO:tasks.workunit.client.0.smithi012.stdout:6/572: link d13/d15/f26 d13/d29/d37/d3b/daa/fc2 0 2023-10-21T17:15:40.511 INFO:tasks.workunit.client.0.smithi012.stdout:0/626: symlink d7/d81/lf1 0 2023-10-21T17:15:40.512 INFO:tasks.workunit.client.0.smithi012.stdout:0/627: dread - d7/d55/d23/d27/d31/d5f/ff0 zero size 2023-10-21T17:15:40.512 INFO:tasks.workunit.client.0.smithi012.stdout:0/628: truncate d7/dbd/fc3 985381 0 2023-10-21T17:15:40.524 INFO:tasks.workunit.client.0.smithi012.stdout:6/573: write d13/d15/f1f [12678,91018] 0 2023-10-21T17:15:40.645 INFO:tasks.workunit.client.0.smithi012.stdout:0/629: dwrite d7/d55/d1f/d28/f51 [4194304,4194304] 0 2023-10-21T17:15:40.656 INFO:tasks.workunit.client.0.smithi012.stdout:4/617: dwrite dc/d15/d18/fc6 [0,4194304] 0 2023-10-21T17:15:40.705 INFO:tasks.workunit.client.0.smithi012.stdout:0/630: dwrite d7/d55/d1f/d28/f59 [0,4194304] 0 2023-10-21T17:15:41.105 INFO:tasks.workunit.client.0.smithi012.stdout:5/571: unlink d2/d6/f54 0 2023-10-21T17:15:41.106 INFO:tasks.workunit.client.0.smithi012.stdout:5/572: stat d2/d4f/d7e/d87/l3a 0 2023-10-21T17:15:41.109 INFO:tasks.workunit.client.0.smithi012.stdout:7/602: truncate d3/d6/dc/d19/d28/f6d 858779 0 2023-10-21T17:15:41.126 INFO:tasks.workunit.client.0.smithi012.stdout:2/666: chown d1/d4/d3f/d41/d59/c7b 358 1 2023-10-21T17:15:41.126 INFO:tasks.workunit.client.0.smithi012.stdout:6/574: fsync d13/d42/d89/db8/f2f 0 2023-10-21T17:15:41.349 INFO:tasks.workunit.client.0.smithi012.stdout:4/618: symlink dc/d15/d18/d4c/d55/d6c/d9e/lda 0 2023-10-21T17:15:41.441 INFO:tasks.workunit.client.0.smithi012.stdout:4/619: dwrite dc/d15/d18/d4c/d55/d6c/d83/fbd [0,4194304] 0 2023-10-21T17:15:41.441 INFO:tasks.workunit.client.0.smithi012.stdout:4/620: readlink dc/d1e/la6 0 2023-10-21T17:15:41.441 INFO:tasks.workunit.client.0.smithi012.stdout:4/621: chown dc/d1e/d33/d8a/cbf 0 1 2023-10-21T17:15:41.453 INFO:tasks.workunit.client.0.smithi012.stdout:4/622: dread dc/d1e/f4b [0,4194304] 0 2023-10-21T17:15:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:4/623: dread dc/d15/d18/f71 [0,4194304] 0 2023-10-21T17:15:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:4/624: fdatasync dc/d15/f5e 0 2023-10-21T17:15:41.789 INFO:tasks.workunit.client.0.smithi012.stdout:0/631: mknod d7/d55/d23/cf2 0 2023-10-21T17:15:42.082 INFO:tasks.workunit.client.0.smithi012.stdout:5/573: rename d2/d2c/d8c/c9c to d2/d6/cb9 0 2023-10-21T17:15:42.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/574: dread d2/d2c/fab [4194304,4194304] 0 2023-10-21T17:15:42.188 INFO:tasks.workunit.client.0.smithi012.stdout:7/603: mknod d3/d6/d73/cba 0 2023-10-21T17:15:42.470 INFO:tasks.workunit.client.0.smithi012.stdout:2/667: dread d1/d14/d17/fc4 [0,4194304] 0 2023-10-21T17:15:42.470 INFO:tasks.workunit.client.0.smithi012.stdout:2/668: creat d1/d14/d17/db9/dd6/fdf x:0 0 0 2023-10-21T17:15:42.470 INFO:tasks.workunit.client.0.smithi012.stdout:2/669: dread - d1/d95/f9e zero size 2023-10-21T17:15:42.515 INFO:tasks.workunit.client.0.smithi012.stdout:6/575: creat d13/d42/fc3 x:0 0 0 2023-10-21T17:15:42.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/617: sync 2023-10-21T17:15:42.718 INFO:tasks.workunit.client.0.smithi012.stdout:1/618: write d5/d26/d54/f9f [20864,93879] 0 2023-10-21T17:15:42.927 INFO:tasks.workunit.client.0.smithi012.stdout:4/625: mkdir dc/d1e/d33/d8a/ddb 0 2023-10-21T17:15:42.956 INFO:tasks.workunit.client.0.smithi012.stdout:4/626: read dc/d15/d18/fc6 [1429948,97600] 0 2023-10-21T17:15:43.000 INFO:tasks.workunit.client.0.smithi012.stdout:0/632: creat d7/d55/d23/d30/ff3 x:0 0 0 2023-10-21T17:15:43.559 INFO:tasks.workunit.client.0.smithi012.stdout:5/575: link l1 d2/db5/lba 0 2023-10-21T17:15:43.627 INFO:tasks.workunit.client.0.smithi012.stdout:7/604: creat d3/d6/dc/d19/d1e/d69/db3/fbb x:0 0 0 2023-10-21T17:15:44.126 INFO:tasks.workunit.client.0.smithi012.stdout:2/670: symlink d1/d8/d25/d5f/le0 0 2023-10-21T17:15:44.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/576: truncate d13/d42/f5c 894993 0 2023-10-21T17:15:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:4/627: rmdir dc/d1e/d2b 39 2023-10-21T17:15:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/633: creat d7/d52/ff4 x:0 0 0 2023-10-21T17:15:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:5/576: symlink d2/d2c/d73/d49/d96/lbb 0 2023-10-21T17:15:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/634: write d7/d55/f22 [4646302,26213] 0 2023-10-21T17:15:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/635: stat d7/d55/d23/d66/d48/f80 0 2023-10-21T17:15:44.410 INFO:tasks.workunit.client.0.smithi012.stdout:7/605: mknod d3/d6/cbc 0 2023-10-21T17:15:44.432 INFO:tasks.workunit.client.0.smithi012.stdout:4/628: write dc/d1e/d65/f68 [1506480,78194] 0 2023-10-21T17:15:44.439 INFO:tasks.workunit.client.0.smithi012.stdout:5/577: dread d2/d6/f51 [0,4194304] 0 2023-10-21T17:15:44.647 INFO:tasks.workunit.client.0.smithi012.stdout:2/671: mknod d1/d14/d17/db9/ce1 0 2023-10-21T17:15:44.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/672: dread d1/f30 [0,4194304] 0 2023-10-21T17:15:44.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/673: write d1/d95/fc0 [601941,19353] 0 2023-10-21T17:15:44.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/674: write d1/f30 [3480928,130602] 0 2023-10-21T17:15:44.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/675: chown d1/d14/d17/db9/dd6 24666658 1 2023-10-21T17:15:44.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/676: write d1/f30 [5979253,127617] 0 2023-10-21T17:15:44.827 INFO:tasks.workunit.client.0.smithi012.stdout:6/577: link d13/d42/d89/db8/la3 d13/d64/d6d/lc4 0 2023-10-21T17:15:44.828 INFO:tasks.workunit.client.0.smithi012.stdout:6/578: fdatasync d13/d15/d1d/d28/fad 0 2023-10-21T17:15:44.828 INFO:tasks.workunit.client.0.smithi012.stdout:6/579: truncate d13/d42/d89/db8/fa7 650165 0 2023-10-21T17:15:44.873 INFO:tasks.workunit.client.0.smithi012.stdout:6/580: dread d13/d15/d1d/d28/f7c [0,4194304] 0 2023-10-21T17:15:44.873 INFO:tasks.workunit.client.0.smithi012.stdout:6/581: read d13/d15/d1d/d28/f8f [1034377,115474] 0 2023-10-21T17:15:44.907 INFO:tasks.workunit.client.0.smithi012.stdout:6/582: dread f1 [0,4194304] 0 2023-10-21T17:15:44.907 INFO:tasks.workunit.client.0.smithi012.stdout:6/583: chown d13/d29/d77/lbf 229015 1 2023-10-21T17:15:45.571 INFO:tasks.workunit.client.0.smithi012.stdout:0/636: mkdir d7/d55/d23/d66/d48/db7/df5 0 2023-10-21T17:15:45.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/606: rename d3/d6/dc/d19/d43/cb8 to d3/d6/dc/d19/d1e/d69/db3/cbd 0 2023-10-21T17:15:45.680 INFO:tasks.workunit.client.0.smithi012.stdout:4/629: getdents dc/d28 0 2023-10-21T17:15:45.708 INFO:tasks.workunit.client.0.smithi012.stdout:5/578: getdents d2/d4f/d7e 0 2023-10-21T17:15:45.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/505: dwrite d0/d62/f8d [0,4194304] 0 2023-10-21T17:15:45.890 INFO:tasks.workunit.client.0.smithi012.stdout:9/555: dwrite d0/d4/d4b/d6a/d12/d25/d2f/f65 [0,4194304] 0 2023-10-21T17:15:45.907 INFO:tasks.workunit.client.0.smithi012.stdout:2/677: mkdir d1/d14/d16/d22/de2 0 2023-10-21T17:15:45.907 INFO:tasks.workunit.client.0.smithi012.stdout:2/678: stat d1/d14/d17/db9/dd6/lb0 0 2023-10-21T17:15:45.921 INFO:tasks.workunit.client.0.smithi012.stdout:9/556: write d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 [2893009,42182] 0 2023-10-21T17:15:45.934 INFO:tasks.workunit.client.0.smithi012.stdout:8/506: dwrite d0/d29/d79/f97 [0,4194304] 0 2023-10-21T17:15:45.934 INFO:tasks.workunit.client.0.smithi012.stdout:8/507: fsync d0/f4f 0 2023-10-21T17:15:46.132 INFO:tasks.workunit.client.0.smithi012.stdout:0/637: dread d7/d55/f5a [0,4194304] 0 2023-10-21T17:15:46.132 INFO:tasks.workunit.client.0.smithi012.stdout:0/638: read - d7/d52/fc1 zero size 2023-10-21T17:15:46.706 INFO:tasks.workunit.client.0.smithi012.stdout:7/607: truncate d3/d29/f27 2760771 0 2023-10-21T17:15:46.776 INFO:tasks.workunit.client.0.smithi012.stdout:7/608: dwrite d3/d6/dc/d19/d1e/f5c [4194304,4194304] 0 2023-10-21T17:15:46.776 INFO:tasks.workunit.client.0.smithi012.stdout:7/609: fsync d3/d29/f11 0 2023-10-21T17:15:46.848 INFO:tasks.workunit.client.0.smithi012.stdout:1/619: mknod d5/cd3 0 2023-10-21T17:15:46.949 INFO:tasks.workunit.client.0.smithi012.stdout:4/630: mkdir dc/d93/d99/ddc 0 2023-10-21T17:15:48.449 INFO:tasks.workunit.client.0.smithi012.stdout:2/679: rename d1/d4/d3f/d41/l56 to d1/d8/d25/dcc/le3 0 2023-10-21T17:15:48.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/557: mkdir d0/d4/d4b/d6a/d89/dbb 0 2023-10-21T17:15:49.163 INFO:tasks.workunit.client.0.smithi012.stdout:8/508: creat d0/d12/d40/d91/fae x:0 0 0 2023-10-21T17:15:49.391 INFO:tasks.workunit.client.0.smithi012.stdout:3/549: symlink d0/la2 0 2023-10-21T17:15:49.391 INFO:tasks.workunit.client.0.smithi012.stdout:6/584: rmdir d13/d15/d1d/d28 39 2023-10-21T17:15:50.096 INFO:tasks.workunit.client.0.smithi012.stdout:7/610: mknod d3/d29/d7f/cbe 0 2023-10-21T17:15:50.097 INFO:tasks.workunit.client.0.smithi012.stdout:7/611: stat d3/d29/d7f/c8d 0 2023-10-21T17:15:50.126 INFO:tasks.workunit.client.0.smithi012.stdout:1/620: dread d5/d32/d1b/d27/d86/f99 [0,4194304] 0 2023-10-21T17:15:50.127 INFO:tasks.workunit.client.0.smithi012.stdout:1/621: chown d5/d32/d1b/d2c/cbd 39801774 1 2023-10-21T17:15:50.177 INFO:tasks.workunit.client.0.smithi012.stdout:4/631: symlink dc/d1e/dd6/ldd 0 2023-10-21T17:15:50.209 INFO:tasks.workunit.client.0.smithi012.stdout:4/632: dread dc/d93/f46 [0,4194304] 0 2023-10-21T17:15:50.343 INFO:tasks.workunit.client.0.smithi012.stdout:4/633: dwrite dc/d1e/d33/fd9 [0,4194304] 0 2023-10-21T17:15:50.618 INFO:tasks.workunit.client.0.smithi012.stdout:2/680: read - d1/d14/d16/d22/da5/fca zero size 2023-10-21T17:15:50.618 INFO:tasks.workunit.client.0.smithi012.stdout:2/681: write d1/d8/d25/f70 [800096,111723] 0 2023-10-21T17:15:50.640 INFO:tasks.workunit.client.0.smithi012.stdout:2/682: read d1/d4/d3f/f4f [3694220,108369] 0 2023-10-21T17:15:50.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/558: unlink d0/d4/d4b/d6a/d12/d25/d39/d3b/f53 0 2023-10-21T17:15:50.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/559: fdatasync d0/d4/d4b/d6a/d12/d2a/f87 0 2023-10-21T17:15:50.927 INFO:tasks.workunit.client.0.smithi012.stdout:9/560: dwrite d0/df/d8d/f38 [0,4194304] 0 2023-10-21T17:15:50.928 INFO:tasks.workunit.client.0.smithi012.stdout:9/561: chown d0/df/d8d/fad 103 1 2023-10-21T17:15:50.992 INFO:tasks.workunit.client.0.smithi012.stdout:8/509: mknod d0/d62/d7d/caf 0 2023-10-21T17:15:51.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/510: dread d0/f11 [4194304,4194304] 0 2023-10-21T17:15:51.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/511: chown d0/d12/d40/d91/c98 0 1 2023-10-21T17:15:51.221 INFO:tasks.workunit.client.0.smithi012.stdout:3/550: truncate d0/d1c/f71 1222267 0 2023-10-21T17:15:51.222 INFO:tasks.workunit.client.0.smithi012.stdout:3/551: dread - d0/d82/f9f zero size 2023-10-21T17:15:51.222 INFO:tasks.workunit.client.0.smithi012.stdout:3/552: dread - d0/d32/d43/f61 zero size 2023-10-21T17:15:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:3/553: dwrite d0/d32/d43/d47/f83 [0,4194304] 0 2023-10-21T17:15:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:3/554: getdents d0/da 0 2023-10-21T17:15:51.402 INFO:tasks.workunit.client.0.smithi012.stdout:6/585: dwrite d13/d15/f1f [0,4194304] 0 2023-10-21T17:15:51.467 INFO:tasks.workunit.client.0.smithi012.stdout:6/586: dwrite d13/d15/d1d/d28/f7c [4194304,4194304] 0 2023-10-21T17:15:51.468 INFO:tasks.workunit.client.0.smithi012.stdout:6/587: readlink d13/d29/d77/lbf 0 2023-10-21T17:15:51.562 INFO:tasks.workunit.client.0.smithi012.stdout:0/639: symlink d7/d55/d23/d66/da9/lf6 0 2023-10-21T17:15:51.562 INFO:tasks.workunit.client.0.smithi012.stdout:0/640: write d7/d55/fb3 [606481,16075] 0 2023-10-21T17:15:51.562 INFO:tasks.workunit.client.0.smithi012.stdout:0/641: write d7/d52/d53/fdd [587005,64457] 0 2023-10-21T17:15:51.693 INFO:tasks.workunit.client.0.smithi012.stdout:7/612: symlink d3/d6/dc/d19/d28/da0/lbf 0 2023-10-21T17:15:52.030 INFO:tasks.workunit.client.0.smithi012.stdout:1/622: link d5/c5b d5/d32/d1b/d35/d49/cd4 0 2023-10-21T17:15:52.103 INFO:tasks.workunit.client.0.smithi012.stdout:1/623: dwrite d5/d32/d1b/d27/d1a/f1d [0,4194304] 0 2023-10-21T17:15:52.302 INFO:tasks.workunit.client.0.smithi012.stdout:4/634: mkdir dc/d93/dde 0 2023-10-21T17:15:52.502 INFO:tasks.workunit.client.0.smithi012.stdout:2/683: mknod d1/d14/d17/da6/ce4 0 2023-10-21T17:15:52.682 INFO:tasks.workunit.client.0.smithi012.stdout:9/562: rename d0/d4/d4b/l7b to d0/d4/d4b/d6a/d12/d25/d2f/d8c/lbc 0 2023-10-21T17:15:52.713 INFO:tasks.workunit.client.0.smithi012.stdout:9/563: dread d0/d4/d4b/d6a/d12/d25/d39/d3b/f3f [0,4194304] 0 2023-10-21T17:15:52.790 INFO:tasks.workunit.client.0.smithi012.stdout:8/512: rmdir d0/d62/d83/d72 39 2023-10-21T17:15:52.791 INFO:tasks.workunit.client.0.smithi012.stdout:8/513: chown d0/d12/d40/d91/fa9 685 1 2023-10-21T17:15:53.325 INFO:tasks.workunit.client.0.smithi012.stdout:3/555: creat d0/d1c/d5e/fa3 x:0 0 0 2023-10-21T17:15:53.360 INFO:tasks.workunit.client.0.smithi012.stdout:3/556: write d0/d1c/f60 [3997588,94050] 0 2023-10-21T17:15:53.360 INFO:tasks.workunit.client.0.smithi012.stdout:3/557: chown d0/d1c/c93 173741722 1 2023-10-21T17:15:53.464 INFO:tasks.workunit.client.0.smithi012.stdout:3/558: dwrite d0/d1c/d5e/f84 [0,4194304] 0 2023-10-21T17:15:53.920 INFO:tasks.workunit.client.0.smithi012.stdout:6/588: getdents d13/d15/d1d 0 2023-10-21T17:15:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:6/589: chown d13/d15/f1f 1 1 2023-10-21T17:15:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:6/590: truncate d13/d42/d89/db8/f2f 1940647 0 2023-10-21T17:15:54.003 INFO:tasks.workunit.client.0.smithi012.stdout:6/591: dwrite d13/d15/d1d/d28/f8f [0,4194304] 0 2023-10-21T17:15:54.121 INFO:tasks.workunit.client.0.smithi012.stdout:0/642: mkdir d7/d52/df7 0 2023-10-21T17:15:54.121 INFO:tasks.workunit.client.0.smithi012.stdout:0/643: fdatasync d7/d55/d23/d27/d31/d5f/ff0 0 2023-10-21T17:15:55.081 INFO:tasks.workunit.client.0.smithi012.stdout:5/579: sync 2023-10-21T17:15:55.359 INFO:tasks.workunit.client.0.smithi012.stdout:4/635: creat dc/d15/d18/d4c/fdf x:0 0 0 2023-10-21T17:15:55.359 INFO:tasks.workunit.client.0.smithi012.stdout:9/564: mknod d0/d4/d4b/d6a/d12/d25/d39/d76/cbd 0 2023-10-21T17:15:55.362 INFO:tasks.workunit.client.0.smithi012.stdout:8/514: mkdir d0/d1a/db0 0 2023-10-21T17:15:55.363 INFO:tasks.workunit.client.0.smithi012.stdout:3/559: readlink d0/l17 0 2023-10-21T17:15:55.365 INFO:tasks.workunit.client.0.smithi012.stdout:6/592: rename d13/d15/d1d/d5d/d66/c6a to d13/d29/cc5 0 2023-10-21T17:15:55.463 INFO:tasks.workunit.client.0.smithi012.stdout:9/565: dwrite d0/f3e [0,4194304] 0 2023-10-21T17:15:55.591 INFO:tasks.workunit.client.0.smithi012.stdout:5/580: mkdir d2/d2c/db6/dbc 0 2023-10-21T17:15:55.662 INFO:tasks.workunit.client.0.smithi012.stdout:4/636: creat dc/d15/d2a/dce/fe0 x:0 0 0 2023-10-21T17:15:55.782 INFO:tasks.workunit.client.0.smithi012.stdout:8/515: unlink d0/d12/d6c/l7f 0 2023-10-21T17:15:56.152 INFO:tasks.workunit.client.0.smithi012.stdout:9/566: mknod d0/d5/d9c/cbe 0 2023-10-21T17:15:56.297 INFO:tasks.workunit.client.0.smithi012.stdout:0/644: getdents d7/d55/d23/d27/d40 0 2023-10-21T17:15:56.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/645: dwrite d7/d55/d23/d66/d48/f68 [4194304,4194304] 0 2023-10-21T17:15:56.442 INFO:tasks.workunit.client.0.smithi012.stdout:5/581: symlink d2/d2c/d73/d49/da9/lbd 0 2023-10-21T17:15:56.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/637: mkdir dc/d15/d2a/d58/de1 0 2023-10-21T17:15:56.779 INFO:tasks.workunit.client.0.smithi012.stdout:8/516: fsync d0/d12/d51/f57 0 2023-10-21T17:15:57.144 INFO:tasks.workunit.client.0.smithi012.stdout:9/567: creat d0/d4/d4b/fbf x:0 0 0 2023-10-21T17:15:57.144 INFO:tasks.workunit.client.0.smithi012.stdout:9/568: write d0/d4/d4b/f4c [4861053,62120] 0 2023-10-21T17:15:57.358 INFO:tasks.workunit.client.0.smithi012.stdout:0/646: creat d7/d52/df7/ff8 x:0 0 0 2023-10-21T17:15:57.359 INFO:tasks.workunit.client.0.smithi012.stdout:0/647: stat d7/d55/d23/d66/d48/f80 0 2023-10-21T17:15:57.454 INFO:tasks.workunit.client.0.smithi012.stdout:0/648: dwrite d7/f83 [0,4194304] 0 2023-10-21T17:15:57.455 INFO:tasks.workunit.client.0.smithi012.stdout:0/649: write d7/d55/d23/d66/d63/fd6 [88587,120298] 0 2023-10-21T17:15:57.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/650: dwrite d7/f1d [0,4194304] 0 2023-10-21T17:15:57.535 INFO:tasks.workunit.client.0.smithi012.stdout:5/582: symlink d2/d1d/d4e/lbe 0 2023-10-21T17:15:57.577 INFO:tasks.workunit.client.0.smithi012.stdout:5/583: dread d2/d1d/f56 [0,4194304] 0 2023-10-21T17:15:57.740 INFO:tasks.workunit.client.0.smithi012.stdout:4/638: rename dc/d15/d2a/d58/cb4 to dc/d15/d18/d4c/d55/d6c/d77/ce2 0 2023-10-21T17:15:57.807 INFO:tasks.workunit.client.0.smithi012.stdout:8/517: mkdir d0/d12/d6c/db1 0 2023-10-21T17:15:58.765 INFO:tasks.workunit.client.0.smithi012.stdout:9/569: mknod d0/d4/d4b/d6a/d12/d25/d39/d3b/cc0 0 2023-10-21T17:15:58.796 INFO:tasks.workunit.client.0.smithi012.stdout:9/570: dread d0/d4/d4b/d6a/d12/d25/f37 [0,4194304] 0 2023-10-21T17:15:59.213 INFO:tasks.workunit.client.0.smithi012.stdout:0/651: rename d7/d55/d23/d27/da1 to d7/d55/d23/d66/df9 0 2023-10-21T17:15:59.391 INFO:tasks.workunit.client.0.smithi012.stdout:4/639: rmdir dc 39 2023-10-21T17:15:59.954 INFO:tasks.workunit.client.0.smithi012.stdout:9/571: rename d0/d5/d9c/cbe to d0/d5/d9c/cc1 0 2023-10-21T17:15:59.954 INFO:tasks.workunit.client.0.smithi012.stdout:9/572: write d0/d15/f9f [2169944,10930] 0 2023-10-21T17:16:00.150 INFO:tasks.workunit.client.0.smithi012.stdout:5/584: rename d2/d2c/d73/f60 to d2/d4f/d7e/d87/fbf 0 2023-10-21T17:16:00.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/652: symlink d7/d52/d53/lfa 0 2023-10-21T17:16:00.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/653: chown d7/d52/d90 27 1 2023-10-21T17:16:00.576 INFO:tasks.workunit.client.0.smithi012.stdout:7/613: read d3/d29/f27 [1340,129442] 0 2023-10-21T17:16:01.251 INFO:tasks.workunit.client.0.smithi012.stdout:5/585: creat d2/d1d/d4e/fc0 x:0 0 0 2023-10-21T17:16:01.345 INFO:tasks.workunit.client.0.smithi012.stdout:0/654: creat d7/d55/d23/d66/da9/ffb x:0 0 0 2023-10-21T17:16:01.370 INFO:tasks.workunit.client.0.smithi012.stdout:0/655: dread d7/d55/d23/d27/d31/f32 [0,4194304] 0 2023-10-21T17:16:01.433 INFO:tasks.workunit.client.0.smithi012.stdout:0/656: dwrite d7/d55/d23/d27/d31/f3c [0,4194304] 0 2023-10-21T17:16:01.434 INFO:tasks.workunit.client.0.smithi012.stdout:0/657: chown d7/d55/d23/f2a 14370 1 2023-10-21T17:16:01.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/614: mknod d3/d64/cc0 0 2023-10-21T17:16:01.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/615: chown d3/d6/dc/c88 308200 1 2023-10-21T17:16:01.566 INFO:tasks.workunit.client.0.smithi012.stdout:9/573: creat d0/d4/d4b/d6a/d12/d25/d39/d8e/fc2 x:0 0 0 2023-10-21T17:16:01.567 INFO:tasks.workunit.client.0.smithi012.stdout:9/574: creat d0/df/d8d/fc3 x:0 0 0 2023-10-21T17:16:01.692 INFO:tasks.workunit.client.0.smithi012.stdout:5/586: mknod d2/d4f/d7e/daf/cc1 0 2023-10-21T17:16:01.693 INFO:tasks.workunit.client.0.smithi012.stdout:5/587: stat d2/d4f/d59/d5b/d1e 0 2023-10-21T17:16:01.938 INFO:tasks.workunit.client.0.smithi012.stdout:0/658: symlink d7/d55/d23/d27/lfc 0 2023-10-21T17:16:02.018 INFO:tasks.workunit.client.0.smithi012.stdout:7/616: symlink d3/d6/d73/lc1 0 2023-10-21T17:16:02.018 INFO:tasks.workunit.client.0.smithi012.stdout:7/617: stat d3/d6/dc/d19/d28/l2d 0 2023-10-21T17:16:02.019 INFO:tasks.workunit.client.0.smithi012.stdout:1/624: sync 2023-10-21T17:16:02.019 INFO:tasks.workunit.client.0.smithi012.stdout:1/625: dread - d5/d32/d1b/d35/fb2 zero size 2023-10-21T17:16:02.019 INFO:tasks.workunit.client.0.smithi012.stdout:1/626: fdatasync d5/f14 0 2023-10-21T17:16:02.053 INFO:tasks.workunit.client.0.smithi012.stdout:1/627: write d5/d32/f17 [3015804,7807] 0 2023-10-21T17:16:02.204 INFO:tasks.workunit.client.0.smithi012.stdout:2/684: sync 2023-10-21T17:16:02.358 INFO:tasks.workunit.client.0.smithi012.stdout:5/588: truncate d2/d6/f4b 2197897 0 2023-10-21T17:16:02.358 INFO:tasks.workunit.client.0.smithi012.stdout:5/589: fsync d2/d1d/f56 0 2023-10-21T17:16:02.479 INFO:tasks.workunit.client.0.smithi012.stdout:7/618: getdents d3/d6/d6a 0 2023-10-21T17:16:02.803 INFO:tasks.workunit.client.0.smithi012.stdout:2/685: rmdir d1/d4/d65 39 2023-10-21T17:16:03.106 INFO:tasks.workunit.client.0.smithi012.stdout:5/590: symlink d2/d2c/d73/lc2 0 2023-10-21T17:16:03.106 INFO:tasks.workunit.client.0.smithi012.stdout:7/619: mknod d3/d6/dc/d19/d1e/cc2 0 2023-10-21T17:16:03.149 INFO:tasks.workunit.client.0.smithi012.stdout:3/560: write d0/f14 [4923878,108133] 0 2023-10-21T17:16:03.585 INFO:tasks.workunit.client.0.smithi012.stdout:6/593: dwrite d13/d35/d4c/f82 [0,4194304] 0 2023-10-21T17:16:03.962 INFO:tasks.workunit.client.0.smithi012.stdout:7/620: mkdir d3/d6/dc/d19/d1e/d34/da8/db4/dc3 0 2023-10-21T17:16:04.303 INFO:tasks.workunit.client.0.smithi012.stdout:1/628: mkdir d5/d30/da9/db9/dd5 0 2023-10-21T17:16:04.464 INFO:tasks.workunit.client.0.smithi012.stdout:2/686: mknod d1/d14/d16/d22/d82/ce5 0 2023-10-21T17:16:04.550 INFO:tasks.workunit.client.0.smithi012.stdout:2/687: dwrite d1/d14/d16/d22/da5/d50/f54 [0,4194304] 0 2023-10-21T17:16:05.158 INFO:tasks.workunit.client.0.smithi012.stdout:7/621: link d3/d6/c9 d3/d6/d73/d8e/cc4 0 2023-10-21T17:16:05.158 INFO:tasks.workunit.client.0.smithi012.stdout:7/622: fdatasync d3/d16/f1a 0 2023-10-21T17:16:05.843 INFO:tasks.workunit.client.0.smithi012.stdout:1/629: mkdir d5/d26/d64/d8f/dd6 0 2023-10-21T17:16:06.429 INFO:tasks.workunit.client.0.smithi012.stdout:7/623: mknod d3/d6/dc/d19/d1e/d69/d9c/cc5 0 2023-10-21T17:16:06.539 INFO:tasks.workunit.client.0.smithi012.stdout:7/624: dwrite d3/d6/dc/d19/d1e/d7b/f85 [4194304,4194304] 0 2023-10-21T17:16:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/625: getdents d3/d6/dc/d19/d1e/d34/da8/db4/dc3 0 2023-10-21T17:16:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/626: fsync d3/d6/dc/d19/d43/f61 0 2023-10-21T17:16:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/627: creat d3/d64/fc6 x:0 0 0 2023-10-21T17:16:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/628: dread - d3/d6/dc/fa6 zero size 2023-10-21T17:16:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/629: stat d3/d6/dc/d19/d1e/d7b/l96 0 2023-10-21T17:16:06.629 INFO:tasks.workunit.client.0.smithi012.stdout:2/688: unlink d1/d14/d16/d22/c48 0 2023-10-21T17:16:06.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:16:06.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:16:06.663 INFO:tasks.workunit.client.0.smithi012.stdout:2/689: write d1/d4/f7 [231235,104481] 0 2023-10-21T17:16:06.663 INFO:tasks.workunit.client.0.smithi012.stdout:2/690: fdatasync d1/d8/d25/f70 0 2023-10-21T17:16:06.898 INFO:tasks.workunit.client.0.smithi012.stdout:8/518: rename d0/d29/l9e to d0/d12/d6a/lb2 0 2023-10-21T17:16:07.220 INFO:tasks.workunit.client.0.smithi012.stdout:1/630: link d5/d26/d54/f63 d5/d32/d1b/d35/d49/fd7 0 2023-10-21T17:16:07.586 INFO:tasks.workunit.client.0.smithi012.stdout:0/659: mkdir d7/d55/d1f/dfd 0 2023-10-21T17:16:07.626 INFO:tasks.workunit.client.0.smithi012.stdout:7/630: symlink d3/da7/daf/lc7 0 2023-10-21T17:16:07.652 INFO:tasks.workunit.client.0.smithi012.stdout:7/631: dread d3/d29/f27 [0,4194304] 0 2023-10-21T17:16:07.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/632: chown d3/d6/dc/d19/d1e/f5c 29946353 1 2023-10-21T17:16:07.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/633: truncate d3/d6/dc/d19/d1e/d7b/fa4 970288 0 2023-10-21T17:16:07.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/634: truncate d3/d6/dc/d19/d28/da0/fb6 913385 0 2023-10-21T17:16:07.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/635: readlink d3/da7/daf/lc7 0 2023-10-21T17:16:07.654 INFO:tasks.workunit.client.0.smithi012.stdout:7/636: write d3/f41 [4775561,118268] 0 2023-10-21T17:16:07.684 INFO:tasks.workunit.client.0.smithi012.stdout:0/660: dwrite d7/f83 [0,4194304] 0 2023-10-21T17:16:07.684 INFO:tasks.workunit.client.0.smithi012.stdout:0/661: chown d7/d55/d23/d66/d48/db7/df5 2532 1 2023-10-21T17:16:07.691 INFO:tasks.workunit.client.0.smithi012.stdout:0/662: write d7/d55/d23/d27/f5d [16608,22046] 0 2023-10-21T17:16:07.692 INFO:tasks.workunit.client.0.smithi012.stdout:0/663: fsync d7/d55/d23/d27/d31/d5f/ff0 0 2023-10-21T17:16:07.799 INFO:tasks.workunit.client.0.smithi012.stdout:8/519: mknod d0/d62/d83/d4e/cb3 0 2023-10-21T17:16:07.799 INFO:tasks.workunit.client.0.smithi012.stdout:4/640: sync 2023-10-21T17:16:07.800 INFO:tasks.workunit.client.0.smithi012.stdout:4/641: fsync dc/d15/d18/d4c/d55/d6c/d83/f86 0 2023-10-21T17:16:07.922 INFO:tasks.workunit.client.0.smithi012.stdout:3/561: rename d0/d32/d43/f6f to d0/d96/d97/fa4 0 2023-10-21T17:16:08.090 INFO:tasks.workunit.client.0.smithi012.stdout:1/631: truncate d5/d26/d54/f63 810615 0 2023-10-21T17:16:08.234 INFO:tasks.workunit.client.0.smithi012.stdout:7/637: unlink d3/d6/dc/d19/d1e/d34/da8/fab 0 2023-10-21T17:16:08.565 INFO:tasks.workunit.client.0.smithi012.stdout:0/664: mknod d7/d55/d23/d66/d48/db7/df5/cfe 0 2023-10-21T17:16:09.739 INFO:tasks.workunit.client.0.smithi012.stdout:6/594: rename d13/d29/d37/d3b/l50 to d13/d35/lc6 0 2023-10-21T17:16:09.739 INFO:tasks.workunit.client.0.smithi012.stdout:6/595: chown d13/d29/d37/f44 355792 1 2023-10-21T17:16:09.816 INFO:tasks.workunit.client.0.smithi012.stdout:3/562: link d0/c73 d0/d96/d97/ca5 0 2023-10-21T17:16:09.816 INFO:tasks.workunit.client.0.smithi012.stdout:3/563: readlink d0/l31 0 2023-10-21T17:16:09.831 INFO:tasks.workunit.client.0.smithi012.stdout:6/596: dwrite d13/d42/f84 [0,4194304] 0 2023-10-21T17:16:09.832 INFO:tasks.workunit.client.0.smithi012.stdout:6/597: fdatasync d13/d42/d89/db8/f2f 0 2023-10-21T17:16:09.850 INFO:tasks.workunit.client.0.smithi012.stdout:3/564: dread d0/f2b [4194304,4194304] 0 2023-10-21T17:16:09.850 INFO:tasks.workunit.client.0.smithi012.stdout:3/565: write d0/da/f26 [5040424,4087] 0 2023-10-21T17:16:10.094 INFO:tasks.workunit.client.0.smithi012.stdout:7/638: symlink d3/d6/d73/lc8 0 2023-10-21T17:16:10.123 INFO:tasks.workunit.client.0.smithi012.stdout:7/639: dread d3/d6/dc/d19/f6c [0,4194304] 0 2023-10-21T17:16:10.300 INFO:tasks.workunit.client.0.smithi012.stdout:0/665: creat d7/d55/d23/d66/d82/fff x:0 0 0 2023-10-21T17:16:10.450 INFO:tasks.workunit.client.0.smithi012.stdout:5/591: write d2/d4f/d7e/d87/f39 [9149491,22734] 0 2023-10-21T17:16:10.984 INFO:tasks.workunit.client.0.smithi012.stdout:0/666: rename d7/d55/d23/d66/d82/ccd to d7/d55/d23/d66/d82/c100 0 2023-10-21T17:16:10.984 INFO:tasks.workunit.client.0.smithi012.stdout:0/667: truncate d7/d55/d1f/d28/fd4 137415 0 2023-10-21T17:16:10.985 INFO:tasks.workunit.client.0.smithi012.stdout:0/668: dread - d7/d55/d23/d30/d8c/fe6 zero size 2023-10-21T17:16:11.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/592: mkdir d2/d4f/d7e/d87/d93/dc3 0 2023-10-21T17:16:11.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/593: dwrite d2/d1d/d20/f48 [0,4194304] 0 2023-10-21T17:16:11.237 INFO:tasks.workunit.client.0.smithi012.stdout:5/594: creat d2/d1d/d4e/fc4 x:0 0 0 2023-10-21T17:16:11.519 INFO:tasks.workunit.client.0.smithi012.stdout:1/632: rename d5/d32/d1b/d35/d49/c8b to d5/d32/d62/dae/cd8 0 2023-10-21T17:16:11.519 INFO:tasks.workunit.client.0.smithi012.stdout:0/669: creat d7/d55/d1f/d28/f101 x:0 0 0 2023-10-21T17:16:11.519 INFO:tasks.workunit.client.0.smithi012.stdout:1/633: creat d5/d26/da3/fd9 x:0 0 0 2023-10-21T17:16:11.884 INFO:tasks.workunit.client.0.smithi012.stdout:0/670: creat d7/d55/d23/d27/dcf/f102 x:0 0 0 2023-10-21T17:16:11.925 INFO:tasks.workunit.client.0.smithi012.stdout:0/671: dread d7/d55/d1f/d28/f59 [0,4194304] 0 2023-10-21T17:16:12.003 INFO:tasks.workunit.client.0.smithi012.stdout:0/672: dwrite d7/d52/d90/fbe [0,4194304] 0 2023-10-21T17:16:12.339 INFO:tasks.workunit.client.0.smithi012.stdout:1/634: truncate d5/d30/d51/f73 984527 0 2023-10-21T17:16:12.339 INFO:tasks.workunit.client.0.smithi012.stdout:1/635: chown d5/d26/cc5 222 1 2023-10-21T17:16:12.427 INFO:tasks.workunit.client.0.smithi012.stdout:1/636: dwrite d5/d32/d1b/d27/d1a/d46/d4f/fa6 [0,4194304] 0 2023-10-21T17:16:13.057 INFO:tasks.workunit.client.0.smithi012.stdout:3/566: rename d0/f46 to d0/da/d28/fa6 0 2023-10-21T17:16:13.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/637: mknod d5/d26/cda 0 2023-10-21T17:16:13.641 INFO:tasks.workunit.client.0.smithi012.stdout:0/673: getdents d7/d55/d23/d66/da8 0 2023-10-21T17:16:13.747 INFO:tasks.workunit.client.0.smithi012.stdout:0/674: dwrite f6 [0,4194304] 0 2023-10-21T17:16:13.747 INFO:tasks.workunit.client.0.smithi012.stdout:0/675: chown d7/d55/da2/cd8 3809942 1 2023-10-21T17:16:14.410 INFO:tasks.workunit.client.0.smithi012.stdout:5/595: rename d2/d2c/d73/d49/l63 to d2/d1d/lc5 0 2023-10-21T17:16:14.447 INFO:tasks.workunit.client.0.smithi012.stdout:1/638: mknod d5/d32/d1b/d27/d47/cdb 0 2023-10-21T17:16:14.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/639: fdatasync d5/fa5 0 2023-10-21T17:16:14.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/640: stat d5/d32/d1b/d35/f3f 0 2023-10-21T17:16:14.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/596: link d2/d1d/d20/c88 d2/d6/cc6 0 2023-10-21T17:16:14.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/597: dread - d2/d1d/d4e/f85 zero size 2023-10-21T17:16:14.708 INFO:tasks.workunit.client.0.smithi012.stdout:5/598: dread d2/d1d/f8e [0,4194304] 0 2023-10-21T17:16:14.872 INFO:tasks.workunit.client.0.smithi012.stdout:1/641: creat d5/d30/da9/fdc x:0 0 0 2023-10-21T17:16:14.872 INFO:tasks.workunit.client.0.smithi012.stdout:1/642: dread - d5/d26/fbe zero size 2023-10-21T17:16:15.030 INFO:tasks.workunit.client.0.smithi012.stdout:3/567: rmdir d0/d1c/d5e 39 2023-10-21T17:16:15.031 INFO:tasks.workunit.client.0.smithi012.stdout:3/568: write d0/da/f34 [4715858,93911] 0 2023-10-21T17:16:15.144 INFO:tasks.workunit.client.0.smithi012.stdout:5/599: mkdir d2/d4f/d7e/d87/d57/dc7 0 2023-10-21T17:16:15.144 INFO:tasks.workunit.client.0.smithi012.stdout:5/600: chown d2/d4f/d7e 600029754 1 2023-10-21T17:16:15.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/643: read d5/d32/d1b/d35/d3a/d5c/fc3 [744,59731] 0 2023-10-21T17:16:15.392 INFO:tasks.workunit.client.0.smithi012.stdout:2/691: dwrite d1/d14/d16/d22/f39 [0,4194304] 0 2023-10-21T17:16:15.393 INFO:tasks.workunit.client.0.smithi012.stdout:2/692: chown d1/d14/c52 309751595 1 2023-10-21T17:16:15.517 INFO:tasks.workunit.client.0.smithi012.stdout:5/601: truncate d2/d4f/f94 165382 0 2023-10-21T17:16:15.545 INFO:tasks.workunit.client.0.smithi012.stdout:5/602: dread d2/d4f/d59/d5b/f77 [0,4194304] 0 2023-10-21T17:16:15.605 INFO:tasks.workunit.client.0.smithi012.stdout:4/642: dwrite dc/d1e/d33/f52 [0,4194304] 0 2023-10-21T17:16:15.632 INFO:tasks.workunit.client.0.smithi012.stdout:4/643: write f8 [2545418,98538] 0 2023-10-21T17:16:15.632 INFO:tasks.workunit.client.0.smithi012.stdout:4/644: chown dc/d15/d2a/d31/fb6 116 1 2023-10-21T17:16:15.633 INFO:tasks.workunit.client.0.smithi012.stdout:4/645: stat dc/c13 0 2023-10-21T17:16:15.705 INFO:tasks.workunit.client.0.smithi012.stdout:1/644: symlink d5/d32/d1b/d2c/d4b/ldd 0 2023-10-21T17:16:16.027 INFO:tasks.workunit.client.0.smithi012.stdout:2/693: rmdir d1/d14/d17 39 2023-10-21T17:16:16.308 INFO:tasks.workunit.client.0.smithi012.stdout:5/603: truncate d2/d6/f51 7803821 0 2023-10-21T17:16:16.420 INFO:tasks.workunit.client.0.smithi012.stdout:4/646: mkdir dc/d15/d18/d4c/d75/de3 0 2023-10-21T17:16:17.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/694: rename d1/d4/c49 to d1/d14/d16/d22/da5/dbe/ce6 0 2023-10-21T17:16:17.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/695: chown d1/d4/d93/caa 21 1 2023-10-21T17:16:17.793 INFO:tasks.workunit.client.0.smithi012.stdout:4/647: dwrite dc/d1e/d2b/fc3 [0,4194304] 0 2023-10-21T17:16:17.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/648: dwrite dc/d15/d18/d4c/d75/fcd [0,4194304] 0 2023-10-21T17:16:18.084 INFO:tasks.workunit.client.0.smithi012.stdout:9/575: link d0/d4/l82 d0/d4/d4b/d6a/d12/d25/lc4 0 2023-10-21T17:16:18.283 INFO:tasks.workunit.client.0.smithi012.stdout:3/569: truncate d0/da/f3d 2853804 0 2023-10-21T17:16:18.284 INFO:tasks.workunit.client.0.smithi012.stdout:3/570: fdatasync d0/da/f1f 0 2023-10-21T17:16:18.647 INFO:tasks.workunit.client.0.smithi012.stdout:0/676: rmdir d7/d52/dd3 39 2023-10-21T17:16:19.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/649: stat dc/d15/d2a/d58/l60 0 2023-10-21T17:16:19.548 INFO:tasks.workunit.client.0.smithi012.stdout:4/650: dread - dc/d15/d18/d4c/fdf zero size 2023-10-21T17:16:19.614 INFO:tasks.workunit.client.0.smithi012.stdout:4/651: dwrite dc/d15/d18/d4c/d55/d6c/d83/fd7 [0,4194304] 0 2023-10-21T17:16:19.614 INFO:tasks.workunit.client.0.smithi012.stdout:4/652: chown dc/d15/d2a/d58/de1 2 1 2023-10-21T17:16:19.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/653: read - dc/d15/d18/d4c/fdf zero size 2023-10-21T17:16:20.274 INFO:tasks.workunit.client.0.smithi012.stdout:4/654: rename dc/d1e/d65/f68 to dc/d15/d18/d4c/d55/d6c/d83/fe4 0 2023-10-21T17:16:20.381 INFO:tasks.workunit.client.0.smithi012.stdout:9/576: symlink d0/d4/d4b/d6a/d12/d25/d2f/lc5 0 2023-10-21T17:16:20.419 INFO:tasks.workunit.client.0.smithi012.stdout:9/577: write d0/df/f42 [3158775,66986] 0 2023-10-21T17:16:20.459 INFO:tasks.workunit.client.0.smithi012.stdout:9/578: write d0/df/d44/f7c [1172938,47780] 0 2023-10-21T17:16:21.067 INFO:tasks.workunit.client.0.smithi012.stdout:8/520: sync 2023-10-21T17:16:21.067 INFO:tasks.workunit.client.0.smithi012.stdout:6/598: sync 2023-10-21T17:16:21.067 INFO:tasks.workunit.client.0.smithi012.stdout:7/640: sync 2023-10-21T17:16:21.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/521: dread d0/d29/f3c [0,4194304] 0 2023-10-21T17:16:21.168 INFO:tasks.workunit.client.0.smithi012.stdout:5/604: sync 2023-10-21T17:16:21.169 INFO:tasks.workunit.client.0.smithi012.stdout:1/645: sync 2023-10-21T17:16:21.344 INFO:tasks.workunit.client.0.smithi012.stdout:4/655: truncate dc/d15/d18/d4c/d55/d6c/fa1 17033 0 2023-10-21T17:16:22.276 INFO:tasks.workunit.client.0.smithi012.stdout:7/641: unlink d3/d6/dc/d19/d28/f51 0 2023-10-21T17:16:22.316 INFO:tasks.workunit.client.0.smithi012.stdout:7/642: write d3/d6/dc/f79 [1451407,3189] 0 2023-10-21T17:16:22.341 INFO:tasks.workunit.client.0.smithi012.stdout:7/643: dread d3/d6/f81 [0,4194304] 0 2023-10-21T17:16:22.429 INFO:tasks.workunit.client.0.smithi012.stdout:7/644: dwrite d3/d6/f66 [0,4194304] 0 2023-10-21T17:16:22.461 INFO:tasks.workunit.client.0.smithi012.stdout:8/522: mknod d0/d12/d40/d91/cb4 0 2023-10-21T17:16:22.462 INFO:tasks.workunit.client.0.smithi012.stdout:8/523: write d0/d62/f68 [1227617,90346] 0 2023-10-21T17:16:22.721 INFO:tasks.workunit.client.0.smithi012.stdout:5/605: rename d2/d2c/f80 to d2/d6/fc8 0 2023-10-21T17:16:22.820 INFO:tasks.workunit.client.0.smithi012.stdout:1/646: symlink d5/d32/dce/lde 0 2023-10-21T17:16:22.823 INFO:tasks.workunit.client.0.smithi012.stdout:1/647: write d5/d30/da9/fdc [363766,4449] 0 2023-10-21T17:16:22.916 INFO:tasks.workunit.client.0.smithi012.stdout:1/648: dwrite d5/d26/fbe [0,4194304] 0 2023-10-21T17:16:22.916 INFO:tasks.workunit.client.0.smithi012.stdout:1/649: fdatasync d5/d30/f67 0 2023-10-21T17:16:22.916 INFO:tasks.workunit.client.0.smithi012.stdout:1/650: truncate d5/d32/d1b/d27/d1a/d46/fad 514104 0 2023-10-21T17:16:22.916 INFO:tasks.workunit.client.0.smithi012.stdout:1/651: chown d5/d32/d1b/d35/fb3 103524 1 2023-10-21T17:16:23.211 INFO:tasks.workunit.client.0.smithi012.stdout:4/656: creat dc/d1e/d2b/fe5 x:0 0 0 2023-10-21T17:16:23.212 INFO:tasks.workunit.client.0.smithi012.stdout:6/599: mkdir d13/d42/d89/db8/dc7 0 2023-10-21T17:16:23.236 INFO:tasks.workunit.client.0.smithi012.stdout:6/600: dread d13/f69 [0,4194304] 0 2023-10-21T17:16:23.236 INFO:tasks.workunit.client.0.smithi012.stdout:6/601: write fd [5149432,126491] 0 2023-10-21T17:16:23.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/645: dread d3/d6/dc/d19/d1e/d7b/fa4 [0,4194304] 0 2023-10-21T17:16:23.400 INFO:tasks.workunit.client.0.smithi012.stdout:7/646: write d3/d29/f7c [810070,85000] 0 2023-10-21T17:16:23.555 INFO:tasks.workunit.client.0.smithi012.stdout:8/524: truncate d0/f32 4066145 0 2023-10-21T17:16:23.734 INFO:tasks.workunit.client.0.smithi012.stdout:5/606: mknod d2/cc9 0 2023-10-21T17:16:23.735 INFO:tasks.workunit.client.0.smithi012.stdout:5/607: stat d2/d2c/d8c/c90 0 2023-10-21T17:16:24.053 INFO:tasks.workunit.client.0.smithi012.stdout:4/657: rmdir dc/d1e/da7 39 2023-10-21T17:16:24.071 INFO:tasks.workunit.client.0.smithi012.stdout:0/677: write d7/d81/fc4 [1667687,63529] 0 2023-10-21T17:16:24.071 INFO:tasks.workunit.client.0.smithi012.stdout:0/678: chown d7/d55/d23/d66/d48/de2/ced 28321 1 2023-10-21T17:16:24.169 INFO:tasks.workunit.client.0.smithi012.stdout:0/679: dwrite d7/d52/fc1 [0,4194304] 0 2023-10-21T17:16:24.324 INFO:tasks.workunit.client.0.smithi012.stdout:6/602: mknod d13/d42/d89/db8/dc7/cc8 0 2023-10-21T17:16:24.518 INFO:tasks.workunit.client.0.smithi012.stdout:7/647: truncate d3/d6/dc/d19/f6c 2542658 0 2023-10-21T17:16:24.767 INFO:tasks.workunit.client.0.smithi012.stdout:8/525: creat d0/d62/d83/fb5 x:0 0 0 2023-10-21T17:16:24.767 INFO:tasks.workunit.client.0.smithi012.stdout:5/608: link d2/db5/lba d2/d4f/d7e/lca 0 2023-10-21T17:16:24.768 INFO:tasks.workunit.client.0.smithi012.stdout:8/526: fdatasync d0/f4c 0 2023-10-21T17:16:24.768 INFO:tasks.workunit.client.0.smithi012.stdout:5/609: stat d2/d4f/d59/d5b/f67 0 2023-10-21T17:16:24.860 INFO:tasks.workunit.client.0.smithi012.stdout:5/610: dwrite d2/d1d/d4e/f85 [0,4194304] 0 2023-10-21T17:16:24.994 INFO:tasks.workunit.client.0.smithi012.stdout:1/652: symlink d5/d32/d1b/d35/d49/d69/ldf 0 2023-10-21T17:16:25.007 INFO:tasks.workunit.client.0.smithi012.stdout:1/653: dread d5/d32/d62/fcc [0,4194304] 0 2023-10-21T17:16:25.136 INFO:tasks.workunit.client.0.smithi012.stdout:4/658: mkdir dc/d15/d18/d4c/d55/d6c/de6 0 2023-10-21T17:16:25.136 INFO:tasks.workunit.client.0.smithi012.stdout:4/659: truncate dc/d1e/f44 4915829 0 2023-10-21T17:16:25.352 INFO:tasks.workunit.client.0.smithi012.stdout:0/680: rmdir d7/d55/d23/dce 39 2023-10-21T17:16:25.352 INFO:tasks.workunit.client.0.smithi012.stdout:0/681: chown d7/d55/d23/d66/d63 159804032 1 2023-10-21T17:16:25.353 INFO:tasks.workunit.client.0.smithi012.stdout:0/682: chown d7/d55/d23/l47 585985297 1 2023-10-21T17:16:25.603 INFO:tasks.workunit.client.0.smithi012.stdout:6/603: mkdir d13/d15/d1d/d5d/d66/d70/d74/dc9 0 2023-10-21T17:16:25.636 INFO:tasks.workunit.client.0.smithi012.stdout:6/604: dread d13/d15/f27 [0,4194304] 0 2023-10-21T17:16:25.943 INFO:tasks.workunit.client.0.smithi012.stdout:8/527: link d0/d62/d83/d4e/f55 d0/d29/d79/fb6 0 2023-10-21T17:16:26.268 INFO:tasks.workunit.client.0.smithi012.stdout:5/611: creat d2/d2c/d73/d49/da9/fcb x:0 0 0 2023-10-21T17:16:26.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/612: creat d2/d2c/d73/d49/da9/fcc x:0 0 0 2023-10-21T17:16:26.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/613: write d2/d2c/d73/d49/da9/fcb [63930,67766] 0 2023-10-21T17:16:26.663 INFO:tasks.workunit.client.0.smithi012.stdout:1/654: dread d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:16:26.734 INFO:tasks.workunit.client.0.smithi012.stdout:6/605: creat d13/d15/d1d/d28/fca x:0 0 0 2023-10-21T17:16:26.735 INFO:tasks.workunit.client.0.smithi012.stdout:0/683: mknod d7/d55/d23/d27/d31/d5f/dde/c103 0 2023-10-21T17:16:28.116 INFO:tasks.workunit.client.0.smithi012.stdout:5/614: unlink d2/d4f/d59/l5d 0 2023-10-21T17:16:28.117 INFO:tasks.workunit.client.0.smithi012.stdout:5/615: write d2/d4f/d7e/d87/d57/f7d [858629,98138] 0 2023-10-21T17:16:28.151 INFO:tasks.workunit.client.0.smithi012.stdout:1/655: mkdir d5/d32/dce/de0 0 2023-10-21T17:16:28.151 INFO:tasks.workunit.client.0.smithi012.stdout:6/606: getdents d13/d29/d78 0 2023-10-21T17:16:28.219 INFO:tasks.workunit.client.0.smithi012.stdout:0/684: creat d7/d55/d1f/f104 x:0 0 0 2023-10-21T17:16:28.677 INFO:tasks.workunit.client.0.smithi012.stdout:2/696: mkdir d1/de7 0 2023-10-21T17:16:28.683 INFO:tasks.workunit.client.0.smithi012.stdout:2/697: read d1/d4/d93/fa7 [35608,3479] 0 2023-10-21T17:16:28.731 INFO:tasks.workunit.client.0.smithi012.stdout:6/607: truncate d13/d15/d1d/d28/fa8 881944 0 2023-10-21T17:16:28.731 INFO:tasks.workunit.client.0.smithi012.stdout:6/608: dread - d13/d42/fc3 zero size 2023-10-21T17:16:28.732 INFO:tasks.workunit.client.0.smithi012.stdout:6/609: fdatasync d13/d15/f67 0 2023-10-21T17:16:29.355 INFO:tasks.workunit.client.0.smithi012.stdout:7/648: unlink d3/d6/dc/d19/f6c 0 2023-10-21T17:16:29.356 INFO:tasks.workunit.client.0.smithi012.stdout:7/649: chown d3/d6/l62 32610 1 2023-10-21T17:16:29.494 INFO:tasks.workunit.client.0.smithi012.stdout:5/616: symlink d2/d4f/d7e/d87/d57/d66/lcd 0 2023-10-21T17:16:29.931 INFO:tasks.workunit.client.0.smithi012.stdout:1/656: rename d5/d26/d54/f9f to d5/d32/d1b/d35/d3a/fe1 0 2023-10-21T17:16:29.931 INFO:tasks.workunit.client.0.smithi012.stdout:1/657: fsync d5/d32/d1b/d2c/d48/fa1 0 2023-10-21T17:16:30.346 INFO:tasks.workunit.client.0.smithi012.stdout:5/617: dread d2/d4f/f94 [0,4194304] 0 2023-10-21T17:16:30.349 INFO:tasks.workunit.client.0.smithi012.stdout:6/610: dwrite d13/d15/d1d/d28/d5b/f68 [0,4194304] 0 2023-10-21T17:16:30.466 INFO:tasks.workunit.client.0.smithi012.stdout:9/579: rmdir d0/d4/d4b/d6a/d12/d25 39 2023-10-21T17:16:30.826 INFO:tasks.workunit.client.0.smithi012.stdout:2/698: mknod d1/d14/d17/db9/dd6/ce8 0 2023-10-21T17:16:30.826 INFO:tasks.workunit.client.0.smithi012.stdout:2/699: chown d1/d8/d25/l5b 24995 1 2023-10-21T17:16:30.965 INFO:tasks.workunit.client.0.smithi012.stdout:1/658: mknod d5/d32/d1b/d2c/d4b/ce2 0 2023-10-21T17:16:30.965 INFO:tasks.workunit.client.0.smithi012.stdout:1/659: write d5/d32/d1b/d35/faa [848294,4535] 0 2023-10-21T17:16:30.965 INFO:tasks.workunit.client.0.smithi012.stdout:1/660: read - d5/fa5 zero size 2023-10-21T17:16:31.399 INFO:tasks.workunit.client.0.smithi012.stdout:6/611: dread d13/d15/d1d/d28/f7c [4194304,4194304] 0 2023-10-21T17:16:31.399 INFO:tasks.workunit.client.0.smithi012.stdout:6/612: chown d13/d64/d6d/d73 260051 1 2023-10-21T17:16:31.416 INFO:tasks.workunit.client.0.smithi012.stdout:4/660: dwrite dc/d15/d18/d4c/d55/f9c [0,4194304] 0 2023-10-21T17:16:31.416 INFO:tasks.workunit.client.0.smithi012.stdout:4/661: chown dc/d15/d2a/d58 6772 1 2023-10-21T17:16:31.425 INFO:tasks.workunit.client.0.smithi012.stdout:6/613: dread f6 [0,4194304] 0 2023-10-21T17:16:31.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/662: dwrite dc/d15/d18/d4c/d75/fcd [0,4194304] 0 2023-10-21T17:16:31.507 INFO:tasks.workunit.client.0.smithi012.stdout:4/663: chown dc/d15/d18/d4c/d55/d6c/d83/cd2 304930 1 2023-10-21T17:16:31.557 INFO:tasks.workunit.client.0.smithi012.stdout:3/571: rmdir d0/da/d28 39 2023-10-21T17:16:31.558 INFO:tasks.workunit.client.0.smithi012.stdout:3/572: write d0/f4 [740563,86739] 0 2023-10-21T17:16:31.593 INFO:tasks.workunit.client.0.smithi012.stdout:3/573: write d0/d32/f78 [537469,118827] 0 2023-10-21T17:16:31.795 INFO:tasks.workunit.client.0.smithi012.stdout:2/700: mkdir d1/de7/de9 0 2023-10-21T17:16:31.796 INFO:tasks.workunit.client.0.smithi012.stdout:2/701: write d1/d4/f2b [621909,107089] 0 2023-10-21T17:16:31.888 INFO:tasks.workunit.client.0.smithi012.stdout:1/661: unlink d5/d32/d1b/d35/d49/cd4 0 2023-10-21T17:16:31.888 INFO:tasks.workunit.client.0.smithi012.stdout:1/662: chown d5/d30 126738553 1 2023-10-21T17:16:32.298 INFO:tasks.workunit.client.0.smithi012.stdout:9/580: mknod d0/d4/d4b/d6a/d12/d25/d39/d8e/cc6 0 2023-10-21T17:16:32.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/614: creat d13/d15/d1d/d28/d5b/d75/fcb x:0 0 0 2023-10-21T17:16:32.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/615: truncate d13/d42/fc3 258926 0 2023-10-21T17:16:32.683 INFO:tasks.workunit.client.0.smithi012.stdout:3/574: unlink d0/d32/d43/f6b 0 2023-10-21T17:16:32.684 INFO:tasks.workunit.client.0.smithi012.stdout:3/575: chown d0/d32/d43/d47/d50/l69 6 1 2023-10-21T17:16:32.718 INFO:tasks.workunit.client.0.smithi012.stdout:3/576: dread d0/d1c/f1e [0,4194304] 0 2023-10-21T17:16:32.719 INFO:tasks.workunit.client.0.smithi012.stdout:3/577: read d0/f4 [987336,38645] 0 2023-10-21T17:16:32.719 INFO:tasks.workunit.client.0.smithi012.stdout:3/578: chown d0/da/f26 130587 1 2023-10-21T17:16:32.720 INFO:tasks.workunit.client.0.smithi012.stdout:3/579: fdatasync d0/da/f26 0 2023-10-21T17:16:34.102 INFO:tasks.workunit.client.0.smithi012.stdout:6/616: readlink d13/d15/d1d/d28/l3d 0 2023-10-21T17:16:34.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/617: creat d13/d42/fcc x:0 0 0 2023-10-21T17:16:34.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/618: chown f6 82801 1 2023-10-21T17:16:34.983 INFO:tasks.workunit.client.0.smithi012.stdout:3/580: symlink d0/d32/la7 0 2023-10-21T17:16:35.358 INFO:tasks.workunit.client.0.smithi012.stdout:6/619: link d13/d15/d1d/d28/d5b/d75/lae d13/d29/lcd 0 2023-10-21T17:16:35.630 INFO:tasks.workunit.client.0.smithi012.stdout:3/581: read d0/d32/f4e [4840223,33391] 0 2023-10-21T17:16:35.631 INFO:tasks.workunit.client.0.smithi012.stdout:8/528: sync 2023-10-21T17:16:35.666 INFO:tasks.workunit.client.0.smithi012.stdout:3/582: dread d0/d32/f78 [0,4194304] 0 2023-10-21T17:16:35.735 INFO:tasks.workunit.client.0.smithi012.stdout:6/620: rmdir d13/d15/d1d/d28/d5b 39 2023-10-21T17:16:35.912 INFO:tasks.workunit.client.0.smithi012.stdout:8/529: mkdir d0/d1a/db0/db7 0 2023-10-21T17:16:35.971 INFO:tasks.workunit.client.0.smithi012.stdout:8/530: dwrite d0/d29/d79/fa8 [0,4194304] 0 2023-10-21T17:16:36.484 INFO:tasks.workunit.client.0.smithi012.stdout:5/618: dwrite d2/d4f/d7e/d87/d57/d66/f9a [4194304,4194304] 0 2023-10-21T17:16:36.547 INFO:tasks.workunit.client.0.smithi012.stdout:3/583: read d0/d1c/f71 [304577,81415] 0 2023-10-21T17:16:36.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:16:36.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:16:36.803 INFO:tasks.workunit.client.0.smithi012.stdout:8/531: creat d0/d12/d6c/fb8 x:0 0 0 2023-10-21T17:16:36.803 INFO:tasks.workunit.client.0.smithi012.stdout:8/532: fdatasync d0/d1a/f41 0 2023-10-21T17:16:36.883 INFO:tasks.workunit.client.0.smithi012.stdout:8/533: dwrite d0/d62/f8d [4194304,4194304] 0 2023-10-21T17:16:37.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/621: unlink d13/d15/d1d/d28/f39 0 2023-10-21T17:16:37.256 INFO:tasks.workunit.client.0.smithi012.stdout:6/622: dread d13/d42/fc3 [0,4194304] 0 2023-10-21T17:16:37.382 INFO:tasks.workunit.client.0.smithi012.stdout:3/584: creat d0/d32/fa8 x:0 0 0 2023-10-21T17:16:37.916 INFO:tasks.workunit.client.0.smithi012.stdout:6/623: truncate d13/d15/f21 91314 0 2023-10-21T17:16:37.916 INFO:tasks.workunit.client.0.smithi012.stdout:3/585: creat d0/d32/fa9 x:0 0 0 2023-10-21T17:16:37.942 INFO:tasks.workunit.client.0.smithi012.stdout:8/534: dread d0/f32 [0,4194304] 0 2023-10-21T17:16:38.010 INFO:tasks.workunit.client.0.smithi012.stdout:9/581: dwrite d0/d4/d4b/d6a/d12/d25/d39/f5b [0,4194304] 0 2023-10-21T17:16:38.399 INFO:tasks.workunit.client.0.smithi012.stdout:3/586: stat d0/d32/c74 0 2023-10-21T17:16:38.465 INFO:tasks.workunit.client.0.smithi012.stdout:3/587: dwrite d0/d1c/d5e/f84 [4194304,4194304] 0 2023-10-21T17:16:38.567 INFO:tasks.workunit.client.0.smithi012.stdout:8/535: truncate d0/d12/d40/f60 1780652 0 2023-10-21T17:16:38.665 INFO:tasks.workunit.client.0.smithi012.stdout:8/536: dwrite d0/d62/f8d [0,4194304] 0 2023-10-21T17:16:38.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/537: dwrite d0/d29/d79/f81 [0,4194304] 0 2023-10-21T17:16:38.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/538: chown d0/d12/d40/d91/c98 1 1 2023-10-21T17:16:38.918 INFO:tasks.workunit.client.0.smithi012.stdout:0/685: rename d7/f7b to d7/d55/d23/d66/d48/de2/f105 0 2023-10-21T17:16:38.983 INFO:tasks.workunit.client.0.smithi012.stdout:0/686: dwrite d7/d55/d23/d27/f44 [0,4194304] 0 2023-10-21T17:16:39.083 INFO:tasks.workunit.client.0.smithi012.stdout:9/582: mkdir d0/d5/d9c/dc7 0 2023-10-21T17:16:39.083 INFO:tasks.workunit.client.0.smithi012.stdout:9/583: fdatasync d0/d15/f57 0 2023-10-21T17:16:39.204 INFO:tasks.workunit.client.0.smithi012.stdout:3/588: truncate d0/d32/f90 3017895 0 2023-10-21T17:16:39.205 INFO:tasks.workunit.client.0.smithi012.stdout:3/589: stat d0/d9d 0 2023-10-21T17:16:39.465 INFO:tasks.workunit.client.0.smithi012.stdout:8/539: dread d0/d1a/d54/f8b [0,4194304] 0 2023-10-21T17:16:39.537 INFO:tasks.workunit.client.0.smithi012.stdout:8/540: dwrite d0/d62/d83/d4e/f55 [0,4194304] 0 2023-10-21T17:16:40.155 INFO:tasks.workunit.client.0.smithi012.stdout:0/687: dread d7/f19 [0,4194304] 0 2023-10-21T17:16:40.553 INFO:tasks.workunit.client.0.smithi012.stdout:0/688: creat d7/d55/d23/d66/d82/d8d/dea/f106 x:0 0 0 2023-10-21T17:16:40.699 INFO:tasks.workunit.client.0.smithi012.stdout:9/584: getdents d0/df/d8d 0 2023-10-21T17:16:40.913 INFO:tasks.workunit.client.0.smithi012.stdout:7/650: rename d3/d6/dc/d19/d28 to d3/d6/dc/d19/d1e/dc9 0 2023-10-21T17:16:41.072 INFO:tasks.workunit.client.0.smithi012.stdout:0/689: rmdir d7/d55/d23/d66/df9/dd7 0 2023-10-21T17:16:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:5/619: dwrite d2/d4f/d59/d5b/f41 [0,4194304] 0 2023-10-21T17:16:41.544 INFO:tasks.workunit.client.0.smithi012.stdout:0/690: getdents d7/d55/d23/d27/d31/d5f/dde 0 2023-10-21T17:16:41.545 INFO:tasks.workunit.client.0.smithi012.stdout:0/691: fdatasync d7/d55/d23/d66/d82/fff 0 2023-10-21T17:16:41.670 INFO:tasks.workunit.client.0.smithi012.stdout:9/585: mknod d0/d4/d4b/cc8 0 2023-10-21T17:16:41.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/620: unlink d2/d4f/d7e/lca 0 2023-10-21T17:16:43.151 INFO:tasks.workunit.client.0.smithi012.stdout:4/664: rmdir dc/d1e 39 2023-10-21T17:16:43.153 INFO:tasks.workunit.client.0.smithi012.stdout:1/663: sync 2023-10-21T17:16:43.673 INFO:tasks.workunit.client.0.smithi012.stdout:0/692: mkdir d7/d55/d23/d66/da9/d107 0 2023-10-21T17:16:43.673 INFO:tasks.workunit.client.0.smithi012.stdout:0/693: creat d7/d55/d23/d66/d82/d8d/dea/f108 x:0 0 0 2023-10-21T17:16:43.918 INFO:tasks.workunit.client.0.smithi012.stdout:2/702: rename d1/d8/d25 to d1/d4/d65/dea 0 2023-10-21T17:16:43.919 INFO:tasks.workunit.client.0.smithi012.stdout:2/703: read d1/d4/f5 [2216136,44316] 0 2023-10-21T17:16:43.919 INFO:tasks.workunit.client.0.smithi012.stdout:2/704: write d1/d14/d16/d22/da5/d50/da3/da9/dcd/fde [699462,56259] 0 2023-10-21T17:16:43.919 INFO:tasks.workunit.client.0.smithi012.stdout:2/705: creat d1/d4/d93/feb x:0 0 0 2023-10-21T17:16:43.919 INFO:tasks.workunit.client.0.smithi012.stdout:2/706: stat d1/l2c 0 2023-10-21T17:16:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:1/664: symlink d5/d32/d1b/d2c/d4b/d8a/le3 0 2023-10-21T17:16:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:1/665: dread d5/d32/d1b/d35/f3f [0,4194304] 0 2023-10-21T17:16:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:8/541: write d0/d1a/f1d [4991017,76981] 0 2023-10-21T17:16:44.455 INFO:tasks.workunit.client.0.smithi012.stdout:0/694: mknod d7/d55/d23/d66/d48/de2/c109 0 2023-10-21T17:16:44.455 INFO:tasks.workunit.client.0.smithi012.stdout:0/695: readlink d7/d52/d53/lfa 0 2023-10-21T17:16:44.908 INFO:tasks.workunit.client.0.smithi012.stdout:1/666: unlink d5/f11 0 2023-10-21T17:16:45.268 INFO:tasks.workunit.client.0.smithi012.stdout:7/651: dwrite d3/d6/dc/d19/d1e/dc9/f6d [0,4194304] 0 2023-10-21T17:16:45.269 INFO:tasks.workunit.client.0.smithi012.stdout:7/652: write d3/f41 [4969706,102575] 0 2023-10-21T17:16:45.269 INFO:tasks.workunit.client.0.smithi012.stdout:7/653: chown d3/d6/dc/c2b 21942 1 2023-10-21T17:16:45.290 INFO:tasks.workunit.client.0.smithi012.stdout:0/696: creat d7/d55/da2/f10a x:0 0 0 2023-10-21T17:16:45.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/624: rename d13/d15/d1d/d28/d5b/d75/fcb to d13/d29/d78/fce 0 2023-10-21T17:16:45.749 INFO:tasks.workunit.client.0.smithi012.stdout:4/665: getdents dc/d1e/d33/d8a 0 2023-10-21T17:16:45.781 INFO:tasks.workunit.client.0.smithi012.stdout:4/666: dread f8 [4194304,4194304] 0 2023-10-21T17:16:45.781 INFO:tasks.workunit.client.0.smithi012.stdout:4/667: fsync dc/d1e/f3e 0 2023-10-21T17:16:45.818 INFO:tasks.workunit.client.0.smithi012.stdout:8/542: getdents d0/d12/d40/d91 0 2023-10-21T17:16:45.818 INFO:tasks.workunit.client.0.smithi012.stdout:8/543: fdatasync d0/f27 0 2023-10-21T17:16:46.358 INFO:tasks.workunit.client.0.smithi012.stdout:9/586: write d0/d4/d4b/d6a/d12/d25/d39/d3b/f70 [1068011,79226] 0 2023-10-21T17:16:46.466 INFO:tasks.workunit.client.0.smithi012.stdout:3/590: symlink d0/d32/laa 0 2023-10-21T17:16:46.466 INFO:tasks.workunit.client.0.smithi012.stdout:3/591: chown d0/d32/d43/c95 43061687 1 2023-10-21T17:16:46.868 INFO:tasks.workunit.client.0.smithi012.stdout:0/697: link d7/d55/d23/d27/d31/d3d/c2f d7/d55/d23/d27/d40/c10b 0 2023-10-21T17:16:47.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/625: mkdir d13/d29/d37/d3b/daa/dcf 0 2023-10-21T17:16:47.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/667: getdents d5/d32/d1b/d2c/d48 0 2023-10-21T17:16:47.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/668: readlink d5/d32/dce/lde 0 2023-10-21T17:16:47.740 INFO:tasks.workunit.client.0.smithi012.stdout:4/668: readlink dc/d15/d18/l54 0 2023-10-21T17:16:48.142 INFO:tasks.workunit.client.0.smithi012.stdout:3/592: dread d0/da/f3d [0,4194304] 0 2023-10-21T17:16:49.070 INFO:tasks.workunit.client.0.smithi012.stdout:4/669: chown dc/l53 285835 1 2023-10-21T17:16:49.540 INFO:tasks.workunit.client.0.smithi012.stdout:3/593: getdents d0/d96/d97 0 2023-10-21T17:16:49.544 INFO:tasks.workunit.client.0.smithi012.stdout:2/707: rename d1/d14/d16/d22 to d1/d14/d16/d58/dec 0 2023-10-21T17:16:49.708 INFO:tasks.workunit.client.0.smithi012.stdout:1/669: unlink d5/d32/d1b/d27/c33 0 2023-10-21T17:16:49.709 INFO:tasks.workunit.client.0.smithi012.stdout:1/670: readlink d5/d32/d1b/d35/d49/d69/l6d 0 2023-10-21T17:16:49.709 INFO:tasks.workunit.client.0.smithi012.stdout:1/671: stat d5/d26/d64/d8f 0 2023-10-21T17:16:49.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/670: dwrite dc/f42 [0,4194304] 0 2023-10-21T17:16:49.973 INFO:tasks.workunit.client.0.smithi012.stdout:4/671: dwrite dc/d15/d18/d4c/d55/d6c/dbb/fcb [0,4194304] 0 2023-10-21T17:16:49.976 INFO:tasks.workunit.client.0.smithi012.stdout:2/708: getdents d1/d14/d16/d58/dec/da5/d50/da3 0 2023-10-21T17:16:49.976 INFO:tasks.workunit.client.0.smithi012.stdout:2/709: chown d1/d4/d93 335800 1 2023-10-21T17:16:49.976 INFO:tasks.workunit.client.0.smithi012.stdout:2/710: stat d1/d14/d17/db9/dd6/f8c 0 2023-10-21T17:16:49.977 INFO:tasks.workunit.client.0.smithi012.stdout:2/711: write d1/f2a [650846,65264] 0 2023-10-21T17:16:49.977 INFO:tasks.workunit.client.0.smithi012.stdout:2/712: creat d1/d14/d17/da6/fed x:0 0 0 2023-10-21T17:16:50.091 INFO:tasks.workunit.client.0.smithi012.stdout:1/672: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fe4 x:0 0 0 2023-10-21T17:16:50.740 INFO:tasks.workunit.client.0.smithi012.stdout:3/594: getdents d0/d32 0 2023-10-21T17:16:50.772 INFO:tasks.workunit.client.0.smithi012.stdout:3/595: write d0/da/fe [1416007,82220] 0 2023-10-21T17:16:50.903 INFO:tasks.workunit.client.0.smithi012.stdout:5/621: sync 2023-10-21T17:16:50.904 INFO:tasks.workunit.client.0.smithi012.stdout:3/596: dwrite d0/d32/d43/d47/f83 [0,4194304] 0 2023-10-21T17:16:50.904 INFO:tasks.workunit.client.0.smithi012.stdout:3/597: write d0/f3b [2726626,37002] 0 2023-10-21T17:16:50.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/654: sync 2023-10-21T17:16:50.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/655: dread - d3/d6/dc/d19/fb9 zero size 2023-10-21T17:16:51.753 INFO:tasks.workunit.client.0.smithi012.stdout:5/622: mkdir d2/d4f/d7e/d87/dce 0 2023-10-21T17:16:51.892 INFO:tasks.workunit.client.0.smithi012.stdout:3/598: creat d0/d82/fab x:0 0 0 2023-10-21T17:16:52.223 INFO:tasks.workunit.client.0.smithi012.stdout:5/623: stat d2/d1d/d20/l2d 0 2023-10-21T17:16:52.224 INFO:tasks.workunit.client.0.smithi012.stdout:5/624: write d2/d4f/d59/d5b/f67 [945518,82549] 0 2023-10-21T17:16:52.496 INFO:tasks.workunit.client.0.smithi012.stdout:6/626: write d13/f16 [848154,109240] 0 2023-10-21T17:16:52.496 INFO:tasks.workunit.client.0.smithi012.stdout:6/627: chown d13/d29/lcd 2151 1 2023-10-21T17:16:52.697 INFO:tasks.workunit.client.0.smithi012.stdout:8/544: sync 2023-10-21T17:16:52.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/545: readlink d0/d1a/la2 0 2023-10-21T17:16:52.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/546: chown d0/f11 4 1 2023-10-21T17:16:52.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/547: chown d0/d12/d6a 51838 1 2023-10-21T17:16:52.778 INFO:tasks.workunit.client.0.smithi012.stdout:5/625: mknod d2/d4f/d7e/d87/d93/ccf 0 2023-10-21T17:16:53.112 INFO:tasks.workunit.client.0.smithi012.stdout:8/548: getdents d0/d12 0 2023-10-21T17:16:53.140 INFO:tasks.workunit.client.0.smithi012.stdout:8/549: dread d0/fe [0,4194304] 0 2023-10-21T17:16:53.349 INFO:tasks.workunit.client.0.smithi012.stdout:9/587: mkdir d0/d4/d4b/d6a/d12/d25/dc9 0 2023-10-21T17:16:53.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/628: mknod d13/d15/d1d/cd0 0 2023-10-21T17:16:53.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/629: write d13/d42/f5c [344919,53359] 0 2023-10-21T17:16:53.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/630: chown d13/d29/d78/fce 15 1 2023-10-21T17:16:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/631: read d13/d15/f1f [3942956,39771] 0 2023-10-21T17:16:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/632: write d13/d29/d37/d3b/f5e [951414,126173] 0 2023-10-21T17:16:54.866 INFO:tasks.workunit.client.0.smithi012.stdout:4/672: dwrite dc/d15/f32 [4194304,4194304] 0 2023-10-21T17:16:55.041 INFO:tasks.workunit.client.0.smithi012.stdout:1/673: write d5/d30/da9/fb5 [988460,17979] 0 2023-10-21T17:16:55.122 INFO:tasks.workunit.client.0.smithi012.stdout:6/633: creat d13/d64/fd1 x:0 0 0 2023-10-21T17:16:55.123 INFO:tasks.workunit.client.0.smithi012.stdout:7/656: write d3/d6/dc/d19/d1e/dc9/da0/fb6 [1076453,98976] 0 2023-10-21T17:16:55.123 INFO:tasks.workunit.client.0.smithi012.stdout:6/634: write d13/d64/d6d/f86 [1099691,21376] 0 2023-10-21T17:16:55.126 INFO:tasks.workunit.client.0.smithi012.stdout:0/698: sync 2023-10-21T17:16:55.169 INFO:tasks.workunit.client.0.smithi012.stdout:0/699: dread d7/d55/d23/d27/d31/f91 [0,4194304] 0 2023-10-21T17:16:55.215 INFO:tasks.workunit.client.0.smithi012.stdout:3/599: dwrite d0/d96/d97/fa4 [0,4194304] 0 2023-10-21T17:16:55.216 INFO:tasks.workunit.client.0.smithi012.stdout:3/600: chown d0/l49 8095165 1 2023-10-21T17:16:55.258 INFO:tasks.workunit.client.0.smithi012.stdout:3/601: dread d0/d96/d97/fa4 [0,4194304] 0 2023-10-21T17:16:55.546 INFO:tasks.workunit.client.0.smithi012.stdout:7/657: symlink d3/d6/lca 0 2023-10-21T17:16:55.684 INFO:tasks.workunit.client.0.smithi012.stdout:2/713: rmdir d1/d14 39 2023-10-21T17:16:56.024 INFO:tasks.workunit.client.0.smithi012.stdout:0/700: symlink d7/d55/d23/d66/df9/l10c 0 2023-10-21T17:16:56.024 INFO:tasks.workunit.client.0.smithi012.stdout:0/701: readlink d7/ld 0 2023-10-21T17:16:56.491 INFO:tasks.workunit.client.0.smithi012.stdout:3/602: symlink d0/da/lac 0 2023-10-21T17:16:56.618 INFO:tasks.workunit.client.0.smithi012.stdout:4/673: creat dc/d6b/fe7 x:0 0 0 2023-10-21T17:16:56.618 INFO:tasks.workunit.client.0.smithi012.stdout:4/674: chown dc/d1e/d91/ca0 56540 1 2023-10-21T17:16:56.739 INFO:tasks.workunit.client.0.smithi012.stdout:5/626: rename d2/d6 to d2/d4f/d7e/d87/d57/dc7/dd0 0 2023-10-21T17:16:57.004 INFO:tasks.workunit.client.0.smithi012.stdout:7/658: creat d3/d6/dc/d19/d1e/dc9/da0/fcb x:0 0 0 2023-10-21T17:16:57.004 INFO:tasks.workunit.client.0.smithi012.stdout:7/659: write d3/d16/f32 [4359308,9252] 0 2023-10-21T17:16:57.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/660: dread d3/d6/dc/d19/d1e/dc9/f3b [4194304,4194304] 0 2023-10-21T17:16:57.444 INFO:tasks.workunit.client.0.smithi012.stdout:6/635: mknod d13/d15/d1d/d28/cd2 0 2023-10-21T17:16:57.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/636: write d13/d64/d6d/f86 [1027891,82546] 0 2023-10-21T17:16:57.480 INFO:tasks.workunit.client.0.smithi012.stdout:3/603: dread d0/d1c/f60 [0,4194304] 0 2023-10-21T17:16:57.593 INFO:tasks.workunit.client.0.smithi012.stdout:4/675: mknod dc/d15/d18/d4c/ce8 0 2023-10-21T17:16:57.690 INFO:tasks.workunit.client.0.smithi012.stdout:8/550: rename d0/d12/l7b to d0/d12/d40/lb9 0 2023-10-21T17:16:58.006 INFO:tasks.workunit.client.0.smithi012.stdout:7/661: symlink d3/da7/daf/lcc 0 2023-10-21T17:16:58.438 INFO:tasks.workunit.client.0.smithi012.stdout:6/637: creat d13/d29/d37/d3b/daa/dac/fd3 x:0 0 0 2023-10-21T17:16:58.438 INFO:tasks.workunit.client.0.smithi012.stdout:0/702: write d7/d55/d1f/d28/fd4 [661785,110807] 0 2023-10-21T17:16:58.438 INFO:tasks.workunit.client.0.smithi012.stdout:9/588: sync 2023-10-21T17:16:58.458 INFO:tasks.workunit.client.0.smithi012.stdout:0/703: dread d7/d55/d23/d27/f5d [0,4194304] 0 2023-10-21T17:16:58.459 INFO:tasks.workunit.client.0.smithi012.stdout:0/704: write d7/d55/d23/d27/dcf/f102 [776659,87969] 0 2023-10-21T17:16:58.460 INFO:tasks.workunit.client.0.smithi012.stdout:0/705: write d7/d55/d23/d27/d31/f3e [848288,70864] 0 2023-10-21T17:16:58.460 INFO:tasks.workunit.client.0.smithi012.stdout:0/706: readlink d7/d55/d23/d66/df9/l10c 0 2023-10-21T17:16:58.656 INFO:tasks.workunit.client.0.smithi012.stdout:3/604: symlink d0/d1c/lad 0 2023-10-21T17:16:58.657 INFO:tasks.workunit.client.0.smithi012.stdout:3/605: write d0/d32/d43/d47/f91 [1759673,92119] 0 2023-10-21T17:16:58.673 INFO:tasks.workunit.client.0.smithi012.stdout:4/676: getdents dc/d15/d2a/d58 0 2023-10-21T17:16:58.701 INFO:tasks.workunit.client.0.smithi012.stdout:1/674: rename d5/d32/d1b/d27/d21/f37 to d5/d32/fe5 0 2023-10-21T17:16:58.702 INFO:tasks.workunit.client.0.smithi012.stdout:1/675: chown d5/d32/d1b/d27/d1a/d46/d4f/fa6 12780 1 2023-10-21T17:16:58.702 INFO:tasks.workunit.client.0.smithi012.stdout:1/676: stat d5/d26/d64/d8f 0 2023-10-21T17:16:58.702 INFO:tasks.workunit.client.0.smithi012.stdout:1/677: creat d5/d32/d1b/d2c/d4b/d8a/fe6 x:0 0 0 2023-10-21T17:16:58.991 INFO:tasks.workunit.client.0.smithi012.stdout:7/662: truncate d3/d6/dc/d19/d1e/d7b/f85 7261455 0 2023-10-21T17:16:59.236 INFO:tasks.workunit.client.0.smithi012.stdout:6/638: mknod d13/d29/d37/d3b/daa/cd4 0 2023-10-21T17:16:59.462 INFO:tasks.workunit.client.0.smithi012.stdout:9/589: creat d0/d4/d4b/d6a/d89/dbb/fca x:0 0 0 2023-10-21T17:16:59.464 INFO:tasks.workunit.client.0.smithi012.stdout:9/590: read d0/d15/f57 [1288927,100081] 0 2023-10-21T17:16:59.465 INFO:tasks.workunit.client.0.smithi012.stdout:9/591: chown d0/d15/l49 4167299 1 2023-10-21T17:16:59.818 INFO:tasks.workunit.client.0.smithi012.stdout:0/707: creat d7/d55/d23/dce/ddc/f10d x:0 0 0 2023-10-21T17:16:59.855 INFO:tasks.workunit.client.0.smithi012.stdout:0/708: write d7/d55/d23/f2a [1311369,112913] 0 2023-10-21T17:16:59.856 INFO:tasks.workunit.client.0.smithi012.stdout:3/606: truncate d0/d96/d97/f9a 1030374 0 2023-10-21T17:16:59.873 INFO:tasks.workunit.client.0.smithi012.stdout:2/714: dwrite d1/d4/d3f/f87 [0,4194304] 0 2023-10-21T17:16:59.873 INFO:tasks.workunit.client.0.smithi012.stdout:2/715: truncate d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/fde 1448459 0 2023-10-21T17:16:59.923 INFO:tasks.workunit.client.0.smithi012.stdout:3/607: dwrite d0/da/d28/f40 [4194304,4194304] 0 2023-10-21T17:16:59.923 INFO:tasks.workunit.client.0.smithi012.stdout:3/608: truncate d0/d32/fa9 853970 0 2023-10-21T17:16:59.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/677: unlink dc/d15/d18/l54 0 2023-10-21T17:16:59.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/678: chown dc/d1e/d33/f43 65658619 1 2023-10-21T17:17:00.168 INFO:tasks.workunit.client.0.smithi012.stdout:8/551: dwrite d0/d1a/f24 [0,4194304] 0 2023-10-21T17:17:00.399 INFO:tasks.workunit.client.0.smithi012.stdout:5/627: dwrite d2/d4f/d7e/d87/fbf [0,4194304] 0 2023-10-21T17:17:00.399 INFO:tasks.workunit.client.0.smithi012.stdout:5/628: truncate d2/d4f/d7e/d87/d57/f9b 695879 0 2023-10-21T17:17:00.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/678: mkdir d5/d32/d1b/d27/d1a/de7 0 2023-10-21T17:17:01.756 INFO:tasks.workunit.client.0.smithi012.stdout:0/709: symlink d7/d55/d23/d27/d31/l10e 0 2023-10-21T17:17:01.757 INFO:tasks.workunit.client.0.smithi012.stdout:0/710: stat d7/d55/d23/d66/df9/l10c 0 2023-10-21T17:17:01.788 INFO:tasks.workunit.client.0.smithi012.stdout:0/711: dread d7/d55/d23/d27/d31/f3c [0,4194304] 0 2023-10-21T17:17:01.788 INFO:tasks.workunit.client.0.smithi012.stdout:0/712: chown d7/d55/d23/d66/d48/de2 14 1 2023-10-21T17:17:02.297 INFO:tasks.workunit.client.0.smithi012.stdout:3/609: symlink d0/d32/d43/d47/d50/lae 0 2023-10-21T17:17:02.468 INFO:tasks.workunit.client.0.smithi012.stdout:4/679: creat dc/d15/d18/fe9 x:0 0 0 2023-10-21T17:17:02.469 INFO:tasks.workunit.client.0.smithi012.stdout:4/680: dread - dc/d1e/d2b/fe5 zero size 2023-10-21T17:17:02.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/552: creat d0/d12/d6c/db1/fba x:0 0 0 2023-10-21T17:17:04.054 INFO:tasks.workunit.client.0.smithi012.stdout:1/679: creat d5/d26/d54/fe8 x:0 0 0 2023-10-21T17:17:04.055 INFO:tasks.workunit.client.0.smithi012.stdout:1/680: chown d5/d32/d1b/d27/d47/cdb 3238941 1 2023-10-21T17:17:04.169 INFO:tasks.workunit.client.0.smithi012.stdout:1/681: dwrite d5/d32/d1b/d2c/d4b/f5d [0,4194304] 0 2023-10-21T17:17:04.429 INFO:tasks.workunit.client.0.smithi012.stdout:2/716: mknod d1/d4/d3f/d41/d59/cee 0 2023-10-21T17:17:05.124 INFO:tasks.workunit.client.0.smithi012.stdout:7/663: rename d3/d6/dc/d19/d1e/d69/db3 to d3/da7/daf/dcd 0 2023-10-21T17:17:05.199 INFO:tasks.workunit.client.0.smithi012.stdout:2/717: symlink d1/d4/d93/lef 0 2023-10-21T17:17:05.478 INFO:tasks.workunit.client.0.smithi012.stdout:1/682: rmdir d5/d32/d1b/d35/d49/d69 39 2023-10-21T17:17:05.553 INFO:tasks.workunit.client.0.smithi012.stdout:1/683: dwrite d5/d32/d1b/d27/d21/f2b [0,4194304] 0 2023-10-21T17:17:05.795 INFO:tasks.workunit.client.0.smithi012.stdout:7/664: mkdir d3/d6/dc/d19/d1e/d34/da8/db4/dce 0 2023-10-21T17:17:05.796 INFO:tasks.workunit.client.0.smithi012.stdout:7/665: stat d3/d64/fc6 0 2023-10-21T17:17:06.546 INFO:tasks.workunit.client.0.smithi012.stdout:1/684: mkdir d5/d32/d1b/d27/d47/de9 0 2023-10-21T17:17:06.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:17:06.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:17:06.991 INFO:tasks.workunit.client.0.smithi012.stdout:9/592: rename d0/d4/d4b/d6a/d12 to d0/df/d8d/dcb 0 2023-10-21T17:17:07.415 INFO:tasks.workunit.client.0.smithi012.stdout:1/685: mknod d5/d32/dce/cea 0 2023-10-21T17:17:07.416 INFO:tasks.workunit.client.0.smithi012.stdout:1/686: write d5/d32/d1b/d2c/d48/f74 [5207569,91003] 0 2023-10-21T17:17:07.620 INFO:tasks.workunit.client.0.smithi012.stdout:0/713: rename d7/d55/d23/d66/d82/d8d/caf to d7/d55/d1f/d28/d9b/d8a/c10f 0 2023-10-21T17:17:07.774 INFO:tasks.workunit.client.0.smithi012.stdout:1/687: link d5/d32/d1b/d2c/c8c d5/d26/da3/ceb 0 2023-10-21T17:17:07.775 INFO:tasks.workunit.client.0.smithi012.stdout:1/688: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fec x:0 0 0 2023-10-21T17:17:07.775 INFO:tasks.workunit.client.0.smithi012.stdout:1/689: creat d5/d32/d1b/d35/d3a/d93/fed x:0 0 0 2023-10-21T17:17:07.909 INFO:tasks.workunit.client.0.smithi012.stdout:3/610: rename d0/da/d28/f2c to d0/d82/faf 0 2023-10-21T17:17:08.003 INFO:tasks.workunit.client.0.smithi012.stdout:0/714: mknod d7/d55/d1f/c110 0 2023-10-21T17:17:08.106 INFO:tasks.workunit.client.0.smithi012.stdout:0/715: dwrite d7/f98 [0,4194304] 0 2023-10-21T17:17:08.292 INFO:tasks.workunit.client.0.smithi012.stdout:9/593: unlink d0/df/d8d/dcb/d25/d2f/d8c/cb9 0 2023-10-21T17:17:08.292 INFO:tasks.workunit.client.0.smithi012.stdout:9/594: write d0/d15/faa [818866,66352] 0 2023-10-21T17:17:08.315 INFO:tasks.workunit.client.0.smithi012.stdout:9/595: write d0/d4/d4b/f50 [2851144,70635] 0 2023-10-21T17:17:08.315 INFO:tasks.workunit.client.0.smithi012.stdout:9/596: dread - d0/df/d8d/dcb/d25/fa8 zero size 2023-10-21T17:17:08.405 INFO:tasks.workunit.client.0.smithi012.stdout:9/597: dwrite d0/df/d8d/dcb/d25/d39/f86 [0,4194304] 0 2023-10-21T17:17:08.525 INFO:tasks.workunit.client.0.smithi012.stdout:1/690: symlink d5/d26/d64/d8f/da0/lee 0 2023-10-21T17:17:08.677 INFO:tasks.workunit.client.0.smithi012.stdout:7/666: rename d3/d6/dc/d19/d43 to d3/d6/dc/d19/d43/dcf 22 2023-10-21T17:17:08.747 INFO:tasks.workunit.client.0.smithi012.stdout:7/667: dwrite d3/d6/dc/d19/d1e/dc9/f87 [0,4194304] 0 2023-10-21T17:17:08.854 INFO:tasks.workunit.client.0.smithi012.stdout:3/611: unlink d0/d32/d43/f89 0 2023-10-21T17:17:08.998 INFO:tasks.workunit.client.0.smithi012.stdout:0/716: mknod d7/d55/d23/d27/d40/c111 0 2023-10-21T17:17:09.636 INFO:tasks.workunit.client.0.smithi012.stdout:1/691: truncate d5/d32/d1b/d27/d1a/d46/fad 723840 0 2023-10-21T17:17:09.636 INFO:tasks.workunit.client.0.smithi012.stdout:1/692: write d5/d32/d62/f3b [949784,52818] 0 2023-10-21T17:17:09.709 INFO:tasks.workunit.client.0.smithi012.stdout:1/693: dwrite d5/d32/d1b/d27/f38 [4194304,4194304] 0 2023-10-21T17:17:09.774 INFO:tasks.workunit.client.0.smithi012.stdout:1/694: dwrite d5/d32/d1b/d27/d1a/d46/d4f/fac [0,4194304] 0 2023-10-21T17:17:09.774 INFO:tasks.workunit.client.0.smithi012.stdout:1/695: rename d5/d32/d1b/d27/d47 to d5/d32/d1b/d27/d47/def 22 2023-10-21T17:17:09.775 INFO:tasks.workunit.client.0.smithi012.stdout:1/696: chown d5/d61/f9e 14304 1 2023-10-21T17:17:09.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/629: sync 2023-10-21T17:17:09.803 INFO:tasks.workunit.client.0.smithi012.stdout:4/681: sync 2023-10-21T17:17:09.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/639: sync 2023-10-21T17:17:09.803 INFO:tasks.workunit.client.0.smithi012.stdout:8/553: sync 2023-10-21T17:17:09.852 INFO:tasks.workunit.client.0.smithi012.stdout:4/682: dwrite dc/d1e/f3e [0,4194304] 0 2023-10-21T17:17:10.136 INFO:tasks.workunit.client.0.smithi012.stdout:7/668: mknod d3/d6/dc/d19/d1e/dc9/cd0 0 2023-10-21T17:17:10.136 INFO:tasks.workunit.client.0.smithi012.stdout:7/669: write d3/d6/dc/d19/d1e/dc9/da0/fb6 [1625419,89294] 0 2023-10-21T17:17:10.306 INFO:tasks.workunit.client.0.smithi012.stdout:3/612: symlink d0/d32/d43/d47/d50/lb0 0 2023-10-21T17:17:10.370 INFO:tasks.workunit.client.0.smithi012.stdout:0/717: getdents d7/d55/d23/d66/d48/de2 0 2023-10-21T17:17:10.370 INFO:tasks.workunit.client.0.smithi012.stdout:0/718: fsync d7/d55/f24 0 2023-10-21T17:17:11.283 INFO:tasks.workunit.client.0.smithi012.stdout:2/718: write d1/d14/d16/d58/dec/da5/d50/f68 [913661,41997] 0 2023-10-21T17:17:11.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/554: truncate d0/d1a/f3d 1380291 0 2023-10-21T17:17:11.530 INFO:tasks.workunit.client.0.smithi012.stdout:8/555: dread d0/f27 [0,4194304] 0 2023-10-21T17:17:11.531 INFO:tasks.workunit.client.0.smithi012.stdout:8/556: truncate d0/f8 4228272 0 2023-10-21T17:17:11.741 INFO:tasks.workunit.client.0.smithi012.stdout:5/630: rename d2/d4f/d7e/d87/d57/dc7/dd0/l13 to d2/db5/ld1 0 2023-10-21T17:17:12.079 INFO:tasks.workunit.client.0.smithi012.stdout:4/683: symlink dc/d1e/d33/d8a/lea 0 2023-10-21T17:17:12.079 INFO:tasks.workunit.client.0.smithi012.stdout:4/684: dread - dc/d1e/d33/d8a/fb9 zero size 2023-10-21T17:17:12.236 INFO:tasks.workunit.client.0.smithi012.stdout:6/640: rmdir d13/d29 39 2023-10-21T17:17:12.301 INFO:tasks.workunit.client.0.smithi012.stdout:7/670: creat d3/da7/fd1 x:0 0 0 2023-10-21T17:17:12.376 INFO:tasks.workunit.client.0.smithi012.stdout:7/671: dwrite d3/d29/f7c [0,4194304] 0 2023-10-21T17:17:12.377 INFO:tasks.workunit.client.0.smithi012.stdout:7/672: write d3/d6/dc/f63 [3446340,67582] 0 2023-10-21T17:17:12.377 INFO:tasks.workunit.client.0.smithi012.stdout:7/673: write d3/d6/dc/d19/d1e/d9d/fb0 [397136,101372] 0 2023-10-21T17:17:12.378 INFO:tasks.workunit.client.0.smithi012.stdout:7/674: write d3/d6/d73/d8e/f9f [482789,69940] 0 2023-10-21T17:17:12.419 INFO:tasks.workunit.client.0.smithi012.stdout:3/613: link d0/d32/d43/d47/d50/d52/f5d d0/d1c/d5e/fb1 0 2023-10-21T17:17:12.689 INFO:tasks.workunit.client.0.smithi012.stdout:0/719: dread d7/d55/f8b [0,4194304] 0 2023-10-21T17:17:12.689 INFO:tasks.workunit.client.0.smithi012.stdout:0/720: fsync d7/d52/d90/fe8 0 2023-10-21T17:17:12.690 INFO:tasks.workunit.client.0.smithi012.stdout:0/721: stat d7/d55/d23/l47 0 2023-10-21T17:17:12.690 INFO:tasks.workunit.client.0.smithi012.stdout:0/722: chown d7/d52/df7/ff8 33755965 1 2023-10-21T17:17:12.775 INFO:tasks.workunit.client.0.smithi012.stdout:2/719: creat d1/d14/d16/d58/dec/d82/ff0 x:0 0 0 2023-10-21T17:17:12.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/720: dwrite d1/d14/d17/f92 [0,4194304] 0 2023-10-21T17:17:12.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/557: rename d0/d1a/l9d to d0/d62/d7d/lbb 0 2023-10-21T17:17:12.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/558: write d0/d1a/f1d [4481200,4945] 0 2023-10-21T17:17:13.537 INFO:tasks.workunit.client.0.smithi012.stdout:6/641: symlink d13/d29/d37/d3b/ld5 0 2023-10-21T17:17:13.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/642: chown d13/d29/lcd 51265 1 2023-10-21T17:17:13.930 INFO:tasks.workunit.client.0.smithi012.stdout:3/614: symlink d0/d32/d43/d47/d50/lb2 0 2023-10-21T17:17:14.114 INFO:tasks.workunit.client.0.smithi012.stdout:0/723: mkdir d7/d55/d23/d27/dc6/d112 0 2023-10-21T17:17:14.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/724: chown d7/d55/d23/d27/d40/c111 14122 1 2023-10-21T17:17:14.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/725: chown d7/d55/d23/d66/d82/fff 1090 1 2023-10-21T17:17:14.115 INFO:tasks.workunit.client.0.smithi012.stdout:0/726: stat d7/d55/d23/d66/d63 0 2023-10-21T17:17:14.715 INFO:tasks.workunit.client.0.smithi012.stdout:2/721: creat d1/d14/d16/d58/dec/da5/d50/ff1 x:0 0 0 2023-10-21T17:17:14.715 INFO:tasks.workunit.client.0.smithi012.stdout:8/559: rename d0/d1a/c64 to d0/d62/d7d/da3/cbc 0 2023-10-21T17:17:14.715 INFO:tasks.workunit.client.0.smithi012.stdout:8/560: readlink d0/d12/d6c/l6f 0 2023-10-21T17:17:14.979 INFO:tasks.workunit.client.0.smithi012.stdout:9/598: write d0/df/d8d/dcb/d25/d39/d8e/f91 [310906,117235] 0 2023-10-21T17:17:14.979 INFO:tasks.workunit.client.0.smithi012.stdout:9/599: fdatasync d0/d4/d4b/fba 0 2023-10-21T17:17:15.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/727: stat d7/d52/l9a 0 2023-10-21T17:17:15.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/728: dread - d7/fbc zero size 2023-10-21T17:17:15.015 INFO:tasks.workunit.client.0.smithi012.stdout:0/729: creat d7/d55/da2/f113 x:0 0 0 2023-10-21T17:17:15.170 INFO:tasks.workunit.client.0.smithi012.stdout:2/722: mknod d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/cf2 0 2023-10-21T17:17:15.317 INFO:tasks.workunit.client.0.smithi012.stdout:8/561: truncate d0/f4f 3544281 0 2023-10-21T17:17:15.317 INFO:tasks.workunit.client.0.smithi012.stdout:8/562: readlink d0/d1a/d54/l92 0 2023-10-21T17:17:15.318 INFO:tasks.workunit.client.0.smithi012.stdout:8/563: write d0/d29/f3c [1151771,66920] 0 2023-10-21T17:17:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:8/564: dwrite d0/d12/d6a/fa4 [0,4194304] 0 2023-10-21T17:17:15.501 INFO:tasks.workunit.client.0.smithi012.stdout:8/565: dwrite d0/d62/d83/f5e [0,4194304] 0 2023-10-21T17:17:15.645 INFO:tasks.workunit.client.0.smithi012.stdout:9/600: chown d0/df/d8d/dcb/d25/d39/d8e/ca3 885877 1 2023-10-21T17:17:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:0/730: dread d7/f1d [0,4194304] 0 2023-10-21T17:17:15.765 INFO:tasks.workunit.client.0.smithi012.stdout:0/731: write d7/d55/d1f/fe4 [24477,71371] 0 2023-10-21T17:17:15.765 INFO:tasks.workunit.client.0.smithi012.stdout:0/732: truncate d7/d52/ff4 282766 0 2023-10-21T17:17:17.244 INFO:tasks.workunit.client.0.smithi012.stdout:0/733: rmdir d7/d55 39 2023-10-21T17:17:17.245 INFO:tasks.workunit.client.0.smithi012.stdout:4/685: mknod dc/ceb 0 2023-10-21T17:17:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:0/734: read d7/d55/d23/d66/f1e [2060741,31188] 0 2023-10-21T17:17:17.412 INFO:tasks.workunit.client.0.smithi012.stdout:8/566: rmdir d0/d12/d6c/db1 39 2023-10-21T17:17:17.609 INFO:tasks.workunit.client.0.smithi012.stdout:9/601: rename d0/d4/d4b/d6a/c10 to d0/d4/d4b/ccc 0 2023-10-21T17:17:17.701 INFO:tasks.workunit.client.0.smithi012.stdout:9/602: dwrite d0/d15/f57 [0,4194304] 0 2023-10-21T17:17:18.045 INFO:tasks.workunit.client.0.smithi012.stdout:1/697: sync 2023-10-21T17:17:18.046 INFO:tasks.workunit.client.0.smithi012.stdout:1/698: truncate d5/d32/d1b/d35/d3a/d93/fed 809189 0 2023-10-21T17:17:19.034 INFO:tasks.workunit.client.0.smithi012.stdout:9/603: fsync d0/df/d8d/dcb/d25/d2f/f62 0 2023-10-21T17:17:19.070 INFO:tasks.workunit.client.0.smithi012.stdout:9/604: read d0/df/d8d/dcb/d25/d39/f5b [546282,17008] 0 2023-10-21T17:17:19.129 INFO:tasks.workunit.client.0.smithi012.stdout:1/699: mkdir d5/d32/d1b/d35/d49/d69/df0 0 2023-10-21T17:17:19.130 INFO:tasks.workunit.client.0.smithi012.stdout:1/700: chown d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fec 15091 1 2023-10-21T17:17:19.150 INFO:tasks.workunit.client.0.smithi012.stdout:5/631: sync 2023-10-21T17:17:19.151 INFO:tasks.workunit.client.0.smithi012.stdout:5/632: dread - d2/d4f/d7e/d87/d57/dc7/dd0/f95 zero size 2023-10-21T17:17:19.450 INFO:tasks.workunit.client.0.smithi012.stdout:7/675: write d3/d6/dc/d19/f72 [4323737,64310] 0 2023-10-21T17:17:19.673 INFO:tasks.workunit.client.0.smithi012.stdout:0/735: rename d7/d55/d23/d66 to d7/d55/d23/dce/ddc/d114 0 2023-10-21T17:17:19.674 INFO:tasks.workunit.client.0.smithi012.stdout:0/736: fdatasync d7/d55/d23/dce/ddc/d114/d48/f61 0 2023-10-21T17:17:19.970 INFO:tasks.workunit.client.0.smithi012.stdout:1/701: creat d5/d32/d1b/d35/d49/d69/ff1 x:0 0 0 2023-10-21T17:17:19.971 INFO:tasks.workunit.client.0.smithi012.stdout:1/702: readlink d5/d32/d1b/d2c/la2 0 2023-10-21T17:17:20.204 INFO:tasks.workunit.client.0.smithi012.stdout:7/676: link d3/d6/dc/d19/d43/l8b d3/d6/dc/d19/d1e/d69/d9c/ld2 0 2023-10-21T17:17:20.205 INFO:tasks.workunit.client.0.smithi012.stdout:7/677: write d3/fb1 [555228,55353] 0 2023-10-21T17:17:20.242 INFO:tasks.workunit.client.0.smithi012.stdout:7/678: write d3/d6/dc/d19/d1e/dc9/f6d [1148970,117850] 0 2023-10-21T17:17:20.242 INFO:tasks.workunit.client.0.smithi012.stdout:7/679: chown d3/d6/dc/d19/d1e 54359 1 2023-10-21T17:17:20.316 INFO:tasks.workunit.client.0.smithi012.stdout:7/680: dwrite d3/d6/dc/d19/fb9 [0,4194304] 0 2023-10-21T17:17:20.415 INFO:tasks.workunit.client.0.smithi012.stdout:8/567: rename d0/f27 to d0/d12/d6c/db1/fbd 0 2023-10-21T17:17:20.415 INFO:tasks.workunit.client.0.smithi012.stdout:0/737: symlink d7/d52/df7/l115 0 2023-10-21T17:17:20.476 INFO:tasks.workunit.client.0.smithi012.stdout:8/568: dwrite d0/d12/d6a/fa4 [4194304,4194304] 0 2023-10-21T17:17:20.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/703: creat d5/d32/d1b/d2c/d48/ff2 x:0 0 0 2023-10-21T17:17:20.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/704: dread - d5/d32/d1b/d27/d1a/f89 zero size 2023-10-21T17:17:20.531 INFO:tasks.workunit.client.0.smithi012.stdout:1/705: fsync d5/d30/d51/fb4 0 2023-10-21T17:17:20.573 INFO:tasks.workunit.client.0.smithi012.stdout:6/643: write f10 [412464,76450] 0 2023-10-21T17:17:21.128 INFO:tasks.workunit.client.0.smithi012.stdout:0/738: write d7/d52/ff4 [764800,102747] 0 2023-10-21T17:17:21.229 INFO:tasks.workunit.client.0.smithi012.stdout:0/739: dwrite d7/f10 [0,4194304] 0 2023-10-21T17:17:21.256 INFO:tasks.workunit.client.0.smithi012.stdout:0/740: write d7/d55/d23/dce/ddc/d114/f49 [3729524,124296] 0 2023-10-21T17:17:21.732 INFO:tasks.workunit.client.0.smithi012.stdout:1/706: write d5/d32/d1b/d35/d3a/d93/fed [951469,71386] 0 2023-10-21T17:17:21.733 INFO:tasks.workunit.client.0.smithi012.stdout:1/707: write d5/d32/d62/f82 [251170,112075] 0 2023-10-21T17:17:21.733 INFO:tasks.workunit.client.0.smithi012.stdout:1/708: stat d5/d32/d1b/d27/d47/cc2 0 2023-10-21T17:17:21.826 INFO:tasks.workunit.client.0.smithi012.stdout:6/644: symlink d13/d29/d37/d3b/daa/ld6 0 2023-10-21T17:17:22.297 INFO:tasks.workunit.client.0.smithi012.stdout:0/741: mknod d7/d55/d1f/dfd/c116 0 2023-10-21T17:17:22.586 INFO:tasks.workunit.client.0.smithi012.stdout:8/569: truncate d0/d12/d40/f60 1525247 0 2023-10-21T17:17:22.586 INFO:tasks.workunit.client.0.smithi012.stdout:8/570: stat d0/d12/d40/d91/cb4 0 2023-10-21T17:17:22.748 INFO:tasks.workunit.client.0.smithi012.stdout:1/709: mkdir d5/d32/d1b/d2c/d48/df3 0 2023-10-21T17:17:22.862 INFO:tasks.workunit.client.0.smithi012.stdout:3/615: unlink d0/c68 0 2023-10-21T17:17:22.943 INFO:tasks.workunit.client.0.smithi012.stdout:6/645: dread d13/d15/f2b [0,4194304] 0 2023-10-21T17:17:22.943 INFO:tasks.workunit.client.0.smithi012.stdout:6/646: fdatasync d13/d35/f3a 0 2023-10-21T17:17:23.393 INFO:tasks.workunit.client.0.smithi012.stdout:1/710: creat d5/d32/d1b/d35/d49/ff4 x:0 0 0 2023-10-21T17:17:23.394 INFO:tasks.workunit.client.0.smithi012.stdout:8/571: creat d0/d1a/fbe x:0 0 0 2023-10-21T17:17:23.394 INFO:tasks.workunit.client.0.smithi012.stdout:8/572: chown d0/d12/d80/l99 3 1 2023-10-21T17:17:23.394 INFO:tasks.workunit.client.0.smithi012.stdout:8/573: chown d0/d12/d40/d91/ca0 50165 1 2023-10-21T17:17:23.395 INFO:tasks.workunit.client.0.smithi012.stdout:8/574: fdatasync d0/d29/f59 0 2023-10-21T17:17:23.395 INFO:tasks.workunit.client.0.smithi012.stdout:8/575: chown d0/d62/d83/f5e 686 1 2023-10-21T17:17:23.492 INFO:tasks.workunit.client.0.smithi012.stdout:3/616: mknod d0/d1c/cb3 0 2023-10-21T17:17:23.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/647: creat d13/d64/d6d/d73/fd7 x:0 0 0 2023-10-21T17:17:24.255 INFO:tasks.workunit.client.0.smithi012.stdout:1/711: rename d5/d32/d1b/d35/fb2 to d5/d32/d1b/d27/d21/ff5 0 2023-10-21T17:17:24.256 INFO:tasks.workunit.client.0.smithi012.stdout:1/712: write d5/d32/d1b/d35/d3a/d93/fcf [663048,79288] 0 2023-10-21T17:17:24.257 INFO:tasks.workunit.client.0.smithi012.stdout:1/713: write d5/d26/da3/fb6 [305607,101471] 0 2023-10-21T17:17:24.257 INFO:tasks.workunit.client.0.smithi012.stdout:1/714: fdatasync d5/d32/d1b/d35/d49/fd7 0 2023-10-21T17:17:24.285 INFO:tasks.workunit.client.0.smithi012.stdout:2/723: write d1/d4/d3f/d41/d59/f62 [1833071,48276] 0 2023-10-21T17:17:24.285 INFO:tasks.workunit.client.0.smithi012.stdout:2/724: read d1/d4/d3f/f4f [2114780,45201] 0 2023-10-21T17:17:24.341 INFO:tasks.workunit.client.0.smithi012.stdout:1/715: dwrite d5/d32/d1b/d2c/d4b/f90 [0,4194304] 0 2023-10-21T17:17:24.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/716: chown d5/c1e 91 1 2023-10-21T17:17:24.343 INFO:tasks.workunit.client.0.smithi012.stdout:7/681: truncate d3/d6/dc/f63 2749833 0 2023-10-21T17:17:24.376 INFO:tasks.workunit.client.0.smithi012.stdout:2/725: dwrite d1/d4/f81 [0,4194304] 0 2023-10-21T17:17:24.424 INFO:tasks.workunit.client.0.smithi012.stdout:8/576: truncate d0/f4c 7565260 0 2023-10-21T17:17:24.523 INFO:tasks.workunit.client.0.smithi012.stdout:3/617: symlink d0/d32/d43/lb4 0 2023-10-21T17:17:24.861 INFO:tasks.workunit.client.0.smithi012.stdout:6/648: rename d13/d29/lcd to d13/d15/d1d/d5d/ld8 0 2023-10-21T17:17:25.210 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:50:51.193 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.273 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:50:51.357 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.274 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:50:51.359 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.279 INFO:tasks.workunit.client.0.smithi012.stdout:1/717: creat d5/d26/d64/d8f/dd6/ff6 x:0 0 0 2023-10-21T17:17:25.323 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:50:51.407 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.328 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:50:51.311 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.377 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:50:51.462 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.379 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:50:51.463 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.427 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:50:51.512 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.469 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:50:51.452 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:25.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/577: chown d0/l47 5653300 1 2023-10-21T17:17:25.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/578: chown d0/d12/d51/f57 341343 1 2023-10-21T17:17:25.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/579: write d0/d12/d80/f75 [1281731,20187] 0 2023-10-21T17:17:25.852 INFO:tasks.workunit.client.0.smithi012.stdout:3/618: dread d0/f7 [0,4194304] 0 2023-10-21T17:17:26.031 INFO:tasks.workunit.client.0.smithi012.stdout:7/682: rename d3/d6/dc/d19/d1e/d7b/laa to d3/d6/dc/d19/d1e/dc9/da0/ld3 0 2023-10-21T17:17:26.031 INFO:tasks.workunit.client.0.smithi012.stdout:7/683: chown d3/d64/fc6 124294192 1 2023-10-21T17:17:26.031 INFO:tasks.workunit.client.0.smithi012.stdout:7/684: chown d3/d6/fae 5 1 2023-10-21T17:17:27.467 INFO:tasks.workunit.client.0.smithi012.stdout:1/718: symlink d5/d32/d1b/d2c/lf7 0 2023-10-21T17:17:27.609 INFO:tasks.workunit.client.0.smithi012.stdout:2/726: link d1/d95/faf d1/d4/d3f/d41/d59/ff3 0 2023-10-21T17:17:27.638 INFO:tasks.workunit.client.0.smithi012.stdout:2/727: dread d1/d14/d16/d58/dec/da5/d50/f68 [0,4194304] 0 2023-10-21T17:17:27.795 INFO:tasks.workunit.client.0.smithi012.stdout:9/605: mkdir d0/dcd 0 2023-10-21T17:17:27.795 INFO:tasks.workunit.client.0.smithi012.stdout:9/606: write d0/df/d8d/dcb/d25/f56 [747335,77977] 0 2023-10-21T17:17:27.796 INFO:tasks.workunit.client.0.smithi012.stdout:9/607: dread - d0/df/d8d/dcb/d25/d39/d8e/fc2 zero size 2023-10-21T17:17:28.238 INFO:tasks.workunit.client.0.smithi012.stdout:3/619: rename d0/d32/laa to d0/d96/da0/lb5 0 2023-10-21T17:17:28.239 INFO:tasks.workunit.client.0.smithi012.stdout:3/620: read d0/d1c/f5a [2977306,59266] 0 2023-10-21T17:17:28.239 INFO:tasks.workunit.client.0.smithi012.stdout:3/621: chown d0/d32/d43 1 1 2023-10-21T17:17:28.391 INFO:tasks.workunit.client.0.smithi012.stdout:7/685: read d3/d6/dc/d19/d1e/d7b/f85 [5825697,52548] 0 2023-10-21T17:17:28.392 INFO:tasks.workunit.client.0.smithi012.stdout:7/686: dread - d3/d6/dc/d19/d1e/dc9/da0/fa9 zero size 2023-10-21T17:17:28.451 INFO:tasks.workunit.client.0.smithi012.stdout:6/649: creat d13/d15/d1d/d5d/d92/fd9 x:0 0 0 2023-10-21T17:17:28.738 INFO:tasks.workunit.client.0.smithi012.stdout:4/686: sync 2023-10-21T17:17:28.815 INFO:tasks.workunit.client.0.smithi012.stdout:9/608: read d0/d15/f9f [1171535,90008] 0 2023-10-21T17:17:28.894 INFO:tasks.workunit.client.0.smithi012.stdout:0/742: dwrite d7/d55/d23/dce/ddc/d114/da9/fca [0,4194304] 0 2023-10-21T17:17:28.895 INFO:tasks.workunit.client.0.smithi012.stdout:0/743: creat d7/d52/d53/f117 x:0 0 0 2023-10-21T17:17:28.895 INFO:tasks.workunit.client.0.smithi012.stdout:0/744: fsync d7/d55/d23/d27/d31/d5f/ff0 0 2023-10-21T17:17:29.090 INFO:tasks.workunit.client.0.smithi012.stdout:1/719: rename d5/d32/d1b/d35/d3a/d5c/d7c/c91 to d5/d32/d1b/d27/d47/de9/cf8 0 2023-10-21T17:17:29.090 INFO:tasks.workunit.client.0.smithi012.stdout:1/720: truncate d5/d26/d64/d8f/dd6/ff6 820126 0 2023-10-21T17:17:29.090 INFO:tasks.workunit.client.0.smithi012.stdout:1/721: chown d5/d26/d64/d8f 117422421 1 2023-10-21T17:17:29.091 INFO:tasks.workunit.client.0.smithi012.stdout:1/722: write d5/d32/d1b/d35/d3a/d93/fc0 [497079,80008] 0 2023-10-21T17:17:29.116 INFO:tasks.workunit.client.0.smithi012.stdout:1/723: dread d5/d26/f40 [0,4194304] 0 2023-10-21T17:17:29.116 INFO:tasks.workunit.client.0.smithi012.stdout:1/724: read - d5/d32/d1b/d27/d1a/fc7 zero size 2023-10-21T17:17:29.117 INFO:tasks.workunit.client.0.smithi012.stdout:1/725: read d5/d32/d62/f82 [317320,27474] 0 2023-10-21T17:17:29.262 INFO:tasks.workunit.client.0.smithi012.stdout:3/622: truncate d0/d32/d43/d47/f83 1493104 0 2023-10-21T17:17:29.288 INFO:tasks.workunit.client.0.smithi012.stdout:3/623: dread d0/d32/f4e [0,4194304] 0 2023-10-21T17:17:29.438 INFO:tasks.workunit.client.0.smithi012.stdout:7/687: mkdir d3/d6/dc/d19/d1e/d7b/dd4 0 2023-10-21T17:17:29.438 INFO:tasks.workunit.client.0.smithi012.stdout:7/688: truncate d3/d6/dc/d19/d1e/d9d/fb0 645716 0 2023-10-21T17:17:29.588 INFO:tasks.workunit.client.0.smithi012.stdout:6/650: rmdir d13/d35/d4c 39 2023-10-21T17:17:29.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/651: chown d13/f47 15140245 1 2023-10-21T17:17:29.854 INFO:tasks.workunit.client.0.smithi012.stdout:9/609: truncate d0/df/d8d/f38 3677513 0 2023-10-21T17:17:30.446 INFO:tasks.workunit.client.0.smithi012.stdout:0/745: link d7/d55/d23/d27/d31/d3d/l96 d7/d55/d23/dce/ddc/d114/df9/l118 0 2023-10-21T17:17:31.010 INFO:tasks.workunit.client.0.smithi012.stdout:3/624: creat d0/d82/fb6 x:0 0 0 2023-10-21T17:17:31.010 INFO:tasks.workunit.client.0.smithi012.stdout:7/689: creat d3/d6/dc/d19/d1e/d34/fd5 x:0 0 0 2023-10-21T17:17:31.011 INFO:tasks.workunit.client.0.smithi012.stdout:7/690: readlink d3/d6/dc/l8c 0 2023-10-21T17:17:31.011 INFO:tasks.workunit.client.0.smithi012.stdout:7/691: creat d3/da7/fd6 x:0 0 0 2023-10-21T17:17:31.011 INFO:tasks.workunit.client.0.smithi012.stdout:7/692: creat d3/d6/dc/d19/d1e/d34/da8/fd7 x:0 0 0 2023-10-21T17:17:31.046 INFO:tasks.workunit.client.0.smithi012.stdout:7/693: dread d3/f41 [0,4194304] 0 2023-10-21T17:17:31.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/694: write d3/d64/f8a [4462626,65425] 0 2023-10-21T17:17:31.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/695: chown d3/da7/daf/dcd 1086 1 2023-10-21T17:17:31.362 INFO:tasks.workunit.client.0.smithi012.stdout:9/610: creat d0/df/d8d/dcb/d25/d39/d3b/fce x:0 0 0 2023-10-21T17:17:31.363 INFO:tasks.workunit.client.0.smithi012.stdout:9/611: truncate d0/df/d8d/dcb/d2a/f7f 48422 0 2023-10-21T17:17:31.363 INFO:tasks.workunit.client.0.smithi012.stdout:9/612: chown d0/d4/d4b/d6a/d89/dbb/fca 34 1 2023-10-21T17:17:31.862 INFO:tasks.workunit.client.0.smithi012.stdout:0/746: symlink d7/d55/d23/d27/de3/l119 0 2023-10-21T17:17:32.205 INFO:tasks.workunit.client.0.smithi012.stdout:3/625: creat d0/d96/d97/fb7 x:0 0 0 2023-10-21T17:17:32.205 INFO:tasks.workunit.client.0.smithi012.stdout:3/626: chown d0/da/f54 151536352 1 2023-10-21T17:17:32.206 INFO:tasks.workunit.client.0.smithi012.stdout:3/627: truncate d0/d32/d43/d47/d50/d52/f8e 580564 0 2023-10-21T17:17:32.627 INFO:tasks.workunit.client.0.smithi012.stdout:2/728: creat d1/d14/d16/d58/dec/ff4 x:0 0 0 2023-10-21T17:17:32.628 INFO:tasks.workunit.client.0.smithi012.stdout:2/729: stat d1/d14/d16/d58/dec/da5/d50/c7d 0 2023-10-21T17:17:32.657 INFO:tasks.workunit.client.0.smithi012.stdout:5/633: sync 2023-10-21T17:17:32.905 INFO:tasks.workunit.client.0.smithi012.stdout:8/580: sync 2023-10-21T17:17:32.906 INFO:tasks.workunit.client.0.smithi012.stdout:8/581: fsync d0/f17 0 2023-10-21T17:17:32.936 INFO:tasks.workunit.client.0.smithi012.stdout:8/582: dread d0/f4 [0,4194304] 0 2023-10-21T17:17:33.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/696: symlink d3/d6/dc/d19/d1e/dc9/ld8 0 2023-10-21T17:17:33.209 INFO:tasks.workunit.client.0.smithi012.stdout:9/613: link d0/df/d8d/dcb/d25/d2f/f62 d0/df/d8d/dcb/d25/d2f/d8c/fcf 0 2023-10-21T17:17:33.442 INFO:tasks.workunit.client.0.smithi012.stdout:1/726: rename d5/d32/d1b/d27/d1a to d5/d32/dce/df9 0 2023-10-21T17:17:33.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/628: symlink d0/d96/lb8 0 2023-10-21T17:17:33.542 INFO:tasks.workunit.client.0.smithi012.stdout:1/727: dwrite d5/d32/d1b/d27/d86/f99 [4194304,4194304] 0 2023-10-21T17:17:33.685 INFO:tasks.workunit.client.0.smithi012.stdout:2/730: creat d1/d14/d16/d58/dec/da5/dbe/ddc/ff5 x:0 0 0 2023-10-21T17:17:33.931 INFO:tasks.workunit.client.0.smithi012.stdout:5/634: unlink d2/d2c/c62 0 2023-10-21T17:17:34.079 INFO:tasks.workunit.client.0.smithi012.stdout:8/583: mknod d0/d29/cbf 0 2023-10-21T17:17:34.381 INFO:tasks.workunit.client.0.smithi012.stdout:9/614: rmdir d0/d4/d4b/d6a 39 2023-10-21T17:17:34.449 INFO:tasks.workunit.client.0.smithi012.stdout:4/687: dwrite dc/d15/d2a/f78 [0,4194304] 0 2023-10-21T17:17:35.068 INFO:tasks.workunit.client.0.smithi012.stdout:2/731: mknod d1/d14/d17/da6/cf6 0 2023-10-21T17:17:35.070 INFO:tasks.workunit.client.0.smithi012.stdout:2/732: read d1/d14/d17/f73 [240642,91496] 0 2023-10-21T17:17:35.070 INFO:tasks.workunit.client.0.smithi012.stdout:2/733: stat d1/d14/d17/da6/fb6 0 2023-10-21T17:17:35.070 INFO:tasks.workunit.client.0.smithi012.stdout:2/734: write d1/d14/d16/d58/dec/da5/d50/f79 [1835940,42442] 0 2023-10-21T17:17:35.103 INFO:tasks.workunit.client.0.smithi012.stdout:1/728: dread d5/d32/d1b/d35/d3a/f3d [0,4194304] 0 2023-10-21T17:17:35.104 INFO:tasks.workunit.client.0.smithi012.stdout:2/735: dread d1/d4/f7 [0,4194304] 0 2023-10-21T17:17:35.105 INFO:tasks.workunit.client.0.smithi012.stdout:2/736: chown d1/d4/d3f/d41/d59/cee 15 1 2023-10-21T17:17:35.154 INFO:tasks.workunit.client.0.smithi012.stdout:5/635: symlink d2/db5/ld2 0 2023-10-21T17:17:35.154 INFO:tasks.workunit.client.0.smithi012.stdout:5/636: dread - d2/d4f/d59/d5b/d1e/f91 zero size 2023-10-21T17:17:35.173 INFO:tasks.workunit.client.0.smithi012.stdout:2/737: dwrite d1/d14/d16/d58/dec/da5/d34/fa4 [0,4194304] 0 2023-10-21T17:17:35.272 INFO:tasks.workunit.client.0.smithi012.stdout:9/615: truncate d0/df/d8d/dcb/d2a/f87 3764436 0 2023-10-21T17:17:35.274 INFO:tasks.workunit.client.0.smithi012.stdout:4/688: truncate dc/d15/f47 5330265 0 2023-10-21T17:17:35.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/729: truncate d5/d32/d1b/d35/d3a/d93/fed 923335 0 2023-10-21T17:17:35.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/730: read - d5/d32/d1b/d35/d49/d69/ff1 zero size 2023-10-21T17:17:35.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/731: stat d5/d32/l2a 0 2023-10-21T17:17:35.478 INFO:tasks.workunit.client.0.smithi012.stdout:1/732: read d5/f39 [3051573,104547] 0 2023-10-21T17:17:35.569 INFO:tasks.workunit.client.0.smithi012.stdout:5/637: symlink d2/d4f/d59/d5b/d15/ld3 0 2023-10-21T17:17:36.080 INFO:tasks.workunit.client.0.smithi012.stdout:2/738: chown d1/d4/d65/cac 1063 1 2023-10-21T17:17:36.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/616: creat d0/d4/d4b/d6a/fd0 x:0 0 0 2023-10-21T17:17:36.284 INFO:tasks.workunit.client.0.smithi012.stdout:6/652: dwrite d13/d42/d89/db8/f2f [0,4194304] 0 2023-10-21T17:17:36.467 INFO:tasks.workunit.client.0.smithi012.stdout:4/689: fsync dc/d93/f50 0 2023-10-21T17:17:36.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/690: dwrite dc/d1e/d33/fd9 [0,4194304] 0 2023-10-21T17:17:37.085 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:17:37.098 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:17:37.235 INFO:tasks.workunit.client.0.smithi012.stdout:5/638: stat d2/d2c/l58 0 2023-10-21T17:17:37.275 INFO:tasks.workunit.client.0.smithi012.stdout:5/639: read d2/d1d/d4e/f85 [3483817,1168] 0 2023-10-21T17:17:37.374 INFO:tasks.workunit.client.0.smithi012.stdout:2/739: truncate d1/d14/d16/d58/f66 2673696 0 2023-10-21T17:17:37.375 INFO:tasks.workunit.client.0.smithi012.stdout:2/740: chown d1/d14/d16/d58/dec/da5/d50/da3/da9/fc1 177 1 2023-10-21T17:17:37.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/653: creat d13/d29/d78/fda x:0 0 0 2023-10-21T17:17:38.258 INFO:tasks.workunit.client.0.smithi012.stdout:4/691: truncate dc/d15/d18/d4c/d75/f7c 183996 0 2023-10-21T17:17:38.621 INFO:tasks.workunit.client.0.smithi012.stdout:2/741: unlink d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/fcf 0 2023-10-21T17:17:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:9/617: symlink d0/d4/d4b/d6a/d89/ld1 0 2023-10-21T17:17:38.894 INFO:tasks.workunit.client.0.smithi012.stdout:6/654: rename le to d13/d42/d89/db8/d9f/ldb 0 2023-10-21T17:17:39.511 INFO:tasks.workunit.client.0.smithi012.stdout:9/618: getdents d0/df/d8d/dcb/d25/d39/d8e 0 2023-10-21T17:17:39.511 INFO:tasks.workunit.client.0.smithi012.stdout:9/619: chown d0/df/d8d/dcb/d25/d39/d8e/cc6 83210171 1 2023-10-21T17:17:39.512 INFO:tasks.workunit.client.0.smithi012.stdout:9/620: fdatasync d0/d4/d4b/d6a/fd0 0 2023-10-21T17:17:39.606 INFO:tasks.workunit.client.0.smithi012.stdout:9/621: dwrite d0/d4/d4b/f99 [0,4194304] 0 2023-10-21T17:17:39.606 INFO:tasks.workunit.client.0.smithi012.stdout:9/622: write d0/d4/d4b/fbf [748777,54529] 0 2023-10-21T17:17:39.686 INFO:tasks.workunit.client.0.smithi012.stdout:2/742: rename d1/d4/d65/dea/lcb to d1/d14/d16/d58/dec/da5/dbe/lf7 0 2023-10-21T17:17:39.966 INFO:tasks.workunit.client.0.smithi012.stdout:3/629: write d0/d1c/f60 [4409965,109012] 0 2023-10-21T17:17:39.966 INFO:tasks.workunit.client.0.smithi012.stdout:3/630: read - d0/d82/f9f zero size 2023-10-21T17:17:40.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/697: write d3/d6/dc/d19/f72 [1872303,103809] 0 2023-10-21T17:17:40.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/698: chown d3/d6/d73/d8e/c91 0 1 2023-10-21T17:17:40.020 INFO:tasks.workunit.client.0.smithi012.stdout:3/631: dread d0/d1c/f60 [0,4194304] 0 2023-10-21T17:17:40.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/747: dwrite d7/d55/d23/dce/ddc/d114/d48/de2/f105 [0,4194304] 0 2023-10-21T17:17:40.085 INFO:tasks.workunit.client.0.smithi012.stdout:3/632: dwrite d0/f3b [0,4194304] 0 2023-10-21T17:17:40.103 INFO:tasks.workunit.client.0.smithi012.stdout:3/633: dread d0/da/d28/fa6 [0,4194304] 0 2023-10-21T17:17:40.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/640: link d2/d1d/d20/l50 d2/d1d/ld4 0 2023-10-21T17:17:40.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/641: chown d2/d4f/d7e/d87/d57/dc7/dd0/fc8 2670 1 2023-10-21T17:17:40.287 INFO:tasks.workunit.client.0.smithi012.stdout:5/642: dwrite d2/d1d/f56 [4194304,4194304] 0 2023-10-21T17:17:40.288 INFO:tasks.workunit.client.0.smithi012.stdout:5/643: chown d2/lb 358736 1 2023-10-21T17:17:40.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/584: dwrite d0/d1a/f3d [0,4194304] 0 2023-10-21T17:17:40.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/585: fsync d0/f26 0 2023-10-21T17:17:40.530 INFO:tasks.workunit.client.0.smithi012.stdout:9/623: creat d0/da7/fd2 x:0 0 0 2023-10-21T17:17:40.624 INFO:tasks.workunit.client.0.smithi012.stdout:9/624: dwrite d0/df/d8d/dcb/d25/d39/d3b/f70 [0,4194304] 0 2023-10-21T17:17:40.744 INFO:tasks.workunit.client.0.smithi012.stdout:2/743: write d1/d14/d16/f72 [1847036,93201] 0 2023-10-21T17:17:40.851 INFO:tasks.workunit.client.0.smithi012.stdout:2/744: dwrite d1/d14/d17/db9/dd6/f8c [0,4194304] 0 2023-10-21T17:17:41.187 INFO:tasks.workunit.client.0.smithi012.stdout:0/748: link d7/d55/d23/cf2 d7/d55/d23/d27/c11a 0 2023-10-21T17:17:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:3/634: creat d0/d32/d43/fb9 x:0 0 0 2023-10-21T17:17:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:3/635: write d0/d82/fb6 [236843,118406] 0 2023-10-21T17:17:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:3/636: dwrite d0/da/d28/f38 [0,4194304] 0 2023-10-21T17:17:41.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/644: rmdir d2/d4f/d7e/d87/d57 39 2023-10-21T17:17:43.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/749: creat d7/d55/d23/dce/ddc/d114/df9/f11b x:0 0 0 2023-10-21T17:17:43.126 INFO:tasks.workunit.client.0.smithi012.stdout:0/750: write d7/d52/df7/ff8 [891753,1177] 0 2023-10-21T17:17:43.199 INFO:tasks.workunit.client.0.smithi012.stdout:0/751: dwrite d7/d55/d1f/f104 [0,4194304] 0 2023-10-21T17:17:43.199 INFO:tasks.workunit.client.0.smithi012.stdout:0/752: fdatasync d7/d55/f24 0 2023-10-21T17:17:43.199 INFO:tasks.workunit.client.0.smithi012.stdout:0/753: stat d7/d55/d23/d27/de3 0 2023-10-21T17:17:43.199 INFO:tasks.workunit.client.0.smithi012.stdout:0/754: chown d7/d55/d23/dce/ddc/d114/da9/lf6 6786 1 2023-10-21T17:17:43.434 INFO:tasks.workunit.client.0.smithi012.stdout:1/733: dwrite d5/d32/d1b/d35/d3a/f3d [0,4194304] 0 2023-10-21T17:17:43.437 INFO:tasks.workunit.client.0.smithi012.stdout:5/645: fsync d2/d1d/d20/f2b 0 2023-10-21T17:17:43.520 INFO:tasks.workunit.client.0.smithi012.stdout:5/646: dwrite d2/d4f/d59/d5b/f67 [0,4194304] 0 2023-10-21T17:17:43.520 INFO:tasks.workunit.client.0.smithi012.stdout:5/647: write d2/d4f/d59/f89 [1896419,44458] 0 2023-10-21T17:17:43.520 INFO:tasks.workunit.client.0.smithi012.stdout:5/648: chown d2/d4f/d59/d5b/d15/l92 1292376 1 2023-10-21T17:17:43.869 INFO:tasks.workunit.client.0.smithi012.stdout:6/655: truncate d13/d42/d89/db8/f2f 166896 0 2023-10-21T17:17:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:1/734: truncate d5/d30/d51/fb4 3060223 0 2023-10-21T17:17:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:1/735: dread - d5/d32/d1b/d2c/d4b/d8a/fe6 zero size 2023-10-21T17:17:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:1/736: write d5/d26/da3/fb6 [484770,34865] 0 2023-10-21T17:17:44.777 INFO:tasks.workunit.client.0.smithi012.stdout:5/649: unlink d2/d2c/f43 0 2023-10-21T17:17:45.118 INFO:tasks.workunit.client.0.smithi012.stdout:4/692: write dc/d15/d18/d4c/d55/f7f [2717994,63828] 0 2023-10-21T17:17:45.375 INFO:tasks.workunit.client.0.smithi012.stdout:5/650: getdents d2/d4f/d59/d5b 0 2023-10-21T17:17:45.397 INFO:tasks.workunit.client.0.smithi012.stdout:4/693: mknod dc/d93/dde/cec 0 2023-10-21T17:17:46.150 INFO:tasks.workunit.client.0.smithi012.stdout:3/637: rmdir d0/d1c 39 2023-10-21T17:17:46.151 INFO:tasks.workunit.client.0.smithi012.stdout:3/638: stat d0/d96/lb8 0 2023-10-21T17:17:46.151 INFO:tasks.workunit.client.0.smithi012.stdout:4/694: creat dc/d1e/d33/d8a/fed x:0 0 0 2023-10-21T17:17:46.152 INFO:tasks.workunit.client.0.smithi012.stdout:3/639: write d0/d32/d43/d47/d50/d52/f8e [159184,5944] 0 2023-10-21T17:17:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:7/699: rename d3/d6/dc/d19/d1e/d69 to d3/dd9 0 2023-10-21T17:17:46.704 INFO:tasks.workunit.client.0.smithi012.stdout:0/755: rename d7/d55/d23/dce/ddc/d114/d48/fb0 to d7/d55/d23/dce/ddc/d114/d82/d8d/f11c 0 2023-10-21T17:17:46.705 INFO:tasks.workunit.client.0.smithi012.stdout:0/756: chown d7/d55/d1f/d28/f51 9244 1 2023-10-21T17:17:46.773 INFO:tasks.workunit.client.0.smithi012.stdout:7/700: mkdir d3/d6/dc/d19/d1e/d9d/dda 0 2023-10-21T17:17:46.773 INFO:tasks.workunit.client.0.smithi012.stdout:7/701: read d3/d6/dc/f54 [2865226,6965] 0 2023-10-21T17:17:46.774 INFO:tasks.workunit.client.0.smithi012.stdout:7/702: stat d3/d6/dc/f36 0 2023-10-21T17:17:46.774 INFO:tasks.workunit.client.0.smithi012.stdout:7/703: chown d3/d6/dc/d19/d1e/dc9/c2c 441454021 1 2023-10-21T17:17:46.802 INFO:tasks.workunit.client.0.smithi012.stdout:7/704: dread d3/d6/dc/d19/d1e/d7b/f85 [4194304,4194304] 0 2023-10-21T17:17:46.861 INFO:tasks.workunit.client.0.smithi012.stdout:9/625: write d0/df/d44/f51 [3454969,56897] 0 2023-10-21T17:17:46.940 INFO:tasks.workunit.client.0.smithi012.stdout:9/626: dwrite d0/df/d8d/dcb/d25/d39/d3b/f73 [0,4194304] 0 2023-10-21T17:17:46.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/695: getdents dc/d6b 0 2023-10-21T17:17:46.942 INFO:tasks.workunit.client.0.smithi012.stdout:4/696: read - dc/d15/d18/d4c/d55/d6c/d77/f8f zero size 2023-10-21T17:17:46.942 INFO:tasks.workunit.client.0.smithi012.stdout:4/697: readlink dc/d1e/l1d 0 2023-10-21T17:17:47.047 INFO:tasks.workunit.client.0.smithi012.stdout:5/651: rename d2/d4f/d7e/d87/d57/f7d to d2/d2c/db6/fd5 0 2023-10-21T17:17:47.057 INFO:tasks.workunit.client.0.smithi012.stdout:5/652: write d2/d2c/db6/fd5 [773469,29784] 0 2023-10-21T17:17:47.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/705: mknod d3/d6/dc/d19/d1e/d34/da8/db4/dce/cdb 0 2023-10-21T17:17:47.578 INFO:tasks.workunit.client.0.smithi012.stdout:7/706: dwrite d3/d6/dc/d19/f22 [0,4194304] 0 2023-10-21T17:17:47.849 INFO:tasks.workunit.client.0.smithi012.stdout:4/698: rename dc/d15/d18/d4c/d55/d6c/d83/cd2 to dc/d1e/d6e/cee 0 2023-10-21T17:17:48.042 INFO:tasks.workunit.client.0.smithi012.stdout:6/656: mknod d13/cdc 0 2023-10-21T17:17:48.314 INFO:tasks.workunit.client.0.smithi012.stdout:7/707: mknod d3/d6/dc/d19/d1e/d9d/cdc 0 2023-10-21T17:17:49.944 INFO:tasks.workunit.client.0.smithi012.stdout:6/657: rename d13/d42/d71/cb2 to d13/d15/d1d/d28/d5b/cdd 0 2023-10-21T17:17:50.141 INFO:tasks.workunit.client.0.smithi012.stdout:7/708: truncate d3/d6/dc/f36 5099701 0 2023-10-21T17:17:50.141 INFO:tasks.workunit.client.0.smithi012.stdout:7/709: stat d3/d6/dc/d19/d1e/d7b/c84 0 2023-10-21T17:17:50.646 INFO:tasks.workunit.client.0.smithi012.stdout:6/658: mknod d13/d15/d1d/d28/d5b/d75/cde 0 2023-10-21T17:17:50.646 INFO:tasks.workunit.client.0.smithi012.stdout:6/659: chown d13/d15/d1d/c2c 0 1 2023-10-21T17:17:50.928 INFO:tasks.workunit.client.0.smithi012.stdout:2/745: creat d1/d14/d16/d58/dec/da5/ff8 x:0 0 0 2023-10-21T17:17:51.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/737: mkdir d5/d32/d1b/dfa 0 2023-10-21T17:17:51.477 INFO:tasks.workunit.client.0.smithi012.stdout:2/746: rename d1/de7/de9 to d1/d14/d17/da6/df9 0 2023-10-21T17:17:51.478 INFO:tasks.workunit.client.0.smithi012.stdout:2/747: truncate d1/d14/d16/d58/dec/d82/d86/fd5 552056 0 2023-10-21T17:17:51.478 INFO:tasks.workunit.client.0.smithi012.stdout:2/748: chown d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/fde 707868824 1 2023-10-21T17:17:51.478 INFO:tasks.workunit.client.0.smithi012.stdout:1/738: write d5/d32/d1b/d27/d86/f99 [8951220,102701] 0 2023-10-21T17:17:51.478 INFO:tasks.workunit.client.0.smithi012.stdout:1/739: chown d5/d32/d1b/d35/d49/d69/f9b 381099 1 2023-10-21T17:17:51.479 INFO:tasks.workunit.client.0.smithi012.stdout:1/740: write d5/d32/d1b/d2c/d48/f6c [7368740,15037] 0 2023-10-21T17:17:51.479 INFO:tasks.workunit.client.0.smithi012.stdout:1/741: getdents d5/d61/d95 0 2023-10-21T17:17:51.508 INFO:tasks.workunit.client.0.smithi012.stdout:1/742: write d5/d26/d54/f65 [4105967,17443] 0 2023-10-21T17:17:51.878 INFO:tasks.workunit.client.0.smithi012.stdout:6/660: dread d13/d35/d4c/f9e [0,4194304] 0 2023-10-21T17:17:52.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/586: symlink d0/lc0 0 2023-10-21T17:17:52.032 INFO:tasks.workunit.client.0.smithi012.stdout:8/587: creat d0/d1a/fc1 x:0 0 0 2023-10-21T17:17:52.329 INFO:tasks.workunit.client.0.smithi012.stdout:2/749: rmdir d1/d4/d3f/d41/d59 39 2023-10-21T17:17:52.910 INFO:tasks.workunit.client.0.smithi012.stdout:6/661: creat d13/d15/d1d/d28/fdf x:0 0 0 2023-10-21T17:17:52.910 INFO:tasks.workunit.client.0.smithi012.stdout:6/662: truncate d13/d29/d78/fda 920327 0 2023-10-21T17:17:52.976 INFO:tasks.workunit.client.0.smithi012.stdout:0/757: write d7/d55/d1f/d28/f51 [4061020,115717] 0 2023-10-21T17:17:52.976 INFO:tasks.workunit.client.0.smithi012.stdout:0/758: write d7/d55/d23/d27/fb6 [285263,84136] 0 2023-10-21T17:17:52.976 INFO:tasks.workunit.client.0.smithi012.stdout:0/759: stat d7/d55/d23/d27/fb6 0 2023-10-21T17:17:53.108 INFO:tasks.workunit.client.0.smithi012.stdout:8/588: truncate d0/d12/d6c/db1/fbd 3676651 0 2023-10-21T17:17:53.235 INFO:tasks.workunit.client.0.smithi012.stdout:2/750: symlink d1/d4/d93/lfa 0 2023-10-21T17:17:53.445 INFO:tasks.workunit.client.0.smithi012.stdout:9/627: dwrite d0/df/d8d/dcb/f55 [0,4194304] 0 2023-10-21T17:17:53.604 INFO:tasks.workunit.client.0.smithi012.stdout:1/743: mkdir d5/d32/d1b/d27/dfb 0 2023-10-21T17:17:53.915 INFO:tasks.workunit.client.0.smithi012.stdout:0/760: mkdir d7/d55/d23/dce/ddc/d114/d48/d88/d11d 0 2023-10-21T17:17:53.915 INFO:tasks.workunit.client.0.smithi012.stdout:0/761: stat d7/d55/d23/d30/d8c/ca3 0 2023-10-21T17:17:53.995 INFO:tasks.workunit.client.0.smithi012.stdout:0/762: dwrite d7/d52/d53/fdd [0,4194304] 0 2023-10-21T17:17:54.169 INFO:tasks.workunit.client.0.smithi012.stdout:8/589: creat d0/d62/d7d/da3/fc2 x:0 0 0 2023-10-21T17:17:54.169 INFO:tasks.workunit.client.0.smithi012.stdout:8/590: chown d0/d1a/d54/l92 0 1 2023-10-21T17:17:54.303 INFO:tasks.workunit.client.0.smithi012.stdout:8/591: dwrite d0/fe [0,4194304] 0 2023-10-21T17:17:54.316 INFO:tasks.workunit.client.0.smithi012.stdout:2/751: creat d1/d14/d17/ffb x:0 0 0 2023-10-21T17:17:54.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/592: dread d0/d12/d51/f57 [0,4194304] 0 2023-10-21T17:17:54.409 INFO:tasks.workunit.client.0.smithi012.stdout:9/628: link d0/d4/d4b/d6a/d89/ld1 d0/da7/ld3 0 2023-10-21T17:17:54.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/752: dwrite d1/d14/d16/d58/dec/da5/d34/fb1 [0,4194304] 0 2023-10-21T17:17:54.892 INFO:tasks.workunit.client.0.smithi012.stdout:0/763: symlink d7/d55/d23/dce/ddc/l11e 0 2023-10-21T17:17:55.115 INFO:tasks.workunit.client.0.smithi012.stdout:8/593: creat d0/d29/fc3 x:0 0 0 2023-10-21T17:17:55.116 INFO:tasks.workunit.client.0.smithi012.stdout:8/594: creat d0/d12/d80/d71/fc4 x:0 0 0 2023-10-21T17:17:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:2/753: chown d1/d14/d17/db9/dd6/f3b 615572 1 2023-10-21T17:17:55.573 INFO:tasks.workunit.client.0.smithi012.stdout:9/629: dwrite d0/df/d8d/dcb/d25/f56 [0,4194304] 0 2023-10-21T17:17:55.632 INFO:tasks.workunit.client.0.smithi012.stdout:1/744: symlink d5/d32/d1b/d27/lfc 0 2023-10-21T17:17:55.676 INFO:tasks.workunit.client.0.smithi012.stdout:1/745: read d5/d32/fe5 [227220,125623] 0 2023-10-21T17:17:55.686 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:51:21.669 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.695 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:51:21.779 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.698 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:51:21.783 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.700 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:51:21.784 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.700 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:51:21.683 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.703 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:51:21.788 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.723 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:51:21.808 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.728 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:51:21.813 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.783 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:51:21.766 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:17:55.814 INFO:tasks.workunit.client.0.smithi012.stdout:0/764: getdents d7 0 2023-10-21T17:17:55.814 INFO:tasks.workunit.client.0.smithi012.stdout:0/765: fdatasync d7/d55/d23/f46 0 2023-10-21T17:17:56.252 INFO:tasks.workunit.client.0.smithi012.stdout:9/630: mknod d0/df/d8d/dcb/d25/cd4 0 2023-10-21T17:17:56.414 INFO:tasks.workunit.client.0.smithi012.stdout:1/746: mkdir d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/dfd 0 2023-10-21T17:17:56.492 INFO:tasks.workunit.client.0.smithi012.stdout:1/747: dwrite d5/d32/d1b/d2c/d48/ff2 [0,4194304] 0 2023-10-21T17:17:56.526 INFO:tasks.workunit.client.0.smithi012.stdout:0/766: mkdir d7/d55/d23/dce/ddc/d114/d48/de2/d11f 0 2023-10-21T17:17:56.973 INFO:tasks.workunit.client.0.smithi012.stdout:9/631: link d0/d5/c5d d0/df/d8d/dcb/d25/d2f/d8c/cd5 0 2023-10-21T17:17:57.038 INFO:tasks.workunit.client.0.smithi012.stdout:1/748: symlink d5/d32/dce/df9/de7/lfe 0 2023-10-21T17:17:57.073 INFO:tasks.workunit.client.0.smithi012.stdout:9/632: dwrite d0/df/d8d/dcb/d25/d39/d3b/fce [0,4194304] 0 2023-10-21T17:17:57.127 INFO:tasks.workunit.client.0.smithi012.stdout:0/767: truncate d7/d52/fc1 2550197 0 2023-10-21T17:17:57.899 INFO:tasks.workunit.client.0.smithi012.stdout:1/749: read d5/d32/d1b/d2c/d4b/f70 [692685,125295] 0 2023-10-21T17:17:58.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/768: mknod d7/d55/d23/d27/c120 0 2023-10-21T17:17:58.834 INFO:tasks.workunit.client.0.smithi012.stdout:1/750: symlink d5/d30/lff 0 2023-10-21T17:17:58.834 INFO:tasks.workunit.client.0.smithi012.stdout:1/751: fdatasync d5/f14 0 2023-10-21T17:17:58.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/752: dread - d5/d32/d1b/d35/d3a/d5c/d7c/db7/fc6 zero size 2023-10-21T17:17:58.986 INFO:tasks.workunit.client.0.smithi012.stdout:0/769: creat d7/d55/d23/d27/d31/d5f/dde/f121 x:0 0 0 2023-10-21T17:17:59.296 INFO:tasks.workunit.client.0.smithi012.stdout:1/753: symlink d5/d32/dce/df9/d46/d4f/l100 0 2023-10-21T17:17:59.308 INFO:tasks.workunit.client.0.smithi012.stdout:3/640: rmdir d0/d32/d43/d47 39 2023-10-21T17:17:59.308 INFO:tasks.workunit.client.0.smithi012.stdout:3/641: fsync d0/d1c/f5a 0 2023-10-21T17:17:59.333 INFO:tasks.workunit.client.0.smithi012.stdout:1/754: dread d5/d32/d1b/d35/f3f [4194304,4194304] 0 2023-10-21T17:17:59.980 INFO:tasks.workunit.client.0.smithi012.stdout:6/663: dwrite d13/d42/d89/db8/f2f [0,4194304] 0 2023-10-21T17:18:00.188 INFO:tasks.workunit.client.0.smithi012.stdout:0/770: mknod d7/d55/d23/d30/c122 0 2023-10-21T17:18:00.493 INFO:tasks.workunit.client.0.smithi012.stdout:3/642: mkdir d0/d9d/dba 0 2023-10-21T17:18:00.556 INFO:tasks.workunit.client.0.smithi012.stdout:1/755: mkdir d5/d26/d54/d101 0 2023-10-21T17:18:01.167 INFO:tasks.workunit.client.0.smithi012.stdout:8/595: dwrite d0/d1a/f33 [0,4194304] 0 2023-10-21T17:18:01.458 INFO:tasks.workunit.client.0.smithi012.stdout:0/771: creat d7/d55/d23/dce/ddc/d114/da8/f123 x:0 0 0 2023-10-21T17:18:01.458 INFO:tasks.workunit.client.0.smithi012.stdout:0/772: truncate d7/d52/d90/f95 290640 0 2023-10-21T17:18:01.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/773: dread d7/d55/ff [0,4194304] 0 2023-10-21T17:18:01.653 INFO:tasks.workunit.client.0.smithi012.stdout:3/643: creat d0/d32/d43/fbb x:0 0 0 2023-10-21T17:18:02.057 INFO:tasks.workunit.client.0.smithi012.stdout:8/596: mkdir d0/d62/d83/d4e/dc5 0 2023-10-21T17:18:02.455 INFO:tasks.workunit.client.0.smithi012.stdout:3/644: mknod d0/d82/cbc 0 2023-10-21T17:18:02.963 INFO:tasks.workunit.client.0.smithi012.stdout:1/756: rmdir d5/d32/d1b/d35/d3a/d5c/d7c 39 2023-10-21T17:18:03.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/757: dread d5/d32/d1b/d27/d21/f2b [0,4194304] 0 2023-10-21T17:18:03.136 INFO:tasks.workunit.client.0.smithi012.stdout:8/597: mknod d0/d62/d83/cc6 0 2023-10-21T17:18:03.182 INFO:tasks.workunit.client.0.smithi012.stdout:2/754: dwrite d1/d14/d17/fc4 [0,4194304] 0 2023-10-21T17:18:03.234 INFO:tasks.workunit.client.0.smithi012.stdout:0/774: truncate d7/d55/d1f/d28/f51 3531213 0 2023-10-21T17:18:03.234 INFO:tasks.workunit.client.0.smithi012.stdout:0/775: fsync d7/d55/d23/dce/ddc/d114/d63/fae 0 2023-10-21T17:18:03.234 INFO:tasks.workunit.client.0.smithi012.stdout:0/776: chown d7/d55/d23/d27/d31/f32 0 1 2023-10-21T17:18:03.385 INFO:tasks.workunit.client.0.smithi012.stdout:3/645: creat d0/d1c/fbd x:0 0 0 2023-10-21T17:18:03.385 INFO:tasks.workunit.client.0.smithi012.stdout:3/646: stat d0/d82/faf 0 2023-10-21T17:18:03.531 INFO:tasks.workunit.client.0.smithi012.stdout:8/598: dread - d0/d46/f5d zero size 2023-10-21T17:18:03.611 INFO:tasks.workunit.client.0.smithi012.stdout:8/599: dwrite d0/f11 [0,4194304] 0 2023-10-21T17:18:03.611 INFO:tasks.workunit.client.0.smithi012.stdout:8/600: fdatasync d0/d12/d80/f75 0 2023-10-21T17:18:03.647 INFO:tasks.workunit.client.0.smithi012.stdout:8/601: write d0/d29/d79/f81 [856127,31612] 0 2023-10-21T17:18:03.901 INFO:tasks.workunit.client.0.smithi012.stdout:2/755: stat d1/d4/d3f/d41/d59/f69 0 2023-10-21T17:18:04.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/777: creat d7/d55/d23/dce/ddc/d114/d82/d8d/f124 x:0 0 0 2023-10-21T17:18:04.045 INFO:tasks.workunit.client.0.smithi012.stdout:0/778: chown d7/d55/da2/f10a 3 1 2023-10-21T17:18:04.150 INFO:tasks.workunit.client.0.smithi012.stdout:0/779: dwrite d7/d55/da2/f113 [0,4194304] 0 2023-10-21T17:18:04.273 INFO:tasks.workunit.client.0.smithi012.stdout:3/647: dread d0/f15 [0,4194304] 0 2023-10-21T17:18:04.274 INFO:tasks.workunit.client.0.smithi012.stdout:3/648: readlink d0/d32/la7 0 2023-10-21T17:18:04.337 INFO:tasks.workunit.client.0.smithi012.stdout:3/649: dwrite d0/da/f5f [4194304,4194304] 0 2023-10-21T17:18:04.361 INFO:tasks.workunit.client.0.smithi012.stdout:3/650: dread d0/d32/d43/d47/f48 [0,4194304] 0 2023-10-21T17:18:04.436 INFO:tasks.workunit.client.0.smithi012.stdout:1/758: rename d5/d30/da9/db9/dd5 to d5/d32/d1b/d27/d47/de9/d102 0 2023-10-21T17:18:04.831 INFO:tasks.workunit.client.0.smithi012.stdout:8/602: creat d0/d12/d6c/db1/fc7 x:0 0 0 2023-10-21T17:18:04.845 INFO:tasks.workunit.client.0.smithi012.stdout:8/603: dread d0/d1a/d54/f8b [0,4194304] 0 2023-10-21T17:18:05.254 INFO:tasks.workunit.client.0.smithi012.stdout:0/780: symlink d7/d55/d23/d30/l125 0 2023-10-21T17:18:05.254 INFO:tasks.workunit.client.0.smithi012.stdout:0/781: stat d7/d55/d23/d27/dcf 0 2023-10-21T17:18:05.355 INFO:tasks.workunit.client.0.smithi012.stdout:0/782: dwrite d7/d55/d23/dce/ddc/d114/da9/ffb [0,4194304] 0 2023-10-21T17:18:05.438 INFO:tasks.workunit.client.0.smithi012.stdout:0/783: dwrite d7/d55/d23/d27/f5d [0,4194304] 0 2023-10-21T17:18:05.511 INFO:tasks.workunit.client.0.smithi012.stdout:1/759: unlink d5/d32/dce/df9/f89 0 2023-10-21T17:18:05.683 INFO:tasks.workunit.client.0.smithi012.stdout:2/756: unlink d1/d14/d17/f92 0 2023-10-21T17:18:05.768 INFO:tasks.workunit.client.0.smithi012.stdout:8/604: rename d0/d12/d80/l78 to d0/d1a/db0/lc8 0 2023-10-21T17:18:06.538 INFO:tasks.workunit.client.0.smithi012.stdout:5/653: rmdir d2/db5 39 2023-10-21T17:18:06.539 INFO:tasks.workunit.client.0.smithi012.stdout:1/760: mknod d5/d32/dce/de0/c103 0 2023-10-21T17:18:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/710: sync 2023-10-21T17:18:06.540 INFO:tasks.workunit.client.0.smithi012.stdout:4/699: sync 2023-10-21T17:18:06.561 INFO:tasks.workunit.client.0.smithi012.stdout:2/757: creat d1/d4/d65/dea/ffc x:0 0 0 2023-10-21T17:18:06.819 INFO:tasks.workunit.client.0.smithi012.stdout:0/784: symlink d7/d55/d23/dce/ddc/d114/d63/l126 0 2023-10-21T17:18:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:5/654: unlink d2/d4f/d59/f89 0 2023-10-21T17:18:07.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:18:07.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:18:07.264 INFO:tasks.workunit.client.0.smithi012.stdout:1/761: mknod d5/d32/d1b/d35/d3a/d5c/d7c/c104 0 2023-10-21T17:18:07.264 INFO:tasks.workunit.client.0.smithi012.stdout:7/711: mknod d3/d6/d73/cdd 0 2023-10-21T17:18:07.265 INFO:tasks.workunit.client.0.smithi012.stdout:7/712: write d3/d64/fc6 [407982,80926] 0 2023-10-21T17:18:07.296 INFO:tasks.workunit.client.0.smithi012.stdout:4/700: mknod dc/d15/d2a/d31/cef 0 2023-10-21T17:18:07.993 INFO:tasks.workunit.client.0.smithi012.stdout:6/664: dwrite d13/d15/f67 [4194304,4194304] 0 2023-10-21T17:18:08.329 INFO:tasks.workunit.client.0.smithi012.stdout:7/713: link d3/da7/fd1 d3/d6/dc/d19/d1e/d34/da8/db4/fde 0 2023-10-21T17:18:08.329 INFO:tasks.workunit.client.0.smithi012.stdout:7/714: chown d3/d6/c5a 25976 1 2023-10-21T17:18:08.522 INFO:tasks.workunit.client.0.smithi012.stdout:4/701: chown dc/c16 13 1 2023-10-21T17:18:09.287 INFO:tasks.workunit.client.0.smithi012.stdout:5/655: dread d2/d4f/d7e/d87/d57/dc7/dd0/f4b [0,4194304] 0 2023-10-21T17:18:09.288 INFO:tasks.workunit.client.0.smithi012.stdout:5/656: fdatasync d2/d4f/d59/d5b/d15/f8d 0 2023-10-21T17:18:09.386 INFO:tasks.workunit.client.0.smithi012.stdout:7/715: symlink d3/d16/ldf 0 2023-10-21T17:18:09.404 INFO:tasks.workunit.client.0.smithi012.stdout:7/716: dread d3/d16/f67 [0,4194304] 0 2023-10-21T17:18:09.471 INFO:tasks.workunit.client.0.smithi012.stdout:7/717: dwrite d3/f83 [0,4194304] 0 2023-10-21T17:18:09.476 INFO:tasks.workunit.client.0.smithi012.stdout:7/718: read d3/d6/d73/d8e/f9f [392324,50365] 0 2023-10-21T17:18:09.520 INFO:tasks.workunit.client.0.smithi012.stdout:4/702: link dc/d1e/f44 dc/d15/d2a/d58/ff0 0 2023-10-21T17:18:09.520 INFO:tasks.workunit.client.0.smithi012.stdout:4/703: readlink dc/d15/l1b 0 2023-10-21T17:18:09.668 INFO:tasks.workunit.client.0.smithi012.stdout:0/785: dread d7/d52/fc1 [0,4194304] 0 2023-10-21T17:18:09.789 INFO:tasks.workunit.client.0.smithi012.stdout:5/657: symlink d2/d4f/ld6 0 2023-10-21T17:18:10.091 INFO:tasks.workunit.client.0.smithi012.stdout:7/719: getdents d3/d6/dc/d19/d1e 0 2023-10-21T17:18:10.091 INFO:tasks.workunit.client.0.smithi012.stdout:7/720: fsync d3/d29/f11 0 2023-10-21T17:18:10.173 INFO:tasks.workunit.client.0.smithi012.stdout:4/704: dread dc/f67 [0,4194304] 0 2023-10-21T17:18:10.173 INFO:tasks.workunit.client.0.smithi012.stdout:4/705: chown dc/d1e/d2b 387 1 2023-10-21T17:18:10.317 INFO:tasks.workunit.client.0.smithi012.stdout:0/786: symlink d7/d55/d1f/l127 0 2023-10-21T17:18:10.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/658: unlink d2/d4f/d7e/d87/d57/dc7/dd0/f4b 0 2023-10-21T17:18:10.481 INFO:tasks.workunit.client.0.smithi012.stdout:5/659: creat d2/d2c/d73/d49/da9/fd7 x:0 0 0 2023-10-21T17:18:10.515 INFO:tasks.workunit.client.0.smithi012.stdout:5/660: read d2/d4f/fa4 [1508861,101092] 0 2023-10-21T17:18:10.515 INFO:tasks.workunit.client.0.smithi012.stdout:5/661: write d2/d1d/d20/f2b [5623505,7080] 0 2023-10-21T17:18:10.635 INFO:tasks.workunit.client.0.smithi012.stdout:7/721: mkdir d3/da7/de0 0 2023-10-21T17:18:10.726 INFO:tasks.workunit.client.0.smithi012.stdout:4/706: mkdir dc/d1e/d33/d8a/ddb/df1 0 2023-10-21T17:18:10.756 INFO:tasks.workunit.client.0.smithi012.stdout:4/707: write dc/d15/f5e [425987,82902] 0 2023-10-21T17:18:10.843 INFO:tasks.workunit.client.0.smithi012.stdout:4/708: dwrite dc/d15/d18/d4c/d55/d6c/d77/f8f [0,4194304] 0 2023-10-21T17:18:10.844 INFO:tasks.workunit.client.0.smithi012.stdout:4/709: creat dc/d93/d99/ff2 x:0 0 0 2023-10-21T17:18:10.870 INFO:tasks.workunit.client.0.smithi012.stdout:4/710: dread dc/d93/f46 [0,4194304] 0 2023-10-21T17:18:10.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/711: write dc/d15/d18/fc6 [4191258,33665] 0 2023-10-21T17:18:10.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/712: write dc/d15/d18/d4c/d75/fd0 [191196,39198] 0 2023-10-21T17:18:11.055 INFO:tasks.workunit.client.0.smithi012.stdout:0/787: creat d7/d55/d23/d27/dc6/f128 x:0 0 0 2023-10-21T17:18:11.231 INFO:tasks.workunit.client.0.smithi012.stdout:5/662: truncate d2/d1d/fa8 3866047 0 2023-10-21T17:18:11.320 INFO:tasks.workunit.client.0.smithi012.stdout:5/663: dwrite d2/d2c/d73/d49/fac [0,4194304] 0 2023-10-21T17:18:11.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/722: symlink d3/d6/dc/d19/d1e/d34/da8/db4/le1 0 2023-10-21T17:18:11.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/723: truncate d3/d29/f52 429703 0 2023-10-21T17:18:11.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/724: chown d3/d29/f7c 183 1 2023-10-21T17:18:11.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/725: write d3/d64/fa2 [7648,75386] 0 2023-10-21T17:18:11.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/726: chown d3/d6/dc/d19/d1e/d7b/f99 117 1 2023-10-21T17:18:11.700 INFO:tasks.workunit.client.0.smithi012.stdout:3/651: creat d0/fbe x:0 0 0 2023-10-21T17:18:11.700 INFO:tasks.workunit.client.0.smithi012.stdout:3/652: dread - d0/d96/d97/fb7 zero size 2023-10-21T17:18:11.905 INFO:tasks.workunit.client.0.smithi012.stdout:4/713: mkdir dc/d15/d2a/d31/df3 0 2023-10-21T17:18:11.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/714: dwrite dc/d15/d2a/d31/f49 [4194304,4194304] 0 2023-10-21T17:18:11.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/715: fsync dc/d15/d2a/f78 0 2023-10-21T17:18:12.180 INFO:tasks.workunit.client.0.smithi012.stdout:0/788: mkdir d7/d55/d23/d30/d8c/d129 0 2023-10-21T17:18:12.656 INFO:tasks.workunit.client.0.smithi012.stdout:7/727: creat d3/d6/dc/d19/d1e/d34/da8/db4/dce/fe2 x:0 0 0 2023-10-21T17:18:12.692 INFO:tasks.workunit.client.0.smithi012.stdout:5/664: read d2/d1d/d20/f48 [2696863,87820] 0 2023-10-21T17:18:12.693 INFO:tasks.workunit.client.0.smithi012.stdout:5/665: truncate d2/d4f/d7e/d87/d57/dc7/dd0/fc8 804603 0 2023-10-21T17:18:12.721 INFO:tasks.workunit.client.0.smithi012.stdout:7/728: dwrite d3/d6/dc/d19/d1e/d34/da8/db4/fde [0,4194304] 0 2023-10-21T17:18:12.759 INFO:tasks.workunit.client.0.smithi012.stdout:7/729: dwrite d3/d6/f66 [0,4194304] 0 2023-10-21T17:18:12.778 INFO:tasks.workunit.client.0.smithi012.stdout:7/730: write d3/d16/f32 [2937382,21916] 0 2023-10-21T17:18:12.778 INFO:tasks.workunit.client.0.smithi012.stdout:7/731: creat d3/d6/dc/d19/d1e/dc9/da0/fe3 x:0 0 0 2023-10-21T17:18:13.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/605: write d0/d29/f7a [1125579,125769] 0 2023-10-21T17:18:14.077 INFO:tasks.workunit.client.0.smithi012.stdout:7/732: creat d3/da7/daf/dcd/fe4 x:0 0 0 2023-10-21T17:18:14.078 INFO:tasks.workunit.client.0.smithi012.stdout:7/733: creat d3/d16/fe5 x:0 0 0 2023-10-21T17:18:14.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/633: rmdir d0/df/d8d/dcb/d25 39 2023-10-21T17:18:15.380 INFO:tasks.workunit.client.0.smithi012.stdout:7/734: mknod d3/d29/d7f/ce6 0 2023-10-21T17:18:15.437 INFO:tasks.workunit.client.0.smithi012.stdout:9/634: creat d0/d5/fd6 x:0 0 0 2023-10-21T17:18:15.437 INFO:tasks.workunit.client.0.smithi012.stdout:9/635: fdatasync d0/d4/d4b/fba 0 2023-10-21T17:18:15.437 INFO:tasks.workunit.client.0.smithi012.stdout:9/636: write d0/df/d8d/fc3 [396964,19532] 0 2023-10-21T17:18:15.853 INFO:tasks.workunit.client.0.smithi012.stdout:7/735: symlink d3/d6/dc/d19/d1e/d34/da8/le7 0 2023-10-21T17:18:15.878 INFO:tasks.workunit.client.0.smithi012.stdout:7/736: dread d3/d16/f32 [0,4194304] 0 2023-10-21T17:18:15.897 INFO:tasks.workunit.client.0.smithi012.stdout:7/737: dread d3/d29/f27 [0,4194304] 0 2023-10-21T17:18:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:7/738: dread d3/d16/f31 [0,4194304] 0 2023-10-21T17:18:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:7/739: fsync d3/d16/f67 0 2023-10-21T17:18:15.926 INFO:tasks.workunit.client.0.smithi012.stdout:7/740: chown d3/d6/dc/d19/d1e/dc9/da0/fe3 86826150 1 2023-10-21T17:18:16.320 INFO:tasks.workunit.client.0.smithi012.stdout:6/665: write d13/d29/d37/d3b/daa/fc2 [1969748,88178] 0 2023-10-21T17:18:16.730 INFO:tasks.workunit.client.0.smithi012.stdout:7/741: mknod d3/da7/ce8 0 2023-10-21T17:18:16.730 INFO:tasks.workunit.client.0.smithi012.stdout:7/742: chown d3/d6/dc/d19/d1e/d34/da8/le7 626 1 2023-10-21T17:18:16.907 INFO:tasks.workunit.client.0.smithi012.stdout:1/762: sync 2023-10-21T17:18:16.907 INFO:tasks.workunit.client.0.smithi012.stdout:2/758: sync 2023-10-21T17:18:17.268 INFO:tasks.workunit.client.0.smithi012.stdout:7/743: creat d3/da7/de0/fe9 x:0 0 0 2023-10-21T17:18:17.336 INFO:tasks.workunit.client.0.smithi012.stdout:7/744: dwrite d3/d6/dc/d19/d1e/dc9/f6d [0,4194304] 0 2023-10-21T17:18:17.337 INFO:tasks.workunit.client.0.smithi012.stdout:7/745: dread - d3/d6/dc/d19/d1e/d34/da8/db4/dce/fe2 zero size 2023-10-21T17:18:17.373 INFO:tasks.workunit.client.0.smithi012.stdout:4/716: dwrite dc/d15/f47 [0,4194304] 0 2023-10-21T17:18:17.943 INFO:tasks.workunit.client.0.smithi012.stdout:6/666: creat d13/d15/d1d/d5d/d66/d70/fe0 x:0 0 0 2023-10-21T17:18:18.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/746: creat d3/d6/dc/d19/d1e/dc9/fea x:0 0 0 2023-10-21T17:18:18.893 INFO:tasks.workunit.client.0.smithi012.stdout:4/717: dread dc/d15/d18/d4c/d55/d6c/fa1 [0,4194304] 0 2023-10-21T17:18:18.901 INFO:tasks.workunit.client.0.smithi012.stdout:5/666: dwrite d2/d2c/d73/d49/da9/fcb [0,4194304] 0 2023-10-21T17:18:18.901 INFO:tasks.workunit.client.0.smithi012.stdout:5/667: chown d2/d4f/d59/c84 1664598033 1 2023-10-21T17:18:19.715 INFO:tasks.workunit.client.0.smithi012.stdout:0/789: write d7/d52/dd3/fdb [46797,92655] 0 2023-10-21T17:18:19.723 INFO:tasks.workunit.client.0.smithi012.stdout:3/653: rename d0/d32/c74 to d0/cbf 0 2023-10-21T17:18:19.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/637: write d0/df/d8d/f38 [4181453,80499] 0 2023-10-21T17:18:19.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/638: write d0/d5/f7e [834248,19432] 0 2023-10-21T17:18:19.724 INFO:tasks.workunit.client.0.smithi012.stdout:9/639: fsync d0/df/d8d/dcb/d25/d39/f5b 0 2023-10-21T17:18:19.788 INFO:tasks.workunit.client.0.smithi012.stdout:0/790: dwrite d7/d55/d23/dce/ddc/d114/df9/f11b [0,4194304] 0 2023-10-21T17:18:20.237 INFO:tasks.workunit.client.0.smithi012.stdout:5/668: dread d2/d4f/d7e/d87/d57/f5f [0,4194304] 0 2023-10-21T17:18:20.237 INFO:tasks.workunit.client.0.smithi012.stdout:5/669: creat d2/d4f/d59/d5b/d15/fd8 x:0 0 0 2023-10-21T17:18:20.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/606: rename d0/d62/d7d/caf to d0/d29/d79/cc9 0 2023-10-21T17:18:20.812 INFO:tasks.workunit.client.0.smithi012.stdout:3/654: rmdir d0/da/d28 39 2023-10-21T17:18:20.880 INFO:tasks.workunit.client.0.smithi012.stdout:1/763: dwrite d5/d32/d1b/d35/d3a/d93/fc0 [0,4194304] 0 2023-10-21T17:18:20.880 INFO:tasks.workunit.client.0.smithi012.stdout:1/764: chown d5/d32/dce/df9/d46/d4f 9905 1 2023-10-21T17:18:21.171 INFO:tasks.workunit.client.0.smithi012.stdout:0/791: truncate d7/d55/d23/d27/d31/f91 59706 0 2023-10-21T17:18:21.255 INFO:tasks.workunit.client.0.smithi012.stdout:2/759: dwrite d1/d4/d93/fb4 [0,4194304] 0 2023-10-21T17:18:21.543 INFO:tasks.workunit.client.0.smithi012.stdout:8/607: getdents d0/d12/d40 0 2023-10-21T17:18:21.588 INFO:tasks.workunit.client.0.smithi012.stdout:9/640: getdents d0/d5/d9d 0 2023-10-21T17:18:21.623 INFO:tasks.workunit.client.0.smithi012.stdout:9/641: dread d0/f3e [0,4194304] 0 2023-10-21T17:18:21.623 INFO:tasks.workunit.client.0.smithi012.stdout:9/642: truncate d0/d4/d4b/d6a/d89/dbb/fca 420991 0 2023-10-21T17:18:21.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/608: dwrite d0/d1a/d54/f5f [0,4194304] 0 2023-10-21T17:18:21.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/609: write d0/d29/f59 [5629785,96501] 0 2023-10-21T17:18:21.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/610: write d0/d29/fc3 [636775,84307] 0 2023-10-21T17:18:22.113 INFO:tasks.workunit.client.0.smithi012.stdout:1/765: mkdir d5/d30/d51/d105 0 2023-10-21T17:18:22.356 INFO:tasks.workunit.client.0.smithi012.stdout:0/792: creat d7/d55/d23/dce/ddc/d114/d48/d88/f12a x:0 0 0 2023-10-21T17:18:22.357 INFO:tasks.workunit.client.0.smithi012.stdout:0/793: truncate d7/d55/d23/dce/ddc/d114/d48/fa5 4648228 0 2023-10-21T17:18:22.357 INFO:tasks.workunit.client.0.smithi012.stdout:0/794: fdatasync d7/d55/d23/d27/d31/d5f/dde/f121 0 2023-10-21T17:18:22.790 INFO:tasks.workunit.client.0.smithi012.stdout:6/667: write d13/d29/d37/d3b/f57 [801911,29551] 0 2023-10-21T17:18:23.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/611: mkdir d0/d1a/db0/dca 0 2023-10-21T17:18:23.919 INFO:tasks.workunit.client.0.smithi012.stdout:0/795: symlink d7/d55/d23/l12b 0 2023-10-21T17:18:24.052 INFO:tasks.workunit.client.0.smithi012.stdout:6/668: unlink d13/d35/l55 0 2023-10-21T17:18:24.207 INFO:tasks.workunit.client.0.smithi012.stdout:4/718: creat dc/d15/ff4 x:0 0 0 2023-10-21T17:18:24.327 INFO:tasks.workunit.client.0.smithi012.stdout:8/612: link d0/d12/f94 d0/d12/d80/d71/fcb 0 2023-10-21T17:18:24.327 INFO:tasks.workunit.client.0.smithi012.stdout:8/613: readlink d0/d12/l18 0 2023-10-21T17:18:24.513 INFO:tasks.workunit.client.0.smithi012.stdout:1/766: symlink d5/d32/d1b/d35/d3a/l106 0 2023-10-21T17:18:24.513 INFO:tasks.workunit.client.0.smithi012.stdout:1/767: chown d5/d32/d62/f82 2035175898 1 2023-10-21T17:18:24.624 INFO:tasks.workunit.client.0.smithi012.stdout:0/796: symlink d7/d55/d23/d30/d8c/l12c 0 2023-10-21T17:18:24.625 INFO:tasks.workunit.client.0.smithi012.stdout:0/797: readlink d7/d55/d23/l47 0 2023-10-21T17:18:24.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/669: fdatasync d13/d35/d4c/f93 0 2023-10-21T17:18:25.117 INFO:tasks.workunit.client.0.smithi012.stdout:8/614: mknod d0/d1a/db0/dca/ccc 0 2023-10-21T17:18:25.118 INFO:tasks.workunit.client.0.smithi012.stdout:8/615: chown d0/d29/fc3 90382 1 2023-10-21T17:18:25.350 INFO:tasks.workunit.client.0.smithi012.stdout:1/768: rmdir d5/d26/da3 39 2023-10-21T17:18:25.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/670: mknod d13/d29/d37/d3b/ce1 0 2023-10-21T17:18:25.571 INFO:tasks.workunit.client.0.smithi012.stdout:6/671: dread f1 [0,4194304] 0 2023-10-21T17:18:25.736 INFO:tasks.workunit.client.0.smithi012.stdout:4/719: dread dc/d15/d2a/d31/fb6 [0,4194304] 0 2023-10-21T17:18:25.736 INFO:tasks.workunit.client.0.smithi012.stdout:4/720: read dc/d1e/d33/f43 [2916874,22191] 0 2023-10-21T17:18:26.162 INFO:tasks.workunit.client.0.smithi012.stdout:6/672: mkdir d13/d29/d37/d3b/de2 0 2023-10-21T17:18:26.163 INFO:tasks.workunit.client.0.smithi012.stdout:6/673: fdatasync d13/d42/fcc 0 2023-10-21T17:18:26.163 INFO:tasks.workunit.client.0.smithi012.stdout:6/674: write d13/d15/d1d/d5d/d92/fd9 [463083,82233] 0 2023-10-21T17:18:26.736 INFO:tasks.workunit.client.0.smithi012.stdout:7/747: rmdir d3/da7 39 2023-10-21T17:18:26.822 INFO:tasks.workunit.client.0.smithi012.stdout:3/655: dwrite d0/da/d28/f77 [0,4194304] 0 2023-10-21T17:18:27.218 INFO:tasks.workunit.client.0.smithi012.stdout:7/748: getdents d3/d6/dc/d19/d1e/dc9 0 2023-10-21T17:18:27.425 INFO:tasks.workunit.client.0.smithi012.stdout:7/749: creat d3/d6/dc/d19/d1e/dc9/feb x:0 0 0 2023-10-21T17:18:27.767 INFO:tasks.workunit.client.0.smithi012.stdout:8/616: dwrite d0/d62/f8d [4194304,4194304] 0 2023-10-21T17:18:27.840 INFO:tasks.workunit.client.0.smithi012.stdout:5/670: rename d2/l5a to d2/d4f/d7e/d87/dce/ld9 0 2023-10-21T17:18:27.840 INFO:tasks.workunit.client.0.smithi012.stdout:1/769: write d5/d32/d1b/d35/d3a/d93/fed [1049177,130069] 0 2023-10-21T17:18:27.841 INFO:tasks.workunit.client.0.smithi012.stdout:1/770: write d5/d26/da3/fb6 [1441672,118679] 0 2023-10-21T17:18:27.856 INFO:tasks.workunit.client.0.smithi012.stdout:3/656: write d0/f62 [1190187,24201] 0 2023-10-21T17:18:27.856 INFO:tasks.workunit.client.0.smithi012.stdout:3/657: chown d0/d32/d43/c81 122868 1 2023-10-21T17:18:27.857 INFO:tasks.workunit.client.0.smithi012.stdout:3/658: chown d0/f62 14630 1 2023-10-21T17:18:27.866 INFO:tasks.workunit.client.0.smithi012.stdout:3/659: read d0/da/f86 [369867,410] 0 2023-10-21T17:18:27.925 INFO:tasks.workunit.client.0.smithi012.stdout:1/771: dwrite d5/d32/d1b/d2c/d4b/d8a/fa4 [0,4194304] 0 2023-10-21T17:18:28.163 INFO:tasks.workunit.client.0.smithi012.stdout:7/750: stat d3/d6/dc/d19/d1e/dc9/cac 0 2023-10-21T17:18:28.164 INFO:tasks.workunit.client.0.smithi012.stdout:7/751: stat d3/d29/d7f/ce6 0 2023-10-21T17:18:28.164 INFO:tasks.workunit.client.0.smithi012.stdout:7/752: read - d3/d6/dc/d19/d1e/d34/fd5 zero size 2023-10-21T17:18:28.164 INFO:tasks.workunit.client.0.smithi012.stdout:0/798: sync 2023-10-21T17:18:28.165 INFO:tasks.workunit.client.0.smithi012.stdout:2/760: sync 2023-10-21T17:18:28.165 INFO:tasks.workunit.client.0.smithi012.stdout:2/761: dread - d1/d4/d65/dea/ffc zero size 2023-10-21T17:18:28.165 INFO:tasks.workunit.client.0.smithi012.stdout:2/762: read - d1/d95/faf zero size 2023-10-21T17:18:28.205 INFO:tasks.workunit.client.0.smithi012.stdout:2/763: dread d1/d4/d93/fb4 [0,4194304] 0 2023-10-21T17:18:28.206 INFO:tasks.workunit.client.0.smithi012.stdout:2/764: read - d1/d8/f2d zero size 2023-10-21T17:18:28.261 INFO:tasks.workunit.client.0.smithi012.stdout:2/765: dwrite d1/d4/d93/fc8 [0,4194304] 0 2023-10-21T17:18:28.263 INFO:tasks.workunit.client.0.smithi012.stdout:8/617: getdents d0/d62/d83/d4e 0 2023-10-21T17:18:28.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/618: dread d0/d1a/f3d [0,4194304] 0 2023-10-21T17:18:28.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/766: dwrite d1/d14/d16/d58/dec/da5/dbe/ddc/ff5 [0,4194304] 0 2023-10-21T17:18:28.365 INFO:tasks.workunit.client.0.smithi012.stdout:9/643: rename d0/d5/l28 to d0/ld7 0 2023-10-21T17:18:28.968 INFO:tasks.workunit.client.0.smithi012.stdout:5/671: mkdir d2/d4f/d7e/d87/dda 0 2023-10-21T17:18:29.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/660: rmdir d0/d32 39 2023-10-21T17:18:29.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/661: dread - d0/d82/f9f zero size 2023-10-21T17:18:29.872 INFO:tasks.workunit.client.0.smithi012.stdout:8/619: getdents d0/d1a/db0 0 2023-10-21T17:18:29.872 INFO:tasks.workunit.client.0.smithi012.stdout:8/620: readlink d0/d1a/l7e 0 2023-10-21T17:18:29.944 INFO:tasks.workunit.client.0.smithi012.stdout:8/621: dwrite d0/d29/d79/fb6 [0,4194304] 0 2023-10-21T17:18:30.350 INFO:tasks.workunit.client.0.smithi012.stdout:2/767: read d1/d14/d17/f73 [41580,65068] 0 2023-10-21T17:18:30.486 INFO:tasks.workunit.client.0.smithi012.stdout:4/721: rename dc/d15/d2a/d31/f7e to dc/d93/ff5 0 2023-10-21T17:18:30.486 INFO:tasks.workunit.client.0.smithi012.stdout:4/722: fsync dc/d6b/fb5 0 2023-10-21T17:18:30.679 INFO:tasks.workunit.client.0.smithi012.stdout:9/644: dread d0/df/d8d/dcb/d2a/f87 [0,4194304] 0 2023-10-21T17:18:31.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/672: unlink d2/d4f/d59/d5b/c3c 0 2023-10-21T17:18:31.273 INFO:tasks.workunit.client.0.smithi012.stdout:5/673: dread d2/d1d/d20/f48 [0,4194304] 0 2023-10-21T17:18:31.384 INFO:tasks.workunit.client.0.smithi012.stdout:3/662: unlink d0/d32/d43/d47/f91 0 2023-10-21T17:18:31.667 INFO:tasks.workunit.client.0.smithi012.stdout:8/622: mknod d0/d1a/ccd 0 2023-10-21T17:18:31.788 INFO:tasks.workunit.client.0.smithi012.stdout:8/623: dwrite d0/d1a/f3d [0,4194304] 0 2023-10-21T17:18:31.829 INFO:tasks.workunit.client.0.smithi012.stdout:2/768: getdents d1 0 2023-10-21T17:18:31.923 INFO:tasks.workunit.client.0.smithi012.stdout:0/799: mknod d7/d55/c12d 0 2023-10-21T17:18:31.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/800: dwrite d7/d55/d23/d27/d31/d5f/ff0 [0,4194304] 0 2023-10-21T17:18:32.283 INFO:tasks.workunit.client.0.smithi012.stdout:4/723: symlink dc/d1e/d33/d8a/lf6 0 2023-10-21T17:18:32.325 INFO:tasks.workunit.client.0.smithi012.stdout:9/645: dread d0/d4/d4b/d6a/fae [0,4194304] 0 2023-10-21T17:18:32.512 INFO:tasks.workunit.client.0.smithi012.stdout:5/674: symlink d2/d2c/ldb 0 2023-10-21T17:18:32.576 INFO:tasks.workunit.client.0.smithi012.stdout:3/663: symlink d0/d32/d43/lc0 0 2023-10-21T17:18:33.214 INFO:tasks.workunit.client.0.smithi012.stdout:8/624: mknod d0/d62/d83/cce 0 2023-10-21T17:18:33.215 INFO:tasks.workunit.client.0.smithi012.stdout:8/625: write d0/d12/f94 [702069,36807] 0 2023-10-21T17:18:33.239 INFO:tasks.workunit.client.0.smithi012.stdout:2/769: readlink d1/d14/d17/d8a/dda/l99 0 2023-10-21T17:18:33.994 INFO:tasks.workunit.client.0.smithi012.stdout:6/675: rename d13/d15/d1d/d28/f32 to d13/d42/d89/db8/d9f/fe3 0 2023-10-21T17:18:34.120 INFO:tasks.workunit.client.0.smithi012.stdout:4/724: write dc/d15/d18/d4c/d55/d6c/d83/fbd [1701143,69169] 0 2023-10-21T17:18:34.120 INFO:tasks.workunit.client.0.smithi012.stdout:4/725: stat dc/d93/d99/fb0 0 2023-10-21T17:18:34.351 INFO:tasks.workunit.client.0.smithi012.stdout:9/646: symlink d0/d5/d9c/dc7/ld8 0 2023-10-21T17:18:34.413 INFO:tasks.workunit.client.0.smithi012.stdout:5/675: chown d2/d4f/d7e/d87/d57/f9b 77573275 1 2023-10-21T17:18:34.413 INFO:tasks.workunit.client.0.smithi012.stdout:3/664: creat d0/d82/fc1 x:0 0 0 2023-10-21T17:18:34.414 INFO:tasks.workunit.client.0.smithi012.stdout:5/676: readlink d2/d1d/ld4 0 2023-10-21T17:18:34.414 INFO:tasks.workunit.client.0.smithi012.stdout:5/677: chown d2/d2c 13643523 1 2023-10-21T17:18:35.019 INFO:tasks.workunit.client.0.smithi012.stdout:2/770: dwrite d1/d14/d17/da6/fed [0,4194304] 0 2023-10-21T17:18:35.035 INFO:tasks.workunit.client.0.smithi012.stdout:2/771: dread d1/d14/d16/f75 [0,4194304] 0 2023-10-21T17:18:35.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/772: dwrite d1/d8/f2d [0,4194304] 0 2023-10-21T17:18:35.203 INFO:tasks.workunit.client.0.smithi012.stdout:2/773: dwrite d1/d14/d16/d58/dec/d82/ff0 [0,4194304] 0 2023-10-21T17:18:35.594 INFO:tasks.workunit.client.0.smithi012.stdout:6/676: creat d13/d15/d1d/d5d/d66/d7a/d97/fe4 x:0 0 0 2023-10-21T17:18:35.935 INFO:tasks.workunit.client.0.smithi012.stdout:4/726: symlink dc/d1e/dc7/dcc/lf7 0 2023-10-21T17:18:35.935 INFO:tasks.workunit.client.0.smithi012.stdout:4/727: chown dc/d15/d18/fe9 251163 1 2023-10-21T17:18:35.968 INFO:tasks.workunit.client.0.smithi012.stdout:4/728: write dc/d15/d18/d4c/f81 [3209093,11737] 0 2023-10-21T17:18:35.968 INFO:tasks.workunit.client.0.smithi012.stdout:4/729: fsync dc/d1e/d33/fd9 0 2023-10-21T17:18:35.968 INFO:tasks.workunit.client.0.smithi012.stdout:4/730: chown l9 207861907 1 2023-10-21T17:18:36.063 INFO:tasks.workunit.client.0.smithi012.stdout:9/647: symlink d0/df/d8d/dcb/d25/d39/d3b/ld9 0 2023-10-21T17:18:36.166 INFO:tasks.workunit.client.0.smithi012.stdout:3/665: getdents d0/d1c/d5e 0 2023-10-21T17:18:36.204 INFO:tasks.workunit.client.0.smithi012.stdout:3/666: dread d0/d1c/f5a [0,4194304] 0 2023-10-21T17:18:36.888 INFO:tasks.workunit.client.0.smithi012.stdout:0/801: rmdir d7/d55/d1f/d28 39 2023-10-21T17:18:37.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/774: symlink d1/d14/d17/d8a/lfd 0 2023-10-21T17:18:37.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/775: chown d1/d14/d17/db9/ce1 51255678 1 2023-10-21T17:18:37.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:18:37.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:18:37.521 INFO:tasks.workunit.client.0.smithi012.stdout:6/677: symlink d13/d29/d37/d3b/daa/le5 0 2023-10-21T17:18:37.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/678: dwrite d13/f4b [0,4194304] 0 2023-10-21T17:18:37.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/679: fdatasync d13/d42/f8c 0 2023-10-21T17:18:37.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/680: fdatasync d13/f54 0 2023-10-21T17:18:37.615 INFO:tasks.workunit.client.0.smithi012.stdout:6/681: readlink d13/d42/d89/db8/d9f/ldb 0 2023-10-21T17:18:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/731: getdents dc/d15/d18/d4c/d55 0 2023-10-21T17:18:37.663 INFO:tasks.workunit.client.0.smithi012.stdout:6/682: dwrite d13/d15/d1d/d5d/d66/d70/fe0 [0,4194304] 0 2023-10-21T17:18:37.690 INFO:tasks.workunit.client.0.smithi012.stdout:9/648: dread d0/d4/d4b/d6a/d89/dbb/fca [0,4194304] 0 2023-10-21T17:18:37.734 INFO:tasks.workunit.client.0.smithi012.stdout:4/732: dwrite dc/d15/d18/d4c/d55/f9c [4194304,4194304] 0 2023-10-21T17:18:37.734 INFO:tasks.workunit.client.0.smithi012.stdout:4/733: fsync dc/d93/d99/fb0 0 2023-10-21T17:18:37.789 INFO:tasks.workunit.client.0.smithi012.stdout:3/667: creat d0/d32/d43/d47/d50/d52/fc2 x:0 0 0 2023-10-21T17:18:38.000 INFO:tasks.workunit.client.0.smithi012.stdout:8/626: dwrite d0/f4f [0,4194304] 0 2023-10-21T17:18:38.017 INFO:tasks.workunit.client.0.smithi012.stdout:5/678: rmdir d2/d4f/d59 39 2023-10-21T17:18:38.017 INFO:tasks.workunit.client.0.smithi012.stdout:5/679: chown d2/d4f/d7e/d87/d57/dc7/dd0/f7 3 1 2023-10-21T17:18:38.017 INFO:tasks.workunit.client.0.smithi012.stdout:5/680: fsync d2/d2c/d73/d49/da9/fcc 0 2023-10-21T17:18:38.018 INFO:tasks.workunit.client.0.smithi012.stdout:5/681: chown d2/d2c/d73/d49/cb8 516181988 1 2023-10-21T17:18:38.018 INFO:tasks.workunit.client.0.smithi012.stdout:5/682: stat d2/d2c/d73 0 2023-10-21T17:18:38.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/627: dread d0/d1a/d54/f5f [0,4194304] 0 2023-10-21T17:18:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/776: creat d1/d4/d3f/d41/ffe x:0 0 0 2023-10-21T17:18:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/777: dread - d1/d4/d3f/d41/fdd zero size 2023-10-21T17:18:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/778: readlink d1/d14/d16/l8d 0 2023-10-21T17:18:39.672 INFO:tasks.workunit.client.0.smithi012.stdout:6/683: link d13/cdc d13/d35/ce6 0 2023-10-21T17:18:40.760 INFO:tasks.workunit.client.0.smithi012.stdout:8/628: mkdir d0/d62/d7d/dcf 0 2023-10-21T17:18:41.140 INFO:tasks.workunit.client.0.smithi012.stdout:2/779: symlink d1/d14/d17/d8a/dda/lff 0 2023-10-21T17:18:41.397 INFO:tasks.workunit.client.0.smithi012.stdout:7/753: rename d3/d6/dc/d19/d1e/dc9/da0 to d3/d6/dc/d19/d1e/d9d/dec 0 2023-10-21T17:18:41.613 INFO:tasks.workunit.client.0.smithi012.stdout:6/684: fsync d13/d15/d1d/d28/fad 0 2023-10-21T17:18:41.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/668: symlink d0/lc3 0 2023-10-21T17:18:41.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/669: chown d0/da/d28/f40 137785 1 2023-10-21T17:18:41.814 INFO:tasks.workunit.client.0.smithi012.stdout:3/670: dread - d0/d32/d43/f61 zero size 2023-10-21T17:18:42.285 INFO:tasks.workunit.client.0.smithi012.stdout:1/772: rename d5/d32/dce/df9/d46/f60 to d5/d32/d1b/d35/d3a/d5c/d7c/db7/f107 0 2023-10-21T17:18:42.742 INFO:tasks.workunit.client.0.smithi012.stdout:6/685: mkdir d13/d29/d37/d3b/daa/dac/de7 0 2023-10-21T17:18:42.789 INFO:tasks.workunit.client.0.smithi012.stdout:3/671: link d0/da/d28/f9e d0/d96/d97/d9b/fc4 0 2023-10-21T17:18:42.810 INFO:tasks.workunit.client.0.smithi012.stdout:5/683: truncate d2/d4f/d7e/d87/d57/d66/f7f 807050 0 2023-10-21T17:18:43.142 INFO:tasks.workunit.client.0.smithi012.stdout:9/649: rename d0/d5/f22 to d0/df/d8d/dcb/d25/dc9/fda 0 2023-10-21T17:18:43.168 INFO:tasks.workunit.client.0.smithi012.stdout:1/773: truncate d5/f10 2727607 0 2023-10-21T17:18:43.168 INFO:tasks.workunit.client.0.smithi012.stdout:1/774: chown d5/d30/f67 15345 1 2023-10-21T17:18:43.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/686: creat d13/d29/d37/d3b/daa/fe8 x:0 0 0 2023-10-21T17:18:43.294 INFO:tasks.workunit.client.0.smithi012.stdout:6/687: dread f6 [0,4194304] 0 2023-10-21T17:18:44.015 INFO:tasks.workunit.client.0.smithi012.stdout:8/629: rename d0/d1a/l7e to d0/d12/ld0 0 2023-10-21T17:18:44.016 INFO:tasks.workunit.client.0.smithi012.stdout:0/802: write d7/d55/f8b [1868267,123219] 0 2023-10-21T17:18:44.410 INFO:tasks.workunit.client.0.smithi012.stdout:9/650: mkdir d0/da7/ddb 0 2023-10-21T17:18:44.580 INFO:tasks.workunit.client.0.smithi012.stdout:6/688: mknod d13/d42/d89/db8/d9f/ce9 0 2023-10-21T17:18:44.581 INFO:tasks.workunit.client.0.smithi012.stdout:6/689: write d13/d15/d1d/d28/d5b/d75/fc0 [1019797,128677] 0 2023-10-21T17:18:44.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/734: sync 2023-10-21T17:18:44.963 INFO:tasks.workunit.client.0.smithi012.stdout:4/735: dwrite dc/d1e/f4b [0,4194304] 0 2023-10-21T17:18:45.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/630: creat d0/d62/fd1 x:0 0 0 2023-10-21T17:18:45.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/631: readlink d0/d1a/d54/l63 0 2023-10-21T17:18:45.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/632: chown d0/d62/f6b 446679 1 2023-10-21T17:18:45.344 INFO:tasks.workunit.client.0.smithi012.stdout:8/633: truncate d0/d62/d83/fb5 1020345 0 2023-10-21T17:18:45.415 INFO:tasks.workunit.client.0.smithi012.stdout:8/634: dwrite d0/d29/d79/fa8 [0,4194304] 0 2023-10-21T17:18:45.415 INFO:tasks.workunit.client.0.smithi012.stdout:8/635: creat d0/d12/d6c/db1/fd2 x:0 0 0 2023-10-21T17:18:45.478 INFO:tasks.workunit.client.0.smithi012.stdout:0/803: symlink d7/d55/d23/d27/dc6/d112/l12e 0 2023-10-21T17:18:45.641 INFO:tasks.workunit.client.0.smithi012.stdout:2/780: write d1/d14/d16/d58/f4b [729418,24909] 0 2023-10-21T17:18:45.703 INFO:tasks.workunit.client.0.smithi012.stdout:6/690: chown d13/d15/f26 549 1 2023-10-21T17:18:45.860 INFO:tasks.workunit.client.0.smithi012.stdout:1/775: rename d5/d32/dce/df9/d46 to d5/d32/d1b/d27/dfb/d108 0 2023-10-21T17:18:45.964 INFO:tasks.workunit.client.0.smithi012.stdout:1/776: dwrite d5/d32/d1b/d2c/d48/ff2 [0,4194304] 0 2023-10-21T17:18:46.114 INFO:tasks.workunit.client.0.smithi012.stdout:7/754: write d3/d6/dc/d19/d1e/d9d/fb0 [809219,24551] 0 2023-10-21T17:18:46.186 INFO:tasks.workunit.client.0.smithi012.stdout:4/736: mkdir dc/d15/d2a/d58/df8 0 2023-10-21T17:18:46.640 INFO:tasks.workunit.client.0.smithi012.stdout:0/804: unlink l4 0 2023-10-21T17:18:46.640 INFO:tasks.workunit.client.0.smithi012.stdout:0/805: chown d7/d55/d23/d27/d31/d5f/fad 12 1 2023-10-21T17:18:46.880 INFO:tasks.workunit.client.0.smithi012.stdout:6/691: creat d13/d42/d89/db8/d9f/fea x:0 0 0 2023-10-21T17:18:47.154 INFO:tasks.workunit.client.0.smithi012.stdout:1/777: creat d5/d30/da9/f109 x:0 0 0 2023-10-21T17:18:47.155 INFO:tasks.workunit.client.0.smithi012.stdout:1/778: read - d5/d30/da9/f109 zero size 2023-10-21T17:18:47.155 INFO:tasks.workunit.client.0.smithi012.stdout:1/779: fsync d5/f10 0 2023-10-21T17:18:47.366 INFO:tasks.workunit.client.0.smithi012.stdout:7/755: mknod d3/da7/ced 0 2023-10-21T17:18:47.366 INFO:tasks.workunit.client.0.smithi012.stdout:4/737: truncate dc/d6b/f9b 502820 0 2023-10-21T17:18:47.467 INFO:tasks.workunit.client.0.smithi012.stdout:8/636: mkdir d0/d46/dd3 0 2023-10-21T17:18:47.609 INFO:tasks.workunit.client.0.smithi012.stdout:0/806: link d7/d55/d23/dce/ddc/d114/d48/db7/lbb d7/d55/d23/d27/d40/l12f 0 2023-10-21T17:18:47.609 INFO:tasks.workunit.client.0.smithi012.stdout:0/807: read d7/d52/ff4 [848637,36943] 0 2023-10-21T17:18:47.705 INFO:tasks.workunit.client.0.smithi012.stdout:5/684: write d2/d4f/d7e/d87/d57/d66/f9a [703885,69165] 0 2023-10-21T17:18:47.750 INFO:tasks.workunit.client.0.smithi012.stdout:5/685: dread d2/d4f/d59/fa5 [0,4194304] 0 2023-10-21T17:18:47.750 INFO:tasks.workunit.client.0.smithi012.stdout:5/686: stat d2/d4f/d7e/d87/fbf 0 2023-10-21T17:18:47.751 INFO:tasks.workunit.client.0.smithi012.stdout:5/687: chown d2/d4f/fa4 13676266 1 2023-10-21T17:18:47.763 INFO:tasks.workunit.client.0.smithi012.stdout:5/688: dread d2/d4f/f94 [0,4194304] 0 2023-10-21T17:18:47.931 INFO:tasks.workunit.client.0.smithi012.stdout:3/672: sync 2023-10-21T17:18:47.959 INFO:tasks.workunit.client.0.smithi012.stdout:1/780: dread d5/d32/d1b/d35/d49/f7b [0,4194304] 0 2023-10-21T17:18:48.019 INFO:tasks.workunit.client.0.smithi012.stdout:1/781: dwrite d5/d32/f17 [4194304,4194304] 0 2023-10-21T17:18:48.040 INFO:tasks.workunit.client.0.smithi012.stdout:7/756: dread d3/d6/dc/d19/d1e/dc9/f87 [0,4194304] 0 2023-10-21T17:18:48.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/757: dwrite d3/d64/f7a [0,4194304] 0 2023-10-21T17:18:48.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/758: write d3/d16/f32 [798696,43798] 0 2023-10-21T17:18:48.354 INFO:tasks.workunit.client.0.smithi012.stdout:4/738: rename dc/d1e/d33/c51 to dc/d15/d18/d4c/d55/cf9 0 2023-10-21T17:18:48.355 INFO:tasks.workunit.client.0.smithi012.stdout:4/739: chown dc/d1e/c8c 1 1 2023-10-21T17:18:49.294 INFO:tasks.workunit.client.0.smithi012.stdout:0/808: read d7/d55/d1f/d28/d9b/d8a/f8f [1351286,42351] 0 2023-10-21T17:18:49.294 INFO:tasks.workunit.client.0.smithi012.stdout:0/809: readlink d7/l42 0 2023-10-21T17:18:49.389 INFO:tasks.workunit.client.0.smithi012.stdout:0/810: dwrite d7/d55/d1f/d28/f59 [0,4194304] 0 2023-10-21T17:18:49.459 INFO:tasks.workunit.client.0.smithi012.stdout:6/692: mkdir d13/d42/d89/db8/deb 0 2023-10-21T17:18:49.777 INFO:tasks.workunit.client.0.smithi012.stdout:9/651: write d0/d4/d4b/d6a/d89/dbb/fca [985185,2966] 0 2023-10-21T17:18:50.062 INFO:tasks.workunit.client.0.smithi012.stdout:5/689: getdents d2/d4f/d7e/daf 0 2023-10-21T17:18:50.063 INFO:tasks.workunit.client.0.smithi012.stdout:5/690: fdatasync d2/d4f/d59/d5b/f77 0 2023-10-21T17:18:50.516 INFO:tasks.workunit.client.0.smithi012.stdout:7/759: mknod d3/da7/cee 0 2023-10-21T17:18:50.532 INFO:tasks.workunit.client.0.smithi012.stdout:1/782: dread d5/d32/d1b/d27/f38 [0,4194304] 0 2023-10-21T17:18:50.546 INFO:tasks.workunit.client.0.smithi012.stdout:4/740: chown dc/d1e/d2b/fa3 750886617 1 2023-10-21T17:18:50.605 INFO:tasks.workunit.client.0.smithi012.stdout:7/760: dwrite d3/d64/f7a [0,4194304] 0 2023-10-21T17:18:51.016 INFO:tasks.workunit.client.0.smithi012.stdout:0/811: mkdir d7/d55/d23/d27/dc6/d112/d130 0 2023-10-21T17:18:51.079 INFO:tasks.workunit.client.0.smithi012.stdout:6/693: readlink d13/d15/l51 0 2023-10-21T17:18:51.157 INFO:tasks.workunit.client.0.smithi012.stdout:9/652: dread d0/d4/d4b/fbf [0,4194304] 0 2023-10-21T17:18:51.179 INFO:tasks.workunit.client.0.smithi012.stdout:9/653: write d0/f3e [2663866,130901] 0 2023-10-21T17:18:51.706 INFO:tasks.workunit.client.0.smithi012.stdout:3/673: rmdir d0/d32/d43 39 2023-10-21T17:18:52.142 INFO:tasks.workunit.client.0.smithi012.stdout:1/783: rename d5/d30/da9/fdc to d5/d32/dce/de0/f10a 0 2023-10-21T17:18:52.171 INFO:tasks.workunit.client.0.smithi012.stdout:1/784: read d5/d26/f40 [584626,44] 0 2023-10-21T17:18:52.171 INFO:tasks.workunit.client.0.smithi012.stdout:1/785: dread - d5/d26/d54/fe8 zero size 2023-10-21T17:18:52.172 INFO:tasks.workunit.client.0.smithi012.stdout:1/786: chown d5/fbb 154847 1 2023-10-21T17:18:52.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/741: mkdir dc/d15/d2a/d58/df8/dfa 0 2023-10-21T17:18:52.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/742: stat dc/d15/d2a/d58/df8 0 2023-10-21T17:18:52.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/743: stat dc/d15/d2a/dce 0 2023-10-21T17:18:52.512 INFO:tasks.workunit.client.0.smithi012.stdout:0/812: creat d7/d55/d23/dce/ddc/d114/d82/d8d/f131 x:0 0 0 2023-10-21T17:18:52.512 INFO:tasks.workunit.client.0.smithi012.stdout:7/761: mkdir d3/d6/d6a/def 0 2023-10-21T17:18:52.512 INFO:tasks.workunit.client.0.smithi012.stdout:0/813: chown d7/dbd 2963 1 2023-10-21T17:18:52.711 INFO:tasks.workunit.client.0.smithi012.stdout:2/781: creat d1/f100 x:0 0 0 2023-10-21T17:18:53.236 INFO:tasks.workunit.client.0.smithi012.stdout:3/674: link d0/da/f3d d0/d82/fc5 0 2023-10-21T17:18:53.395 INFO:tasks.workunit.client.0.smithi012.stdout:1/787: rmdir d5/d26/d64/d8f/da0 39 2023-10-21T17:18:53.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/744: creat dc/d15/d2a/d58/de1/ffb x:0 0 0 2023-10-21T17:18:53.876 INFO:tasks.workunit.client.0.smithi012.stdout:7/762: creat d3/d6/dc/d19/d1e/d7b/ff0 x:0 0 0 2023-10-21T17:18:53.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/763: truncate d3/da7/de0/fe9 953294 0 2023-10-21T17:18:53.962 INFO:tasks.workunit.client.0.smithi012.stdout:7/764: dwrite d3/da7/fd1 [0,4194304] 0 2023-10-21T17:18:53.980 INFO:tasks.workunit.client.0.smithi012.stdout:2/782: dread d1/d14/d17/db9/dd6/f3b [0,4194304] 0 2023-10-21T17:18:53.984 INFO:tasks.workunit.client.0.smithi012.stdout:7/765: dread d3/d16/f1a [0,4194304] 0 2023-10-21T17:18:54.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/675: truncate d0/d96/d97/f9a 1268330 0 2023-10-21T17:18:54.627 INFO:tasks.workunit.client.0.smithi012.stdout:3/676: write d0/d1c/d5e/f84 [2829018,13011] 0 2023-10-21T17:18:54.706 INFO:tasks.workunit.client.0.smithi012.stdout:1/788: creat d5/d32/d1b/d27/d47/de9/f10b x:0 0 0 2023-10-21T17:18:54.933 INFO:tasks.workunit.client.0.smithi012.stdout:4/745: dread dc/d1e/d6e/f84 [0,4194304] 0 2023-10-21T17:18:55.003 INFO:tasks.workunit.client.0.smithi012.stdout:4/746: dwrite dc/d93/f50 [0,4194304] 0 2023-10-21T17:18:55.003 INFO:tasks.workunit.client.0.smithi012.stdout:4/747: read dc/d15/d18/d4c/fb3 [251862,85482] 0 2023-10-21T17:18:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:2/783: symlink d1/d4/d65/dea/d5f/l101 0 2023-10-21T17:18:55.604 INFO:tasks.workunit.client.0.smithi012.stdout:3/677: creat d0/d9d/fc6 x:0 0 0 2023-10-21T17:18:55.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/766: mknod d3/dd9/cf1 0 2023-10-21T17:18:55.793 INFO:tasks.workunit.client.0.smithi012.stdout:1/789: mknod d5/d32/d1b/d2c/d48/df3/c10c 0 2023-10-21T17:18:55.794 INFO:tasks.workunit.client.0.smithi012.stdout:1/790: write d5/d32/d1b/d35/d49/d69/ff1 [559475,86547] 0 2023-10-21T17:18:55.955 INFO:tasks.workunit.client.0.smithi012.stdout:6/694: rename d13/d29/d37/d3b/daa to d13/d15/d1d/d5d/d66/d70/d74/dc9/dec 0 2023-10-21T17:18:57.166 INFO:tasks.workunit.client.0.smithi012.stdout:2/784: mknod d1/d14/d16/d58/dec/da5/d34/dc2/dd9/c102 0 2023-10-21T17:18:57.166 INFO:tasks.workunit.client.0.smithi012.stdout:2/785: stat d1/f100 0 2023-10-21T17:18:57.167 INFO:tasks.workunit.client.0.smithi012.stdout:3/678: unlink d0/da/d28/c2a 0 2023-10-21T17:18:57.167 INFO:tasks.workunit.client.0.smithi012.stdout:3/679: chown d0/d32 18066368 1 2023-10-21T17:18:57.167 INFO:tasks.workunit.client.0.smithi012.stdout:3/680: dread - d0/da/f54 zero size 2023-10-21T17:18:57.167 INFO:tasks.workunit.client.0.smithi012.stdout:2/786: creat d1/d8/f103 x:0 0 0 2023-10-21T17:18:57.167 INFO:tasks.workunit.client.0.smithi012.stdout:2/787: read d1/d8/ff [2877676,125378] 0 2023-10-21T17:18:57.168 INFO:tasks.workunit.client.0.smithi012.stdout:8/637: sync 2023-10-21T17:18:57.168 INFO:tasks.workunit.client.0.smithi012.stdout:8/638: chown d0/d62/fd1 24224 1 2023-10-21T17:18:57.191 INFO:tasks.workunit.client.0.smithi012.stdout:8/639: dread d0/f17 [0,4194304] 0 2023-10-21T17:18:57.412 INFO:tasks.workunit.client.0.smithi012.stdout:7/767: unlink d3/c8 0 2023-10-21T17:18:57.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/791: creat d5/d32/dce/f10d x:0 0 0 2023-10-21T17:18:57.412 INFO:tasks.workunit.client.0.smithi012.stdout:7/768: write d3/d6/dc/d19/d43/f61 [1133212,9316] 0 2023-10-21T17:18:57.545 INFO:tasks.workunit.client.0.smithi012.stdout:6/695: symlink d13/d35/led 0 2023-10-21T17:18:57.677 INFO:tasks.workunit.client.0.smithi012.stdout:3/681: chown d0/d32/d43 95 1 2023-10-21T17:18:57.735 INFO:tasks.workunit.client.0.smithi012.stdout:9/654: dwrite d0/f1b [0,4194304] 0 2023-10-21T17:18:57.736 INFO:tasks.workunit.client.0.smithi012.stdout:9/655: readlink d0/d4/d4b/l96 0 2023-10-21T17:18:57.917 INFO:tasks.workunit.client.0.smithi012.stdout:2/788: symlink d1/d14/d16/d58/dec/da5/d34/l104 0 2023-10-21T17:18:57.970 INFO:tasks.workunit.client.0.smithi012.stdout:2/789: write d1/d14/d16/d58/dec/d82/ff0 [1277194,17548] 0 2023-10-21T17:18:57.970 INFO:tasks.workunit.client.0.smithi012.stdout:2/790: fdatasync d1/d8/f8f 0 2023-10-21T17:18:57.970 INFO:tasks.workunit.client.0.smithi012.stdout:2/791: readlink d1/d14/d16/d58/dec/da5/d50/lc9 0 2023-10-21T17:18:58.035 INFO:tasks.workunit.client.0.smithi012.stdout:2/792: dwrite d1/d14/d16/d58/dec/f39 [0,4194304] 0 2023-10-21T17:18:58.128 INFO:tasks.workunit.client.0.smithi012.stdout:7/769: link d3/dd9/d9c/la1 d3/lf2 0 2023-10-21T17:18:58.286 INFO:tasks.workunit.client.0.smithi012.stdout:3/682: symlink d0/d32/d43/d47/d50/d52/lc7 0 2023-10-21T17:18:58.391 INFO:tasks.workunit.client.0.smithi012.stdout:9/656: creat d0/df/d8d/dcb/d25/d39/fdc x:0 0 0 2023-10-21T17:18:58.392 INFO:tasks.workunit.client.0.smithi012.stdout:9/657: dread - d0/d4/d4b/d6a/fd0 zero size 2023-10-21T17:18:58.392 INFO:tasks.workunit.client.0.smithi012.stdout:9/658: truncate d0/d5/f7e 1775191 0 2023-10-21T17:18:58.627 INFO:tasks.workunit.client.0.smithi012.stdout:5/691: rmdir d2/d2c 39 2023-10-21T17:18:58.627 INFO:tasks.workunit.client.0.smithi012.stdout:5/692: readlink d2/d4f/d59/d5b/l12 0 2023-10-21T17:18:58.779 INFO:tasks.workunit.client.0.smithi012.stdout:0/814: write d7/f1d [3169730,27307] 0 2023-10-21T17:18:58.889 INFO:tasks.workunit.client.0.smithi012.stdout:1/792: getdents d5/d26/d54 0 2023-10-21T17:18:59.310 INFO:tasks.workunit.client.0.smithi012.stdout:2/793: readlink d1/d14/d16/d58/dec/l2f 0 2023-10-21T17:18:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/770: rename d3/d16/ldf to d3/d6/dc/d19/d1e/d34/da8/lf3 0 2023-10-21T17:18:59.623 INFO:tasks.workunit.client.0.smithi012.stdout:6/696: mkdir d13/d15/d1d/d28/d5b/dee 0 2023-10-21T17:18:59.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/683: getdents d0/d32 0 2023-10-21T17:19:00.344 INFO:tasks.workunit.client.0.smithi012.stdout:2/794: link d1/d14/d16/f72 d1/d14/d16/d58/f105 0 2023-10-21T17:19:00.345 INFO:tasks.workunit.client.0.smithi012.stdout:2/795: write d1/d4/fc7 [459215,127594] 0 2023-10-21T17:19:00.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/771: link d3/d64/f71 d3/d6/dc/d19/d1e/d9d/dda/ff4 0 2023-10-21T17:19:00.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/772: readlink d3/d29/l86 0 2023-10-21T17:19:00.490 INFO:tasks.workunit.client.0.smithi012.stdout:7/773: write d3/d6/f66 [806146,18525] 0 2023-10-21T17:19:00.669 INFO:tasks.workunit.client.0.smithi012.stdout:6/697: mknod d13/d15/d1d/d5d/d66/d70/d74/d98/cef 0 2023-10-21T17:19:00.803 INFO:tasks.workunit.client.0.smithi012.stdout:3/684: creat d0/d1c/d5e/fc8 x:0 0 0 2023-10-21T17:19:00.803 INFO:tasks.workunit.client.0.smithi012.stdout:3/685: write d0/d32/d43/d47/d50/d52/fa1 [281251,49389] 0 2023-10-21T17:19:01.001 INFO:tasks.workunit.client.0.smithi012.stdout:9/659: mkdir d0/d4/d4b/d6a/ddd 0 2023-10-21T17:19:01.067 INFO:tasks.workunit.client.0.smithi012.stdout:9/660: dwrite d0/d5/fd6 [0,4194304] 0 2023-10-21T17:19:01.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/693: mknod d2/d4f/d7e/d87/d57/d66/cdc 0 2023-10-21T17:19:01.566 INFO:tasks.workunit.client.0.smithi012.stdout:2/796: mknod d1/d8/c106 0 2023-10-21T17:19:01.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/774: mknod d3/d6/dc/d19/d1e/d7b/cf5 0 2023-10-21T17:19:01.819 INFO:tasks.workunit.client.0.smithi012.stdout:7/775: dread d3/d6/fae [0,4194304] 0 2023-10-21T17:19:01.839 INFO:tasks.workunit.client.0.smithi012.stdout:7/776: write d3/d16/f56 [14101,32387] 0 2023-10-21T17:19:01.839 INFO:tasks.workunit.client.0.smithi012.stdout:7/777: truncate d3/d6/dc/d19/d1e/d9d/dec/fcb 648479 0 2023-10-21T17:19:02.053 INFO:tasks.workunit.client.0.smithi012.stdout:6/698: mkdir d13/d64/d6d/df0 0 2023-10-21T17:19:02.053 INFO:tasks.workunit.client.0.smithi012.stdout:3/686: mknod d0/d9d/dba/cc9 0 2023-10-21T17:19:02.054 INFO:tasks.workunit.client.0.smithi012.stdout:6/699: creat d13/d15/d1d/d28/d5b/d75/ff1 x:0 0 0 2023-10-21T17:19:02.429 INFO:tasks.workunit.client.0.smithi012.stdout:5/694: rename d2/d1d/d20/f2b to d2/d2c/db6/fdd 0 2023-10-21T17:19:02.590 INFO:tasks.workunit.client.0.smithi012.stdout:4/748: sync 2023-10-21T17:19:03.268 INFO:tasks.workunit.client.0.smithi012.stdout:2/797: dread d1/d14/d16/f72 [0,4194304] 0 2023-10-21T17:19:03.341 INFO:tasks.workunit.client.0.smithi012.stdout:8/640: unlink d0/f17 0 2023-10-21T17:19:03.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/687: mkdir d0/d32/d43/dca 0 2023-10-21T17:19:03.770 INFO:tasks.workunit.client.0.smithi012.stdout:3/688: dread d0/d32/d43/d47/d50/d52/f8e [0,4194304] 0 2023-10-21T17:19:03.877 INFO:tasks.workunit.client.0.smithi012.stdout:9/661: link d0/d15/f9f d0/d4/d4b/fde 0 2023-10-21T17:19:04.256 INFO:tasks.workunit.client.0.smithi012.stdout:6/700: rename d13/d29/f5f to d13/d42/d89/db8/deb/ff2 0 2023-10-21T17:19:04.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/701: write fd [669620,52650] 0 2023-10-21T17:19:04.314 INFO:tasks.workunit.client.0.smithi012.stdout:5/695: creat d2/d4f/d7e/d87/d93/dc3/fde x:0 0 0 2023-10-21T17:19:04.315 INFO:tasks.workunit.client.0.smithi012.stdout:5/696: write d2/d4f/d59/d5b/f7c [133268,65815] 0 2023-10-21T17:19:04.315 INFO:tasks.workunit.client.0.smithi012.stdout:5/697: dread - d2/d4f/d7e/d87/d57/dc7/dd0/f95 zero size 2023-10-21T17:19:04.315 INFO:tasks.workunit.client.0.smithi012.stdout:5/698: chown d2/d1d/d20/l50 417 1 2023-10-21T17:19:04.345 INFO:tasks.workunit.client.0.smithi012.stdout:5/699: read d2/d2c/d73/d49/fac [369826,49779] 0 2023-10-21T17:19:04.346 INFO:tasks.workunit.client.0.smithi012.stdout:5/700: stat d2/d4f/d59/d5b/d15/fd8 0 2023-10-21T17:19:04.769 INFO:tasks.workunit.client.0.smithi012.stdout:4/749: mkdir dc/d1e/d33/d8a/ddb/dfc 0 2023-10-21T17:19:04.836 INFO:tasks.workunit.client.0.smithi012.stdout:4/750: dwrite dc/d15/d18/d57/f61 [4194304,4194304] 0 2023-10-21T17:19:04.837 INFO:tasks.workunit.client.0.smithi012.stdout:4/751: write dc/d1e/f4b [5122968,78916] 0 2023-10-21T17:19:05.091 INFO:tasks.workunit.client.0.smithi012.stdout:8/641: mkdir d0/d12/d6c/dd4 0 2023-10-21T17:19:05.092 INFO:tasks.workunit.client.0.smithi012.stdout:8/642: readlink d0/d1a/d54/l92 0 2023-10-21T17:19:05.240 INFO:tasks.workunit.client.0.smithi012.stdout:3/689: symlink d0/d32/d43/d47/d50/d52/lcb 0 2023-10-21T17:19:05.372 INFO:tasks.workunit.client.0.smithi012.stdout:9/662: mkdir d0/d4/d4b/d6a/d89/ddf 0 2023-10-21T17:19:05.373 INFO:tasks.workunit.client.0.smithi012.stdout:9/663: dread - d0/f85 zero size 2023-10-21T17:19:05.843 INFO:tasks.workunit.client.0.smithi012.stdout:6/702: rename d13/d15/f26 to d13/d15/d1d/d28/d5b/d75/ff3 0 2023-10-21T17:19:05.975 INFO:tasks.workunit.client.0.smithi012.stdout:5/701: link d2/d4f/d59/d5b/f74 d2/d1d/d4e/fdf 0 2023-10-21T17:19:06.197 INFO:tasks.workunit.client.0.smithi012.stdout:4/752: unlink dc/d1e/d33/d8a/lbc 0 2023-10-21T17:19:06.265 INFO:tasks.workunit.client.0.smithi012.stdout:4/753: dwrite dc/d15/d18/fc6 [0,4194304] 0 2023-10-21T17:19:06.289 INFO:tasks.workunit.client.0.smithi012.stdout:4/754: write dc/d15/d18/d4c/fd4 [2876908,96767] 0 2023-10-21T17:19:06.485 INFO:tasks.workunit.client.0.smithi012.stdout:2/798: mkdir d1/d4/d3f/d107 0 2023-10-21T17:19:06.485 INFO:tasks.workunit.client.0.smithi012.stdout:2/799: readlink d1/d14/d16/l8d 0 2023-10-21T17:19:06.710 INFO:tasks.workunit.client.0.smithi012.stdout:3/690: mkdir d0/d32/d43/d47/d50/dcc 0 2023-10-21T17:19:06.818 INFO:tasks.workunit.client.0.smithi012.stdout:1/793: write d5/d26/d64/d8f/dd6/ff6 [357489,126357] 0 2023-10-21T17:19:06.823 INFO:tasks.workunit.client.0.smithi012.stdout:1/794: write d5/d26/fbc [199906,113772] 0 2023-10-21T17:19:06.823 INFO:tasks.workunit.client.0.smithi012.stdout:1/795: creat d5/d32/d1b/d2c/d48/f10e x:0 0 0 2023-10-21T17:19:06.932 INFO:tasks.workunit.client.0.smithi012.stdout:8/643: rename d0/d12/d40/fac to d0/d1a/db0/dca/fd5 0 2023-10-21T17:19:07.151 INFO:tasks.workunit.client.0.smithi012.stdout:6/703: symlink d13/d42/d89/db8/d9f/lf4 0 2023-10-21T17:19:07.152 INFO:tasks.workunit.client.0.smithi012.stdout:6/704: write d13/d42/d89/db8/deb/ff2 [4554021,95299] 0 2023-10-21T17:19:07.152 INFO:tasks.workunit.client.0.smithi012.stdout:6/705: truncate d13/d42/d89/db8/f8e 1345291 0 2023-10-21T17:19:07.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:19:07.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:19:07.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/702: dread d2/d4f/d7e/d87/d57/dc7/dd0/f51 [4194304,4194304] 0 2023-10-21T17:19:07.839 INFO:tasks.workunit.client.0.smithi012.stdout:4/755: creat dc/d15/d2a/d31/ffd x:0 0 0 2023-10-21T17:19:07.985 INFO:tasks.workunit.client.0.smithi012.stdout:2/800: creat d1/d14/d17/f108 x:0 0 0 2023-10-21T17:19:07.985 INFO:tasks.workunit.client.0.smithi012.stdout:2/801: chown d1/d4/d3f/d4a 50 1 2023-10-21T17:19:08.019 INFO:tasks.workunit.client.0.smithi012.stdout:2/802: dread d1/d8/f51 [0,4194304] 0 2023-10-21T17:19:08.020 INFO:tasks.workunit.client.0.smithi012.stdout:2/803: write d1/d4/f7 [3660580,53238] 0 2023-10-21T17:19:08.020 INFO:tasks.workunit.client.0.smithi012.stdout:2/804: chown d1/d4/d3f/d41/d59 79417796 1 2023-10-21T17:19:08.237 INFO:tasks.workunit.client.0.smithi012.stdout:3/691: rmdir d0/d96/da0 39 2023-10-21T17:19:08.237 INFO:tasks.workunit.client.0.smithi012.stdout:3/692: stat d0/d96/lb8 0 2023-10-21T17:19:08.238 INFO:tasks.workunit.client.0.smithi012.stdout:3/693: write d0/d32/f4e [4931729,36530] 0 2023-10-21T17:19:08.238 INFO:tasks.workunit.client.0.smithi012.stdout:3/694: write d0/da/f54 [188871,109683] 0 2023-10-21T17:19:08.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/796: mkdir d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/d10f 0 2023-10-21T17:19:08.587 INFO:tasks.workunit.client.0.smithi012.stdout:1/797: dwrite d5/d26/d64/f80 [0,4194304] 0 2023-10-21T17:19:08.885 INFO:tasks.workunit.client.0.smithi012.stdout:8/644: creat d0/d62/d7d/dcf/fd6 x:0 0 0 2023-10-21T17:19:08.885 INFO:tasks.workunit.client.0.smithi012.stdout:8/645: write d0/d1a/f41 [1008555,20717] 0 2023-10-21T17:19:10.450 INFO:tasks.workunit.client.0.smithi012.stdout:2/805: creat d1/d4/d65/dea/d5f/f109 x:0 0 0 2023-10-21T17:19:10.795 INFO:tasks.workunit.client.0.smithi012.stdout:1/798: rmdir d5/d30/d51/d105 0 2023-10-21T17:19:10.796 INFO:tasks.workunit.client.0.smithi012.stdout:1/799: chown d5/fbb 1587 1 2023-10-21T17:19:10.796 INFO:tasks.workunit.client.0.smithi012.stdout:7/778: write d3/d6/dc/d19/d43/f4e [4826549,82873] 0 2023-10-21T17:19:10.796 INFO:tasks.workunit.client.0.smithi012.stdout:1/800: write d5/d32/d1b/d2c/d4b/d8a/fe6 [423626,16686] 0 2023-10-21T17:19:11.107 INFO:tasks.workunit.client.0.smithi012.stdout:8/646: creat d0/d12/d40/d91/fd7 x:0 0 0 2023-10-21T17:19:12.844 INFO:tasks.workunit.client.0.smithi012.stdout:6/706: dwrite d13/d15/d1d/d28/fa8 [0,4194304] 0 2023-10-21T17:19:13.600 INFO:tasks.workunit.client.0.smithi012.stdout:0/815: mknod d7/d55/c132 0 2023-10-21T17:19:13.827 INFO:tasks.workunit.client.0.smithi012.stdout:5/703: write d2/d1d/fa8 [1381280,66515] 0 2023-10-21T17:19:13.829 INFO:tasks.workunit.client.0.smithi012.stdout:4/756: write dc/d15/f5e [469004,70368] 0 2023-10-21T17:19:13.842 INFO:tasks.workunit.client.0.smithi012.stdout:3/695: write d0/f5 [4201805,71887] 0 2023-10-21T17:19:13.929 INFO:tasks.workunit.client.0.smithi012.stdout:8/647: write d0/d29/f7a [2961069,46070] 0 2023-10-21T17:19:14.020 INFO:tasks.workunit.client.0.smithi012.stdout:2/806: symlink d1/l10a 0 2023-10-21T17:19:14.096 INFO:tasks.workunit.client.0.smithi012.stdout:7/779: creat d3/d6/dc/d19/ff6 x:0 0 0 2023-10-21T17:19:14.562 INFO:tasks.workunit.client.0.smithi012.stdout:9/664: rename d0/df/d8d/fc3 to d0/fe0 0 2023-10-21T17:19:15.302 INFO:tasks.workunit.client.0.smithi012.stdout:6/707: link fd d13/d35/d4c/ff5 0 2023-10-21T17:19:15.303 INFO:tasks.workunit.client.0.smithi012.stdout:6/708: truncate d13/d64/d6d/d73/fd7 622985 0 2023-10-21T17:19:15.429 INFO:tasks.workunit.client.0.smithi012.stdout:0/816: mknod d7/d55/d1f/d28/d9b/d8a/c133 0 2023-10-21T17:19:15.650 INFO:tasks.workunit.client.0.smithi012.stdout:5/704: mkdir d2/d2c/db6/dbc/de0 0 2023-10-21T17:19:15.651 INFO:tasks.workunit.client.0.smithi012.stdout:4/757: chown dc/d15/f6f 7 1 2023-10-21T17:19:15.758 INFO:tasks.workunit.client.0.smithi012.stdout:4/758: dwrite dc/d15/d2a/d58/f92 [0,4194304] 0 2023-10-21T17:19:15.851 INFO:tasks.workunit.client.0.smithi012.stdout:8/648: mkdir d0/d1a/db0/db7/dd8 0 2023-10-21T17:19:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:7/780: mkdir d3/d6/df7 0 2023-10-21T17:19:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:7/781: dread - d3/d6/dc/d19/d1e/d9d/dec/fe3 zero size 2023-10-21T17:19:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:7/782: write d3/d6/d73/d8e/f9f [1132496,72890] 0 2023-10-21T17:19:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:7/783: creat d3/d6/dc/d19/d1e/d34/da8/db4/dce/ff8 x:0 0 0 2023-10-21T17:19:16.185 INFO:tasks.workunit.client.0.smithi012.stdout:9/665: mkdir d0/df/d8d/de1 0 2023-10-21T17:19:16.253 INFO:tasks.workunit.client.0.smithi012.stdout:9/666: dwrite d0/f85 [0,4194304] 0 2023-10-21T17:19:16.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/667: write d0/d15/faa [1039466,122516] 0 2023-10-21T17:19:16.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/668: stat d0/df/d8d/dcb/d25/f71 0 2023-10-21T17:19:16.701 INFO:tasks.workunit.client.0.smithi012.stdout:6/709: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/ff6 x:0 0 0 2023-10-21T17:19:16.701 INFO:tasks.workunit.client.0.smithi012.stdout:6/710: truncate d13/d15/d1d/d5d/d66/d70/d74/d98/fb5 557696 0 2023-10-21T17:19:16.716 INFO:tasks.workunit.client.0.smithi012.stdout:6/711: dread f6 [0,4194304] 0 2023-10-21T17:19:17.915 INFO:tasks.workunit.client.0.smithi012.stdout:5/705: unlink d2/d4f/d7e/d87/f6b 0 2023-10-21T17:19:18.339 INFO:tasks.workunit.client.0.smithi012.stdout:4/759: truncate dc/d15/d18/d4c/d55/d6c/dbb/fcb 1185551 0 2023-10-21T17:19:18.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/649: creat d0/d1a/fd9 x:0 0 0 2023-10-21T17:19:18.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/650: dread - d0/d62/f76 zero size 2023-10-21T17:19:18.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/807: symlink d1/d4/l10b 0 2023-10-21T17:19:18.919 INFO:tasks.workunit.client.0.smithi012.stdout:1/801: rename d5/d32/d1b/d35/d3a/d5c/d7c/c104 to d5/d32/d1b/d35/d49/c110 0 2023-10-21T17:19:19.534 INFO:tasks.workunit.client.0.smithi012.stdout:9/669: rmdir d0/da7/ddb 0 2023-10-21T17:19:20.425 INFO:tasks.workunit.client.0.smithi012.stdout:0/817: sync 2023-10-21T17:19:20.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/760: symlink dc/d15/d18/d4c/d55/d6c/de6/lfe 0 2023-10-21T17:19:20.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/761: fdatasync dc/d1e/d91/fc8 0 2023-10-21T17:19:20.748 INFO:tasks.workunit.client.0.smithi012.stdout:2/808: chown d1/d14/d17/l1d 180 1 2023-10-21T17:19:21.270 INFO:tasks.workunit.client.0.smithi012.stdout:3/696: rename d0/d1c/l2e to d0/d32/d43/d47/d50/dcc/lcd 0 2023-10-21T17:19:21.270 INFO:tasks.workunit.client.0.smithi012.stdout:3/697: creat d0/d9d/fce x:0 0 0 2023-10-21T17:19:21.287 INFO:tasks.workunit.client.0.smithi012.stdout:9/670: unlink d0/df/d8d/dcb/d25/d2f/d8c/fcf 0 2023-10-21T17:19:21.322 INFO:tasks.workunit.client.0.smithi012.stdout:9/671: dread d0/df/d8d/dcb/d25/f71 [4194304,4194304] 0 2023-10-21T17:19:21.356 INFO:tasks.workunit.client.0.smithi012.stdout:9/672: write d0/d4/d4b/f99 [2171959,123319] 0 2023-10-21T17:19:21.435 INFO:tasks.workunit.client.0.smithi012.stdout:6/712: mkdir d13/d29/d78/df7 0 2023-10-21T17:19:22.074 INFO:tasks.workunit.client.0.smithi012.stdout:4/762: creat dc/d15/d18/d4c/d75/de3/fff x:0 0 0 2023-10-21T17:19:22.074 INFO:tasks.workunit.client.0.smithi012.stdout:4/763: creat dc/d1e/d91/f100 x:0 0 0 2023-10-21T17:19:22.632 INFO:tasks.workunit.client.0.smithi012.stdout:5/706: write d2/d4f/d7e/d87/d57/f9b [254091,18080] 0 2023-10-21T17:19:22.658 INFO:tasks.workunit.client.0.smithi012.stdout:5/707: dread d2/d4f/d59/fa5 [0,4194304] 0 2023-10-21T17:19:22.742 INFO:tasks.workunit.client.0.smithi012.stdout:3/698: dread d0/d82/fb6 [0,4194304] 0 2023-10-21T17:19:22.781 INFO:tasks.workunit.client.0.smithi012.stdout:3/699: read d0/d32/d43/f59 [1264337,16660] 0 2023-10-21T17:19:22.984 INFO:tasks.workunit.client.0.smithi012.stdout:9/673: mkdir d0/d4/d4b/d6a/d89/de2 0 2023-10-21T17:19:23.222 INFO:tasks.workunit.client.0.smithi012.stdout:0/818: creat d7/d55/d23/dce/ddc/d114/da9/d107/f134 x:0 0 0 2023-10-21T17:19:23.314 INFO:tasks.workunit.client.0.smithi012.stdout:0/819: dwrite d7/d55/d23/dce/ddc/d114/d82/d8d/f131 [0,4194304] 0 2023-10-21T17:19:23.771 INFO:tasks.workunit.client.0.smithi012.stdout:5/708: getdents d2/d2c/d8c 0 2023-10-21T17:19:24.126 INFO:tasks.workunit.client.0.smithi012.stdout:6/713: mkdir d13/d15/d1d/d5d/df8 0 2023-10-21T17:19:24.127 INFO:tasks.workunit.client.0.smithi012.stdout:1/802: write d5/d32/f17 [8561960,40378] 0 2023-10-21T17:19:24.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/714: write d13/d42/d89/db8/f45 [61717,72362] 0 2023-10-21T17:19:24.216 INFO:tasks.workunit.client.0.smithi012.stdout:1/803: dwrite d5/d32/d1b/d27/d47/de9/f10b [0,4194304] 0 2023-10-21T17:19:24.699 INFO:tasks.workunit.client.0.smithi012.stdout:0/820: dread d7/d55/d23/dce/ddc/d114/d63/fae [0,4194304] 0 2023-10-21T17:19:24.726 INFO:tasks.workunit.client.0.smithi012.stdout:4/764: truncate fb 586421 0 2023-10-21T17:19:24.925 INFO:tasks.workunit.client.0.smithi012.stdout:5/709: creat d2/fe1 x:0 0 0 2023-10-21T17:19:25.023 INFO:tasks.workunit.client.0.smithi012.stdout:5/710: dwrite d2/d4f/d59/d5b/f67 [0,4194304] 0 2023-10-21T17:19:25.023 INFO:tasks.workunit.client.0.smithi012.stdout:5/711: chown d2/d1d/d20/l50 661 1 2023-10-21T17:19:25.442 INFO:tasks.workunit.client.0.smithi012.stdout:6/715: mkdir d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9 0 2023-10-21T17:19:25.805 INFO:tasks.workunit.client.0.smithi012.stdout:1/804: symlink d5/d32/dce/df9/l111 0 2023-10-21T17:19:26.146 INFO:tasks.workunit.client.0.smithi012.stdout:0/821: mknod d7/d55/d23/dce/ddc/d114/d48/de2/c135 0 2023-10-21T17:19:26.146 INFO:tasks.workunit.client.0.smithi012.stdout:4/765: symlink dc/d1e/d65/l101 0 2023-10-21T17:19:26.335 INFO:tasks.workunit.client.0.smithi012.stdout:5/712: rmdir d2/d2c/db6/dbc/de0 0 2023-10-21T17:19:26.336 INFO:tasks.workunit.client.0.smithi012.stdout:5/713: stat d2/d2c/ldb 0 2023-10-21T17:19:26.336 INFO:tasks.workunit.client.0.smithi012.stdout:5/714: dread - d2/d4f/d7e/d87/d57/dc7/dd0/f95 zero size 2023-10-21T17:19:26.609 INFO:tasks.workunit.client.0.smithi012.stdout:1/805: creat d5/d26/f112 x:0 0 0 2023-10-21T17:19:26.610 INFO:tasks.workunit.client.0.smithi012.stdout:1/806: truncate d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fe4 775862 0 2023-10-21T17:19:26.705 INFO:tasks.workunit.client.0.smithi012.stdout:1/807: dwrite d5/f39 [0,4194304] 0 2023-10-21T17:19:26.720 INFO:tasks.workunit.client.0.smithi012.stdout:0/822: rmdir d7/d55/d1f/d28 39 2023-10-21T17:19:26.720 INFO:tasks.workunit.client.0.smithi012.stdout:0/823: write d7/d52/d90/fe8 [877109,3079] 0 2023-10-21T17:19:26.782 INFO:tasks.workunit.client.0.smithi012.stdout:1/808: dwrite d5/d32/d1b/d27/dfb/d108/d4f/fd2 [4194304,4194304] 0 2023-10-21T17:19:26.782 INFO:tasks.workunit.client.0.smithi012.stdout:1/809: readlink d5/d32/dce/df9/de7/lfe 0 2023-10-21T17:19:26.807 INFO:tasks.workunit.client.0.smithi012.stdout:4/766: write dc/d28/fd8 [719298,27077] 0 2023-10-21T17:19:26.886 INFO:tasks.workunit.client.0.smithi012.stdout:4/767: dwrite dc/d15/d18/d4c/f98 [0,4194304] 0 2023-10-21T17:19:26.920 INFO:tasks.workunit.client.0.smithi012.stdout:4/768: dread dc/d15/d18/d4c/d55/d6c/d83/f86 [0,4194304] 0 2023-10-21T17:19:27.001 INFO:tasks.workunit.client.0.smithi012.stdout:6/716: symlink d13/d15/d1d/d5d/lfa 0 2023-10-21T17:19:27.103 INFO:tasks.workunit.client.0.smithi012.stdout:6/717: dwrite f7 [4194304,4194304] 0 2023-10-21T17:19:27.103 INFO:tasks.workunit.client.0.smithi012.stdout:6/718: fdatasync d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/fd3 0 2023-10-21T17:19:27.103 INFO:tasks.workunit.client.0.smithi012.stdout:6/719: read - d13/d42/d89/db8/fb9 zero size 2023-10-21T17:19:27.218 INFO:tasks.workunit.client.0.smithi012.stdout:0/824: creat d7/d55/d23/d27/f136 x:0 0 0 2023-10-21T17:19:28.075 INFO:tasks.workunit.client.0.smithi012.stdout:1/810: truncate d5/d26/d64/f80 3602853 0 2023-10-21T17:19:28.318 INFO:tasks.workunit.client.0.smithi012.stdout:9/674: write d0/df/d8d/dcb/d25/d39/d3b/f70 [4794046,104686] 0 2023-10-21T17:19:28.319 INFO:tasks.workunit.client.0.smithi012.stdout:7/784: rename d3/f89 to d3/d6/d73/d8e/ff9 0 2023-10-21T17:19:28.319 INFO:tasks.workunit.client.0.smithi012.stdout:7/785: dread - d3/d6/dc/d19/d1e/d9d/dec/fb7 zero size 2023-10-21T17:19:28.319 INFO:tasks.workunit.client.0.smithi012.stdout:7/786: read - d3/da7/daf/dcd/fbb zero size 2023-10-21T17:19:28.394 INFO:tasks.workunit.client.0.smithi012.stdout:9/675: dwrite d0/df/d8d/dcb/d25/f37 [0,4194304] 0 2023-10-21T17:19:28.484 INFO:tasks.workunit.client.0.smithi012.stdout:9/676: dwrite d0/df/d8d/f38 [0,4194304] 0 2023-10-21T17:19:28.484 INFO:tasks.workunit.client.0.smithi012.stdout:9/677: stat d0/df/d8d/dcb/d25/d39/d3b/l75 0 2023-10-21T17:19:28.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/769: creat dc/d15/d2a/d58/df8/f102 x:0 0 0 2023-10-21T17:19:28.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/770: chown dc/d1e/d6e/f84 11622765 1 2023-10-21T17:19:28.731 INFO:tasks.workunit.client.0.smithi012.stdout:6/720: unlink d13/d15/d1d/d5d/d66/d70/fe0 0 2023-10-21T17:19:29.289 INFO:tasks.workunit.client.0.smithi012.stdout:1/811: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/d10f/f113 x:0 0 0 2023-10-21T17:19:29.901 INFO:tasks.workunit.client.0.smithi012.stdout:4/771: mknod dc/d28/c103 0 2023-10-21T17:19:30.133 INFO:tasks.workunit.client.0.smithi012.stdout:0/825: link d7/d55/d23/d27/f44 d7/d55/d23/d27/d31/d3d/f137 0 2023-10-21T17:19:30.282 INFO:tasks.workunit.client.0.smithi012.stdout:1/812: symlink d5/d32/d1b/d35/d49/d69/df0/l114 0 2023-10-21T17:19:30.832 INFO:tasks.workunit.client.0.smithi012.stdout:9/678: mkdir d0/df/d8d/dcb/d25/d2f/de3 0 2023-10-21T17:19:30.918 INFO:tasks.workunit.client.0.smithi012.stdout:4/772: mkdir dc/d93/d99/d104 0 2023-10-21T17:19:30.919 INFO:tasks.workunit.client.0.smithi012.stdout:4/773: chown dc/d93/f5a 22797 1 2023-10-21T17:19:31.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/721: symlink d13/d15/lfb 0 2023-10-21T17:19:31.245 INFO:tasks.workunit.client.0.smithi012.stdout:0/826: creat d7/d55/d23/dce/f138 x:0 0 0 2023-10-21T17:19:31.503 INFO:tasks.workunit.client.0.smithi012.stdout:1/813: truncate d5/d32/d1b/d35/d3a/d93/fa7 550372 0 2023-10-21T17:19:31.503 INFO:tasks.workunit.client.0.smithi012.stdout:1/814: write d5/fbb [572403,75042] 0 2023-10-21T17:19:31.504 INFO:tasks.workunit.client.0.smithi012.stdout:8/651: rename d0/d12/d80/d71 to d0/d1a/db0/db7/dd8/dda 0 2023-10-21T17:19:31.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/652: dwrite d0/fb [0,4194304] 0 2023-10-21T17:19:31.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/653: dread - d0/d62/fd1 zero size 2023-10-21T17:19:31.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/654: dread - d0/d62/f76 zero size 2023-10-21T17:19:32.442 INFO:tasks.workunit.client.0.smithi012.stdout:6/722: truncate d13/d29/d78/f94 387734 0 2023-10-21T17:19:32.444 INFO:tasks.workunit.client.0.smithi012.stdout:1/815: stat d5/d32/d1b/d27/d47/de9/cf8 0 2023-10-21T17:19:32.444 INFO:tasks.workunit.client.0.smithi012.stdout:2/809: rename d1/d14/d17/l1d to d1/de7/l10c 0 2023-10-21T17:19:32.544 INFO:tasks.workunit.client.0.smithi012.stdout:0/827: dwrite d7/d55/f22 [0,4194304] 0 2023-10-21T17:19:32.679 INFO:tasks.workunit.client.0.smithi012.stdout:8/655: truncate d0/d29/d79/f97 1538591 0 2023-10-21T17:19:33.001 INFO:tasks.workunit.client.0.smithi012.stdout:6/723: dread d13/d15/d1d/d28/f8f [0,4194304] 0 2023-10-21T17:19:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/724: dwrite d13/d15/d1d/d28/fa8 [0,4194304] 0 2023-10-21T17:19:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/725: chown d13/d15/d1d/d5d/d66/d70 18 1 2023-10-21T17:19:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/700: rename d0/f4 to d0/d96/fcf 0 2023-10-21T17:19:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:7/787: rename d3/d6/dc/d19/d1e/d9d to d3/d6/dc/d19/d1e/d9d/dec/dfa 22 2023-10-21T17:19:33.223 INFO:tasks.workunit.client.0.smithi012.stdout:2/810: mkdir d1/d14/d17/da6/dd0/d10d 0 2023-10-21T17:19:33.357 INFO:tasks.workunit.client.0.smithi012.stdout:1/816: creat d5/d32/d1b/d27/d86/f115 x:0 0 0 2023-10-21T17:19:33.362 INFO:tasks.workunit.client.0.smithi012.stdout:1/817: read d5/d32/d1b/d35/d3a/d5c/f85 [147838,43866] 0 2023-10-21T17:19:33.362 INFO:tasks.workunit.client.0.smithi012.stdout:1/818: truncate d5/d26/f112 397858 0 2023-10-21T17:19:33.383 INFO:tasks.workunit.client.0.smithi012.stdout:1/819: dread d5/d30/d51/fb4 [0,4194304] 0 2023-10-21T17:19:34.087 INFO:tasks.workunit.client.0.smithi012.stdout:8/656: mkdir d0/d12/d6c/ddb 0 2023-10-21T17:19:34.527 INFO:tasks.workunit.client.0.smithi012.stdout:7/788: mknod d3/d6/dc/d19/d1e/d34/cfb 0 2023-10-21T17:19:34.528 INFO:tasks.workunit.client.0.smithi012.stdout:7/789: write d3/da7/daf/dcd/fe4 [744956,128772] 0 2023-10-21T17:19:34.845 INFO:tasks.workunit.client.0.smithi012.stdout:2/811: mknod d1/d14/d16/d58/dec/da5/d34/dc2/dd9/c10e 0 2023-10-21T17:19:34.846 INFO:tasks.workunit.client.0.smithi012.stdout:2/812: truncate d1/d4/d65/dea/d5f/f109 266289 0 2023-10-21T17:19:34.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/820: mkdir d5/d32/d1b/d35/d116 0 2023-10-21T17:19:35.280 INFO:tasks.workunit.client.0.smithi012.stdout:0/828: truncate d7/d55/f14 3937336 0 2023-10-21T17:19:35.280 INFO:tasks.workunit.client.0.smithi012.stdout:8/657: mknod d0/d29/cdc 0 2023-10-21T17:19:35.300 INFO:tasks.workunit.client.0.smithi012.stdout:3/701: mkdir d0/d32/dd0 0 2023-10-21T17:19:35.487 INFO:tasks.workunit.client.0.smithi012.stdout:6/726: rename d13/d29/d37/d3b/de2 to d13/d29/d37/dfc 0 2023-10-21T17:19:35.487 INFO:tasks.workunit.client.0.smithi012.stdout:6/727: readlink d13/d42/d89/lb4 0 2023-10-21T17:19:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:7/790: creat d3/dd9/ffc x:0 0 0 2023-10-21T17:19:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:2/813: mkdir d1/d14/d17/db9/dd6/d10f 0 2023-10-21T17:19:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:2/814: creat d1/d4/d65/dea/d5f/f110 x:0 0 0 2023-10-21T17:19:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:2/815: readlink d1/d14/d16/d58/dec/d82/d86/la8 0 2023-10-21T17:19:35.980 INFO:tasks.workunit.client.0.smithi012.stdout:7/791: dread d3/d16/f67 [0,4194304] 0 2023-10-21T17:19:36.084 INFO:tasks.workunit.client.0.smithi012.stdout:2/816: dwrite d1/d14/d16/d58/dec/da5/d50/f54 [0,4194304] 0 2023-10-21T17:19:36.099 INFO:tasks.workunit.client.0.smithi012.stdout:1/821: symlink d5/d32/d1b/d27/dfb/l117 0 2023-10-21T17:19:36.296 INFO:tasks.workunit.client.0.smithi012.stdout:0/829: dwrite d7/d55/da2/f10a [0,4194304] 0 2023-10-21T17:19:36.296 INFO:tasks.workunit.client.0.smithi012.stdout:0/830: write d7/d55/d23/d27/dc6/f128 [994612,43332] 0 2023-10-21T17:19:36.296 INFO:tasks.workunit.client.0.smithi012.stdout:0/831: creat d7/d55/da2/f139 x:0 0 0 2023-10-21T17:19:36.297 INFO:tasks.workunit.client.0.smithi012.stdout:0/832: creat d7/d55/d23/d27/dcf/f13a x:0 0 0 2023-10-21T17:19:36.516 INFO:tasks.workunit.client.0.smithi012.stdout:8/658: rename d0/l47 to d0/d62/d83/d4e/ldd 0 2023-10-21T17:19:36.517 INFO:tasks.workunit.client.0.smithi012.stdout:8/659: dread - d0/d1a/db0/db7/dd8/dda/f8c zero size 2023-10-21T17:19:36.750 INFO:tasks.workunit.client.0.smithi012.stdout:6/728: mkdir d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd 0 2023-10-21T17:19:36.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/729: dwrite d13/d42/d89/db8/d9f/fea [0,4194304] 0 2023-10-21T17:19:36.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/730: chown d13/d42/d71 479 1 2023-10-21T17:19:36.879 INFO:tasks.workunit.client.0.smithi012.stdout:6/731: dwrite d13/d15/d1d/d28/d5b/d75/ff3 [0,4194304] 0 2023-10-21T17:19:37.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/817: dread d1/d14/d17/f24 [0,4194304] 0 2023-10-21T17:19:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:2/818: fsync d1/d14/d16/d58/dec/d82/d86/fd5 0 2023-10-21T17:19:37.242 INFO:tasks.workunit.client.0.smithi012.stdout:2/819: truncate d1/d4/d93/fa7 1879976 0 2023-10-21T17:19:37.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:19:37.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:19:37.791 INFO:tasks.workunit.client.0.smithi012.stdout:0/833: unlink d7/d55/d1f/l127 0 2023-10-21T17:19:37.999 INFO:tasks.workunit.client.0.smithi012.stdout:7/792: rename d3/d29/f27 to d3/d6/dc/d19/d1e/d34/da8/db4/dce/ffd 0 2023-10-21T17:19:38.022 INFO:tasks.workunit.client.0.smithi012.stdout:7/793: dread d3/d6/dc/d19/d1e/d9d/fb0 [0,4194304] 0 2023-10-21T17:19:38.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/679: write d0/fb0 [228157,104359] 0 2023-10-21T17:19:38.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/680: write d0/d4/d4b/d6a/d89/dbb/fca [1092534,53386] 0 2023-10-21T17:19:39.526 INFO:tasks.workunit.client.0.smithi012.stdout:2/820: readlink d1/d14/l38 0 2023-10-21T17:19:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:2/821: write d1/d8/f51 [3292118,21633] 0 2023-10-21T17:19:39.553 INFO:tasks.workunit.client.0.smithi012.stdout:2/822: chown d1/d8/f10 588063 1 2023-10-21T17:19:39.778 INFO:tasks.workunit.client.0.smithi012.stdout:3/702: symlink d0/d96/da0/ld1 0 2023-10-21T17:19:39.778 INFO:tasks.workunit.client.0.smithi012.stdout:3/703: chown d0/d32/d43/l65 1 1 2023-10-21T17:19:39.779 INFO:tasks.workunit.client.0.smithi012.stdout:3/704: stat d0/d82/faf 0 2023-10-21T17:19:40.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/660: unlink d0/c13 0 2023-10-21T17:19:40.305 INFO:tasks.workunit.client.0.smithi012.stdout:5/715: rmdir d2/d4f 39 2023-10-21T17:19:40.305 INFO:tasks.workunit.client.0.smithi012.stdout:5/716: fdatasync d2/fe1 0 2023-10-21T17:19:40.306 INFO:tasks.workunit.client.0.smithi012.stdout:4/774: sync 2023-10-21T17:19:40.343 INFO:tasks.workunit.client.0.smithi012.stdout:9/681: dread d0/d4/d4b/fde [0,4194304] 0 2023-10-21T17:19:40.551 INFO:tasks.workunit.client.0.smithi012.stdout:6/732: link d13/d15/f21 d13/d64/d6d/d73/ffe 0 2023-10-21T17:19:41.265 INFO:tasks.workunit.client.0.smithi012.stdout:2/823: getdents d1/d4/d65 0 2023-10-21T17:19:41.469 INFO:tasks.workunit.client.0.smithi012.stdout:1/822: mknod d5/d26/d64/d8f/da0/c118 0 2023-10-21T17:19:41.469 INFO:tasks.workunit.client.0.smithi012.stdout:3/705: truncate d0/d32/f90 3439335 0 2023-10-21T17:19:41.519 INFO:tasks.workunit.client.0.smithi012.stdout:9/682: rmdir d0/df/d8d/dcb/d25/d39/d3b 39 2023-10-21T17:19:41.519 INFO:tasks.workunit.client.0.smithi012.stdout:9/683: truncate d0/d4/d4b/d6a/d89/dbb/fca 2106261 0 2023-10-21T17:19:41.990 INFO:tasks.workunit.client.0.smithi012.stdout:6/733: symlink d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/lff 0 2023-10-21T17:19:42.690 INFO:tasks.workunit.client.0.smithi012.stdout:1/823: truncate d5/d32/d1b/d2c/d4b/f90 3647066 0 2023-10-21T17:19:42.691 INFO:tasks.workunit.client.0.smithi012.stdout:8/661: truncate d0/d12/d6c/db1/fbd 2838776 0 2023-10-21T17:19:42.837 INFO:tasks.workunit.client.0.smithi012.stdout:3/706: getdents d0/d32/d43/d47 0 2023-10-21T17:19:43.029 INFO:tasks.workunit.client.0.smithi012.stdout:4/775: getdents dc/d15/d2a/d31 0 2023-10-21T17:19:43.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/776: dwrite dc/d15/d18/d4c/d75/fcd [4194304,4194304] 0 2023-10-21T17:19:43.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/777: write dc/d15/d18/d57/fcf [5473195,55480] 0 2023-10-21T17:19:43.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/778: creat dc/d15/d18/d4c/d75/f105 x:0 0 0 2023-10-21T17:19:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:1/824: mknod d5/d26/d54/d101/c119 0 2023-10-21T17:19:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:1/825: creat d5/d32/d1b/d2c/d4b/d8a/f11a x:0 0 0 2023-10-21T17:19:44.443 INFO:tasks.workunit.client.0.smithi012.stdout:3/707: mknod d0/d32/d43/d47/d50/d52/cd2 0 2023-10-21T17:19:44.547 INFO:tasks.workunit.client.0.smithi012.stdout:3/708: dwrite d0/d32/d43/d47/d50/f8d [0,4194304] 0 2023-10-21T17:19:44.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/779: truncate dc/d15/d2a/d31/fb6 2830452 0 2023-10-21T17:19:44.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/780: dread dc/d1e/d6e/f84 [0,4194304] 0 2023-10-21T17:19:44.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/781: write dc/d1e/f9f [327741,125335] 0 2023-10-21T17:19:45.557 INFO:tasks.workunit.client.0.smithi012.stdout:3/709: dread d0/d32/d43/d47/d50/d52/f76 [0,4194304] 0 2023-10-21T17:19:45.558 INFO:tasks.workunit.client.0.smithi012.stdout:3/710: chown d0/d1c/f60 1578265 1 2023-10-21T17:19:45.856 INFO:tasks.workunit.client.0.smithi012.stdout:8/662: rename d0/d62/d7d/da3 to d0/d29/dde 0 2023-10-21T17:19:45.857 INFO:tasks.workunit.client.0.smithi012.stdout:8/663: write d0/d1a/f41 [1395712,101789] 0 2023-10-21T17:19:45.903 INFO:tasks.workunit.client.0.smithi012.stdout:8/664: dread d0/d62/d83/d4e/f55 [0,4194304] 0 2023-10-21T17:19:45.903 INFO:tasks.workunit.client.0.smithi012.stdout:8/665: write d0/d1a/db0/db7/dd8/dda/fc4 [1001624,113565] 0 2023-10-21T17:19:45.965 INFO:tasks.workunit.client.0.smithi012.stdout:8/666: dwrite d0/d12/d6c/db1/fba [0,4194304] 0 2023-10-21T17:19:45.987 INFO:tasks.workunit.client.0.smithi012.stdout:3/711: symlink d0/d9d/dba/ld3 0 2023-10-21T17:19:46.317 INFO:tasks.workunit.client.0.smithi012.stdout:4/782: getdents dc/d1e/d33 0 2023-10-21T17:19:47.070 INFO:tasks.workunit.client.0.smithi012.stdout:8/667: rmdir d0/d62/d83/d4e 39 2023-10-21T17:19:47.070 INFO:tasks.workunit.client.0.smithi012.stdout:3/712: mkdir d0/d32/d43/d47/dd4 0 2023-10-21T17:19:47.259 INFO:tasks.workunit.client.0.smithi012.stdout:4/783: chown dc/lb7 31556469 1 2023-10-21T17:19:47.260 INFO:tasks.workunit.client.0.smithi012.stdout:4/784: write dc/d1e/f9f [1283949,97041] 0 2023-10-21T17:19:47.356 INFO:tasks.workunit.client.0.smithi012.stdout:4/785: dwrite dc/d15/d18/d4c/fdf [0,4194304] 0 2023-10-21T17:19:47.435 INFO:tasks.workunit.client.0.smithi012.stdout:8/668: stat d0/d46/c88 0 2023-10-21T17:19:47.449 INFO:tasks.workunit.client.0.smithi012.stdout:4/786: dwrite dc/d93/f46 [0,4194304] 0 2023-10-21T17:19:47.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/669: creat d0/d62/d7d/fdf x:0 0 0 2023-10-21T17:19:47.885 INFO:tasks.workunit.client.0.smithi012.stdout:8/670: write d0/d1a/f41 [212346,18855] 0 2023-10-21T17:19:47.892 INFO:tasks.workunit.client.0.smithi012.stdout:8/671: fdatasync d0/d1a/db0/db7/dd8/dda/fc4 0 2023-10-21T17:19:47.989 INFO:tasks.workunit.client.0.smithi012.stdout:8/672: dwrite d0/f4f [0,4194304] 0 2023-10-21T17:19:48.071 INFO:tasks.workunit.client.0.smithi012.stdout:4/787: link dc/d15/d18/d4c/fdf dc/d1e/dc7/f106 0 2023-10-21T17:19:48.094 INFO:tasks.workunit.client.0.smithi012.stdout:4/788: write dc/d1e/d33/f52 [914546,107241] 0 2023-10-21T17:19:48.094 INFO:tasks.workunit.client.0.smithi012.stdout:4/789: dread - dc/d1e/d33/d8a/fed zero size 2023-10-21T17:19:48.484 INFO:tasks.workunit.client.0.smithi012.stdout:3/713: dread d0/d32/d43/d47/d50/d52/f5d [0,4194304] 0 2023-10-21T17:19:48.484 INFO:tasks.workunit.client.0.smithi012.stdout:3/714: stat d0/d32/d43/d47/d50/d52/f76 0 2023-10-21T17:19:48.486 INFO:tasks.workunit.client.0.smithi012.stdout:5/717: write d2/d4f/d7e/d87/d57/d66/f7f [479878,32774] 0 2023-10-21T17:19:48.594 INFO:tasks.workunit.client.0.smithi012.stdout:8/673: link d0/d62/f8d d0/d1a/db0/fe0 0 2023-10-21T17:19:48.595 INFO:tasks.workunit.client.0.smithi012.stdout:8/674: fsync d0/d29/f7a 0 2023-10-21T17:19:48.595 INFO:tasks.workunit.client.0.smithi012.stdout:8/675: dread - d0/f8f zero size 2023-10-21T17:19:48.595 INFO:tasks.workunit.client.0.smithi012.stdout:8/676: stat d0/d62/d83/d4e/c70 0 2023-10-21T17:19:48.926 INFO:tasks.workunit.client.0.smithi012.stdout:4/790: rename dc/d1e/fad to dc/d15/d2a/d58/df8/dfa/f107 0 2023-10-21T17:19:49.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/715: creat d0/d32/dd0/fd5 x:0 0 0 2023-10-21T17:19:49.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/716: dread - d0/d96/d97/fb7 zero size 2023-10-21T17:19:49.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/718: mkdir d2/d4f/d59/d5b/d15/de2 0 2023-10-21T17:19:49.524 INFO:tasks.workunit.client.0.smithi012.stdout:8/677: truncate d0/d12/f2b 585564 0 2023-10-21T17:19:49.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/719: readlink d2/d4f/d7e/d87/d57/dc7/dd0/lf 0 2023-10-21T17:19:49.525 INFO:tasks.workunit.client.0.smithi012.stdout:8/678: read - d0/d62/fd1 zero size 2023-10-21T17:19:49.525 INFO:tasks.workunit.client.0.smithi012.stdout:8/679: creat d0/d1a/d54/fe1 x:0 0 0 2023-10-21T17:19:49.525 INFO:tasks.workunit.client.0.smithi012.stdout:8/680: creat d0/d12/d6a/fe2 x:0 0 0 2023-10-21T17:19:49.648 INFO:tasks.workunit.client.0.smithi012.stdout:4/791: write dc/d15/d18/d57/fcf [5169077,10126] 0 2023-10-21T17:19:49.884 INFO:tasks.workunit.client.0.smithi012.stdout:3/717: dwrite d0/da/d28/f40 [4194304,4194304] 0 2023-10-21T17:19:49.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/718: dread d0/d32/d43/d47/d50/d52/f76 [0,4194304] 0 2023-10-21T17:19:49.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/719: fsync d0/da/f86 0 2023-10-21T17:19:49.932 INFO:tasks.workunit.client.0.smithi012.stdout:5/720: mkdir d2/d4f/d7e/d87/d57/dc7/dd0/de3 0 2023-10-21T17:19:49.932 INFO:tasks.workunit.client.0.smithi012.stdout:5/721: chown d2/fe1 3699603 1 2023-10-21T17:19:49.933 INFO:tasks.workunit.client.0.smithi012.stdout:5/722: truncate d2/d4f/d59/d5b/f77 444785 0 2023-10-21T17:19:50.220 INFO:tasks.workunit.client.0.smithi012.stdout:2/824: write d1/d14/d16/f72 [2218346,10524] 0 2023-10-21T17:19:50.393 INFO:tasks.workunit.client.0.smithi012.stdout:5/723: creat d2/d4f/d7e/d87/d57/dc7/dd0/de3/fe4 x:0 0 0 2023-10-21T17:19:50.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/681: creat d0/d62/d83/d72/fe3 x:0 0 0 2023-10-21T17:19:50.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/682: dread - d0/d1a/fc1 zero size 2023-10-21T17:19:50.586 INFO:tasks.workunit.client.0.smithi012.stdout:8/683: write d0/d29/d79/fb6 [3055844,12774] 0 2023-10-21T17:19:50.587 INFO:tasks.workunit.client.0.smithi012.stdout:8/684: dread - d0/d1a/d54/fe1 zero size 2023-10-21T17:19:50.621 INFO:tasks.workunit.client.0.smithi012.stdout:8/685: dread d0/d1a/f24 [0,4194304] 0 2023-10-21T17:19:50.635 INFO:tasks.workunit.client.0.smithi012.stdout:2/825: dread d1/d4/d93/fa7 [0,4194304] 0 2023-10-21T17:19:50.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/826: write d1/d14/d16/d58/dec/ff4 [947982,58602] 0 2023-10-21T17:19:50.668 INFO:tasks.workunit.client.0.smithi012.stdout:8/686: write d0/f35 [5208986,2107] 0 2023-10-21T17:19:50.669 INFO:tasks.workunit.client.0.smithi012.stdout:8/687: chown d0/d62/d83/c61 335938161 1 2023-10-21T17:19:50.669 INFO:tasks.workunit.client.0.smithi012.stdout:8/688: write d0/d1a/db0/dca/fd5 [302182,4460] 0 2023-10-21T17:19:50.669 INFO:tasks.workunit.client.0.smithi012.stdout:8/689: fdatasync d0/d1a/d54/f5f 0 2023-10-21T17:19:50.669 INFO:tasks.workunit.client.0.smithi012.stdout:8/690: truncate d0/d29/d79/fb6 4548553 0 2023-10-21T17:19:50.676 INFO:tasks.workunit.client.0.smithi012.stdout:2/827: write d1/d14/d17/da6/fed [3704474,25017] 0 2023-10-21T17:19:51.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/826: write d5/d32/d1b/d35/d3a/d93/fa7 [1146240,99370] 0 2023-10-21T17:19:51.121 INFO:tasks.workunit.client.0.smithi012.stdout:5/724: symlink d2/d4f/d7e/d87/dce/le5 0 2023-10-21T17:19:51.219 INFO:tasks.workunit.client.0.smithi012.stdout:0/834: unlink d7/f98 0 2023-10-21T17:19:51.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/835: chown d7/d55/d23/d30/c122 6591661 1 2023-10-21T17:19:51.781 INFO:tasks.workunit.client.0.smithi012.stdout:8/691: link d0/d1a/fd9 d0/d62/d83/d4e/fe4 0 2023-10-21T17:19:51.782 INFO:tasks.workunit.client.0.smithi012.stdout:2/828: creat d1/d4/d3f/f111 x:0 0 0 2023-10-21T17:19:51.839 INFO:tasks.workunit.client.0.smithi012.stdout:8/692: dwrite d0/f90 [0,4194304] 0 2023-10-21T17:19:51.839 INFO:tasks.workunit.client.0.smithi012.stdout:8/693: truncate d0/d29/dde/fc2 250241 0 2023-10-21T17:19:51.839 INFO:tasks.workunit.client.0.smithi012.stdout:8/694: write d0/d62/fd1 [231324,54464] 0 2023-10-21T17:19:51.929 INFO:tasks.workunit.client.0.smithi012.stdout:8/695: dwrite d0/d1a/f1d [0,4194304] 0 2023-10-21T17:19:51.929 INFO:tasks.workunit.client.0.smithi012.stdout:8/696: fdatasync d0/d29/d79/fa8 0 2023-10-21T17:19:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:1/827: symlink d5/d32/d1b/d35/d3a/d5c/d7c/db7/l11b 0 2023-10-21T17:19:52.217 INFO:tasks.workunit.client.0.smithi012.stdout:5/725: dwrite d2/d4f/d7e/d87/d57/d66/daa/fb2 [0,4194304] 0 2023-10-21T17:19:52.217 INFO:tasks.workunit.client.0.smithi012.stdout:5/726: chown d2/d4f/d7e/d87/l2f 29 1 2023-10-21T17:19:52.241 INFO:tasks.workunit.client.0.smithi012.stdout:5/727: write d2/d2c/d73/d49/da9/fcb [184722,89197] 0 2023-10-21T17:19:52.476 INFO:tasks.workunit.client.0.smithi012.stdout:2/829: rename d1/d14/d17/da6/cd8 to d1/d14/d17/da6/c112 0 2023-10-21T17:19:52.830 INFO:tasks.workunit.client.0.smithi012.stdout:8/697: creat d0/d62/d83/d4e/dc5/fe5 x:0 0 0 2023-10-21T17:19:52.837 INFO:tasks.workunit.client.0.smithi012.stdout:8/698: write d0/d1a/db0/db7/dd8/dda/fcb [413919,12880] 0 2023-10-21T17:19:52.911 INFO:tasks.workunit.client.0.smithi012.stdout:8/699: dwrite d0/d62/f73 [4194304,4194304] 0 2023-10-21T17:19:52.911 INFO:tasks.workunit.client.0.smithi012.stdout:8/700: write d0/d62/d83/d72/fe3 [514369,26365] 0 2023-10-21T17:19:52.912 INFO:tasks.workunit.client.0.smithi012.stdout:8/701: creat d0/d12/d6c/db1/fe6 x:0 0 0 2023-10-21T17:19:53.021 INFO:tasks.workunit.client.0.smithi012.stdout:1/828: link d5/d32/d1b/d2c/d4b/f5d d5/d32/d1b/d27/d47/f11c 0 2023-10-21T17:19:53.021 INFO:tasks.workunit.client.0.smithi012.stdout:1/829: getdents d5/d32/d1b/d35/d116 0 2023-10-21T17:19:53.279 INFO:tasks.workunit.client.0.smithi012.stdout:0/836: symlink d7/d55/d23/dce/ddc/d114/d48/de2/l13b 0 2023-10-21T17:19:54.254 INFO:tasks.workunit.client.0.smithi012.stdout:8/702: unlink d0/d12/d80/f67 0 2023-10-21T17:19:54.482 INFO:tasks.workunit.client.0.smithi012.stdout:1/830: link d5/d32/d1b/d2c/d4b/f90 d5/d26/da3/f11d 0 2023-10-21T17:19:54.483 INFO:tasks.workunit.client.0.smithi012.stdout:1/831: write d5/d32/d1b/d2c/d48/f10e [134035,127902] 0 2023-10-21T17:19:54.483 INFO:tasks.workunit.client.0.smithi012.stdout:1/832: chown d5/d32/d1b/l25 274 1 2023-10-21T17:19:54.572 INFO:tasks.workunit.client.0.smithi012.stdout:1/833: dwrite d5/d26/d64/d8f/dd6/ff6 [0,4194304] 0 2023-10-21T17:19:54.572 INFO:tasks.workunit.client.0.smithi012.stdout:1/834: fsync d5/d32/d1b/d35/d3a/d93/fc0 0 2023-10-21T17:19:54.572 INFO:tasks.workunit.client.0.smithi012.stdout:1/835: readlink d5/d32/d1b/l25 0 2023-10-21T17:19:54.573 INFO:tasks.workunit.client.0.smithi012.stdout:1/836: read d5/d32/d1b/d27/d21/f31 [974158,102458] 0 2023-10-21T17:19:54.580 INFO:tasks.workunit.client.0.smithi012.stdout:1/837: read d5/d32/d62/fcc [646898,64621] 0 2023-10-21T17:19:55.183 INFO:tasks.workunit.client.0.smithi012.stdout:9/684: creat d0/fe4 x:0 0 0 2023-10-21T17:19:55.590 INFO:tasks.workunit.client.0.smithi012.stdout:7/794: creat d3/d6/ffe x:0 0 0 2023-10-21T17:19:55.591 INFO:tasks.workunit.client.0.smithi012.stdout:7/795: chown d3/d6/d73/c9a 2018 1 2023-10-21T17:19:55.591 INFO:tasks.workunit.client.0.smithi012.stdout:7/796: readlink d3/dd9/d9c/la1 0 2023-10-21T17:19:55.591 INFO:tasks.workunit.client.0.smithi012.stdout:7/797: dread - d3/d6/dc/d19/d1e/d9d/dda/ff4 zero size 2023-10-21T17:19:56.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/703: symlink d0/d12/d80/le7 0 2023-10-21T17:19:56.725 INFO:tasks.workunit.client.0.smithi012.stdout:7/798: creat d3/d6/dc/d19/fff x:0 0 0 2023-10-21T17:19:56.943 INFO:tasks.workunit.client.0.smithi012.stdout:8/704: symlink d0/d62/d83/d4e/le8 0 2023-10-21T17:19:57.160 INFO:tasks.workunit.client.0.smithi012.stdout:9/685: mkdir d0/df/d8d/dcb/d25/d2f/de5 0 2023-10-21T17:19:57.160 INFO:tasks.workunit.client.0.smithi012.stdout:9/686: dread - d0/f6b zero size 2023-10-21T17:19:57.161 INFO:tasks.workunit.client.0.smithi012.stdout:9/687: dread - d0/d4/d4b/d6a/fd0 zero size 2023-10-21T17:19:57.248 INFO:tasks.workunit.client.0.smithi012.stdout:9/688: dwrite d0/d15/faa [0,4194304] 0 2023-10-21T17:19:57.275 INFO:tasks.workunit.client.0.smithi012.stdout:9/689: read d0/f85 [3062055,91186] 0 2023-10-21T17:19:57.398 INFO:tasks.workunit.client.0.smithi012.stdout:7/799: creat d3/d6/dc/d19/d1e/d9d/dda/f100 x:0 0 0 2023-10-21T17:19:57.465 INFO:tasks.workunit.client.0.smithi012.stdout:8/705: rename d0/d62/d83/d4e/le8 to d0/d12/d6a/le9 0 2023-10-21T17:19:57.499 INFO:tasks.workunit.client.0.smithi012.stdout:7/800: dwrite d3/d6/dc/d19/d1e/d34/fd5 [0,4194304] 0 2023-10-21T17:19:58.182 INFO:tasks.workunit.client.0.smithi012.stdout:7/801: symlink d3/d6/dc/d19/d1e/d34/da8/l101 0 2023-10-21T17:19:58.203 INFO:tasks.workunit.client.0.smithi012.stdout:3/720: write d0/d32/d43/d47/f48 [2108541,68550] 0 2023-10-21T17:19:58.204 INFO:tasks.workunit.client.0.smithi012.stdout:3/721: write d0/da/fe [4706264,87657] 0 2023-10-21T17:19:58.271 INFO:tasks.workunit.client.0.smithi012.stdout:3/722: dwrite d0/d96/d97/fb7 [0,4194304] 0 2023-10-21T17:19:58.447 INFO:tasks.workunit.client.0.smithi012.stdout:7/802: mkdir d3/d6/d73/d8e/d102 0 2023-10-21T17:19:58.551 INFO:tasks.workunit.client.0.smithi012.stdout:7/803: dwrite d3/d6/dc/d19/d1e/d34/da8/db4/dce/fe2 [0,4194304] 0 2023-10-21T17:19:58.579 INFO:tasks.workunit.client.0.smithi012.stdout:7/804: dread d3/d29/f11 [4194304,4194304] 0 2023-10-21T17:19:58.897 INFO:tasks.workunit.client.0.smithi012.stdout:3/723: dread d0/da/d28/f3c [0,4194304] 0 2023-10-21T17:19:58.952 INFO:tasks.workunit.client.0.smithi012.stdout:3/724: dwrite d0/da/d28/f40 [0,4194304] 0 2023-10-21T17:19:59.035 INFO:tasks.workunit.client.0.smithi012.stdout:3/725: dwrite d0/d1c/f5a [4194304,4194304] 0 2023-10-21T17:19:59.699 INFO:tasks.workunit.client.0.smithi012.stdout:2/830: rmdir d1/d14/d17/da6 39 2023-10-21T17:19:59.728 INFO:tasks.workunit.client.0.smithi012.stdout:4/792: unlink l2 0 2023-10-21T17:19:59.824 INFO:tasks.workunit.client.0.smithi012.stdout:4/793: dwrite dc/d15/d2a/d58/df8/f102 [0,4194304] 0 2023-10-21T17:19:59.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/838: fsync d5/d32/d1b/d2c/d4b/f5d 0 2023-10-21T17:19:59.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/839: chown d5/d32/d1b/cd0 0 1 2023-10-21T17:19:59.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/840: fsync d5/d32/d1b/d35/d3a/d93/fc0 0 2023-10-21T17:20:00.282 INFO:tasks.workunit.client.0.smithi012.stdout:2/831: creat d1/d14/d17/d8a/dda/f113 x:0 0 0 2023-10-21T17:20:00.376 INFO:tasks.workunit.client.0.smithi012.stdout:2/832: dwrite d1/d14/d16/f75 [0,4194304] 0 2023-10-21T17:20:00.537 INFO:tasks.workunit.client.0.smithi012.stdout:4/794: creat dc/d15/d2a/d31/df3/f108 x:0 0 0 2023-10-21T17:20:00.989 INFO:tasks.workunit.client.0.smithi012.stdout:1/841: dread d5/d32/d1b/d2c/d48/f10e [0,4194304] 0 2023-10-21T17:20:00.998 INFO:tasks.workunit.client.0.smithi012.stdout:3/726: mkdir d0/d32/d43/d47/dd6 0 2023-10-21T17:20:01.034 INFO:tasks.workunit.client.0.smithi012.stdout:0/837: write d7/d55/f5a [1149271,92706] 0 2023-10-21T17:20:01.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/838: chown d7/d81/lf1 503 1 2023-10-21T17:20:01.045 INFO:tasks.workunit.client.0.smithi012.stdout:5/728: truncate d2/d4f/d7e/d87/d57/d66/f7f 700085 0 2023-10-21T17:20:01.510 INFO:tasks.workunit.client.0.smithi012.stdout:2/833: unlink d1/c64 0 2023-10-21T17:20:01.511 INFO:tasks.workunit.client.0.smithi012.stdout:1/842: creat d5/d32/d1b/d35/d49/f11e x:0 0 0 2023-10-21T17:20:01.511 INFO:tasks.workunit.client.0.smithi012.stdout:1/843: write d5/d32/d1b/d27/d21/f31 [94031,88028] 0 2023-10-21T17:20:01.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/844: stat d5/d30/d51/fb4 0 2023-10-21T17:20:01.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/845: fsync d5/d32/d1b/d35/d3a/d93/fed 0 2023-10-21T17:20:01.530 INFO:tasks.workunit.client.0.smithi012.stdout:1/846: dread d5/d26/d54/f63 [0,4194304] 0 2023-10-21T17:20:01.822 INFO:tasks.workunit.client.0.smithi012.stdout:0/839: mkdir d7/d55/d1f/d13c 0 2023-10-21T17:20:02.189 INFO:tasks.workunit.client.0.smithi012.stdout:5/729: creat d2/d2c/d73/d49/fe6 x:0 0 0 2023-10-21T17:20:02.189 INFO:tasks.workunit.client.0.smithi012.stdout:5/730: chown l1 0 1 2023-10-21T17:20:02.190 INFO:tasks.workunit.client.0.smithi012.stdout:4/795: creat dc/d1e/da7/f109 x:0 0 0 2023-10-21T17:20:02.213 INFO:tasks.workunit.client.0.smithi012.stdout:2/834: creat d1/d4/d3f/f114 x:0 0 0 2023-10-21T17:20:02.213 INFO:tasks.workunit.client.0.smithi012.stdout:2/835: dread - d1/d14/d16/d58/dec/da5/d50/da3/fd3 zero size 2023-10-21T17:20:02.229 INFO:tasks.workunit.client.0.smithi012.stdout:2/836: dread d1/d14/d16/d58/dec/da5/d50/f68 [0,4194304] 0 2023-10-21T17:20:02.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/837: stat d1/d8/f2d 0 2023-10-21T17:20:02.247 INFO:tasks.workunit.client.0.smithi012.stdout:3/727: symlink d0/d96/da0/ld7 0 2023-10-21T17:20:02.596 INFO:tasks.workunit.client.0.smithi012.stdout:5/731: creat d2/d4f/d7e/daf/fe7 x:0 0 0 2023-10-21T17:20:02.789 INFO:tasks.workunit.client.0.smithi012.stdout:2/838: rename d1/d4/d65/dea/d5f/le0 to d1/d4/d93/l115 0 2023-10-21T17:20:02.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/734: sync 2023-10-21T17:20:02.980 INFO:tasks.workunit.client.0.smithi012.stdout:3/728: write d0/da/d28/f9e [211307,35316] 0 2023-10-21T17:20:03.149 INFO:tasks.workunit.client.0.smithi012.stdout:5/732: symlink d2/d2c/d73/d49/da9/le8 0 2023-10-21T17:20:03.448 INFO:tasks.workunit.client.0.smithi012.stdout:2/839: link d1/d14/d16/d58/dec/da5/f57 d1/d14/d16/d58/dec/da5/dbe/ddc/f116 0 2023-10-21T17:20:03.653 INFO:tasks.workunit.client.0.smithi012.stdout:6/735: symlink d13/d15/d1d/d5d/d66/l100 0 2023-10-21T17:20:03.654 INFO:tasks.workunit.client.0.smithi012.stdout:6/736: stat d13/d15/d1d/d5d/d66/f79 0 2023-10-21T17:20:03.654 INFO:tasks.workunit.client.0.smithi012.stdout:6/737: write d13/d15/d1d/d5d/d66/d7a/d97/fe4 [417451,65056] 0 2023-10-21T17:20:03.687 INFO:tasks.workunit.client.0.smithi012.stdout:3/729: rmdir d0/d32/d43/d47/d50/dcc 39 2023-10-21T17:20:03.726 INFO:tasks.workunit.client.0.smithi012.stdout:3/730: dread d0/d1c/f1e [4194304,4194304] 0 2023-10-21T17:20:04.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/840: truncate d1/d14/d16/d58/dec/da5/d34/f45 2324483 0 2023-10-21T17:20:04.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/841: chown d1/d95/faf 3 1 2023-10-21T17:20:04.416 INFO:tasks.workunit.client.0.smithi012.stdout:9/690: write d0/df/d8d/dcb/d25/d2f/d8c/f9a [1010943,116685] 0 2023-10-21T17:20:04.417 INFO:tasks.workunit.client.0.smithi012.stdout:9/691: write d0/df/d8d/dcb/d25/d39/d8e/fc2 [978593,113925] 0 2023-10-21T17:20:04.430 INFO:tasks.workunit.client.0.smithi012.stdout:7/805: write d3/d16/f56 [4813475,49985] 0 2023-10-21T17:20:04.430 INFO:tasks.workunit.client.0.smithi012.stdout:7/806: chown d3/d16/c92 6861 1 2023-10-21T17:20:04.461 INFO:tasks.workunit.client.0.smithi012.stdout:7/807: write d3/d16/f65 [1637238,62159] 0 2023-10-21T17:20:05.562 INFO:tasks.workunit.client.0.smithi012.stdout:3/731: mknod d0/d32/d43/d47/d50/dcc/cd8 0 2023-10-21T17:20:05.562 INFO:tasks.workunit.client.0.smithi012.stdout:3/732: dread - d0/d32/d43/fb9 zero size 2023-10-21T17:20:05.956 INFO:tasks.workunit.client.0.smithi012.stdout:9/692: rmdir d0/df/d8d/d8a 0 2023-10-21T17:20:05.957 INFO:tasks.workunit.client.0.smithi012.stdout:7/808: mknod d3/d16/c103 0 2023-10-21T17:20:05.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/693: creat d0/fe6 x:0 0 0 2023-10-21T17:20:05.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/694: read d0/f14 [2671745,13286] 0 2023-10-21T17:20:05.957 INFO:tasks.workunit.client.0.smithi012.stdout:7/809: write d3/da7/fd6 [586025,126643] 0 2023-10-21T17:20:05.958 INFO:tasks.workunit.client.0.smithi012.stdout:9/695: write d0/d15/f88 [4956659,112088] 0 2023-10-21T17:20:06.194 INFO:tasks.workunit.client.0.smithi012.stdout:3/733: unlink d0/d1c/f6a 0 2023-10-21T17:20:06.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/810: rename d3/d6/dc/d19/d1e/d34/cfb to d3/dd9/d9c/c104 0 2023-10-21T17:20:06.819 INFO:tasks.workunit.client.0.smithi012.stdout:7/811: dread d3/d16/f56 [0,4194304] 0 2023-10-21T17:20:06.820 INFO:tasks.workunit.client.0.smithi012.stdout:7/812: creat d3/d6/dc/d19/d1e/d34/da8/f105 x:0 0 0 2023-10-21T17:20:07.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/696: creat d0/d4/d4b/d6a/d89/de2/fe7 x:0 0 0 2023-10-21T17:20:07.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:20:07.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:20:07.822 INFO:tasks.workunit.client.0.smithi012.stdout:3/734: dread d0/da/d28/f38 [0,4194304] 0 2023-10-21T17:20:08.177 INFO:tasks.workunit.client.0.smithi012.stdout:1/847: write d5/d30/d51/f73 [181813,12175] 0 2023-10-21T17:20:08.522 INFO:tasks.workunit.client.0.smithi012.stdout:0/840: dwrite d7/d55/d1f/d28/d9b/d8a/f8f [0,4194304] 0 2023-10-21T17:20:08.556 INFO:tasks.workunit.client.0.smithi012.stdout:0/841: dread f6 [0,4194304] 0 2023-10-21T17:20:08.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/735: mknod d0/d96/da0/cd9 0 2023-10-21T17:20:09.128 INFO:tasks.workunit.client.0.smithi012.stdout:0/842: mkdir d7/d52/d90/d13d 0 2023-10-21T17:20:09.255 INFO:tasks.workunit.client.0.smithi012.stdout:3/736: creat d0/d32/d43/d47/dd6/fda x:0 0 0 2023-10-21T17:20:09.256 INFO:tasks.workunit.client.0.smithi012.stdout:3/737: chown d0/d32/d43/d47/d50/dcc/lcd 31956 1 2023-10-21T17:20:09.609 INFO:tasks.workunit.client.0.smithi012.stdout:0/843: rename d7/d55/d23/dce/ddc/d114/d82/l9f to d7/d55/d23/dce/ddc/l13e 0 2023-10-21T17:20:09.655 INFO:tasks.workunit.client.0.smithi012.stdout:4/796: link dc/d15/d18/l7d dc/l10a 0 2023-10-21T17:20:09.655 INFO:tasks.workunit.client.0.smithi012.stdout:4/797: creat dc/d15/d2a/d31/df3/f10b x:0 0 0 2023-10-21T17:20:09.739 INFO:tasks.workunit.client.0.smithi012.stdout:5/733: dwrite d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:20:09.926 INFO:tasks.workunit.client.0.smithi012.stdout:3/738: mknod d0/da/cdb 0 2023-10-21T17:20:10.018 INFO:tasks.workunit.client.0.smithi012.stdout:0/844: truncate d7/d55/d23/dce/ddc/d114/d63/fae 290311 0 2023-10-21T17:20:10.352 INFO:tasks.workunit.client.0.smithi012.stdout:4/798: mkdir dc/d28/d10c 0 2023-10-21T17:20:11.482 INFO:tasks.workunit.client.0.smithi012.stdout:0/845: symlink d7/d55/d1f/dfd/l13f 0 2023-10-21T17:20:11.685 INFO:tasks.workunit.client.0.smithi012.stdout:4/799: rename dc/d15/d2a/d31/l89 to dc/d93/d99/ddc/l10d 0 2023-10-21T17:20:12.491 INFO:tasks.workunit.client.0.smithi012.stdout:0/846: mknod d7/c140 0 2023-10-21T17:20:12.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/847: dread d7/d55/d1f/d28/fd4 [0,4194304] 0 2023-10-21T17:20:12.710 INFO:tasks.workunit.client.0.smithi012.stdout:4/800: unlink dc/d15/d18/d4c/d55/f7f 0 2023-10-21T17:20:12.710 INFO:tasks.workunit.client.0.smithi012.stdout:4/801: chown dc/d15/d18/d4c/d55/d6c/de6 1432 1 2023-10-21T17:20:12.710 INFO:tasks.workunit.client.0.smithi012.stdout:4/802: getdents dc/d28/d10c 0 2023-10-21T17:20:13.524 INFO:tasks.workunit.client.0.smithi012.stdout:4/803: read dc/d15/d18/d4c/d75/f7c [113057,104015] 0 2023-10-21T17:20:13.553 INFO:tasks.workunit.client.0.smithi012.stdout:1/848: write d5/d32/d1b/d27/f38 [1252159,69631] 0 2023-10-21T17:20:13.571 INFO:tasks.workunit.client.0.smithi012.stdout:1/849: dread d5/d32/d1b/d35/d3a/d93/fcf [0,4194304] 0 2023-10-21T17:20:13.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/697: dwrite d0/d4/d4b/f99 [0,4194304] 0 2023-10-21T17:20:13.697 INFO:tasks.workunit.client.0.smithi012.stdout:9/698: dwrite d0/d5/d9d/fb5 [0,4194304] 0 2023-10-21T17:20:13.698 INFO:tasks.workunit.client.0.smithi012.stdout:9/699: write d0/fe6 [395870,23491] 0 2023-10-21T17:20:13.729 INFO:tasks.workunit.client.0.smithi012.stdout:9/700: write d0/d15/f57 [1913797,13246] 0 2023-10-21T17:20:13.729 INFO:tasks.workunit.client.0.smithi012.stdout:9/701: readlink d0/df/l74 0 2023-10-21T17:20:14.005 INFO:tasks.workunit.client.0.smithi012.stdout:4/804: link dc/d6b/f9b dc/d15/d18/d4c/d55/d6c/dbb/f10e 0 2023-10-21T17:20:14.005 INFO:tasks.workunit.client.0.smithi012.stdout:4/805: chown dc/d1e/d91/fc8 16 1 2023-10-21T17:20:14.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/850: truncate d5/d26/f112 1260547 0 2023-10-21T17:20:14.008 INFO:tasks.workunit.client.0.smithi012.stdout:8/706: rmdir d0/d12/d80 39 2023-10-21T17:20:14.078 INFO:tasks.workunit.client.0.smithi012.stdout:8/707: dwrite d0/d12/d6c/db1/fba [4194304,4194304] 0 2023-10-21T17:20:14.079 INFO:tasks.workunit.client.0.smithi012.stdout:8/708: chown d0/d62/d83/d4e/c70 1851 1 2023-10-21T17:20:14.473 INFO:tasks.workunit.client.0.smithi012.stdout:7/813: link d3/d6/dc/d19/d1e/dc9/ld8 d3/l106 0 2023-10-21T17:20:14.475 INFO:tasks.workunit.client.0.smithi012.stdout:6/738: sync 2023-10-21T17:20:14.507 INFO:tasks.workunit.client.0.smithi012.stdout:9/702: rename d0/df/d8d/dcb/fb8 to d0/d15/fe8 0 2023-10-21T17:20:14.624 INFO:tasks.workunit.client.0.smithi012.stdout:1/851: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/dfd/f11f x:0 0 0 2023-10-21T17:20:14.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/806: read dc/d15/d2a/d31/fb6 [2522,39827] 0 2023-10-21T17:20:15.185 INFO:tasks.workunit.client.0.smithi012.stdout:7/814: symlink d3/l107 0 2023-10-21T17:20:15.217 INFO:tasks.workunit.client.0.smithi012.stdout:6/739: mknod d13/d15/d1d/d5d/df8/c101 0 2023-10-21T17:20:15.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/703: creat d0/df/d8d/dcb/d25/fe9 x:0 0 0 2023-10-21T17:20:16.656 INFO:tasks.workunit.client.0.smithi012.stdout:5/734: mknod d2/ce9 0 2023-10-21T17:20:16.843 INFO:tasks.workunit.client.0.smithi012.stdout:2/842: mkdir d1/d14/d16/d117 0 2023-10-21T17:20:16.844 INFO:tasks.workunit.client.0.smithi012.stdout:2/843: fdatasync d1/d4/d93/fb4 0 2023-10-21T17:20:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:8/709: rename d0/d12/d6a to d0/d1a/db0/dea 0 2023-10-21T17:20:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:8/710: read d0/d12/d80/f75 [4063837,65275] 0 2023-10-21T17:20:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:8/711: chown d0/d29/dde 447079373 1 2023-10-21T17:20:17.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/712: dwrite d0/d12/d40/d91/fd7 [0,4194304] 0 2023-10-21T17:20:17.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/713: write d0/d1a/f41 [893424,46131] 0 2023-10-21T17:20:17.578 INFO:tasks.workunit.client.0.smithi012.stdout:9/704: mknod d0/df/cea 0 2023-10-21T17:20:17.680 INFO:tasks.workunit.client.0.smithi012.stdout:5/735: mkdir d2/d4f/d7e/dea 0 2023-10-21T17:20:17.786 INFO:tasks.workunit.client.0.smithi012.stdout:2/844: rmdir d1/d4/d3f/d41 39 2023-10-21T17:20:17.990 INFO:tasks.workunit.client.0.smithi012.stdout:0/848: write d7/d55/f3b [5518184,90520] 0 2023-10-21T17:20:18.259 INFO:tasks.workunit.client.0.smithi012.stdout:8/714: unlink d0/d12/d40/d91/fa9 0 2023-10-21T17:20:18.459 INFO:tasks.workunit.client.0.smithi012.stdout:3/739: mknod d0/d96/cdc 0 2023-10-21T17:20:18.459 INFO:tasks.workunit.client.0.smithi012.stdout:3/740: creat d0/d9d/fdd x:0 0 0 2023-10-21T17:20:18.460 INFO:tasks.workunit.client.0.smithi012.stdout:9/705: truncate d0/df/f63 2956163 0 2023-10-21T17:20:18.577 INFO:tasks.workunit.client.0.smithi012.stdout:5/736: creat d2/d4f/d59/feb x:0 0 0 2023-10-21T17:20:18.731 INFO:tasks.workunit.client.0.smithi012.stdout:2/845: creat d1/de7/f118 x:0 0 0 2023-10-21T17:20:19.117 INFO:tasks.workunit.client.0.smithi012.stdout:0/849: mkdir d7/d55/d23/d27/dc6/d141 0 2023-10-21T17:20:19.118 INFO:tasks.workunit.client.0.smithi012.stdout:8/715: mknod d0/d1a/ceb 0 2023-10-21T17:20:19.118 INFO:tasks.workunit.client.0.smithi012.stdout:0/850: write d7/d55/d23/dce/ddc/d114/d48/f80 [527976,18910] 0 2023-10-21T17:20:19.328 INFO:tasks.workunit.client.0.smithi012.stdout:3/741: dread - d0/d32/f6e zero size 2023-10-21T17:20:19.474 INFO:tasks.workunit.client.0.smithi012.stdout:9/706: unlink d0/d15/f57 0 2023-10-21T17:20:19.474 INFO:tasks.workunit.client.0.smithi012.stdout:9/707: fdatasync d0/d4/d4b/f50 0 2023-10-21T17:20:19.474 INFO:tasks.workunit.client.0.smithi012.stdout:9/708: chown d0/df/d8d/dcb/d25/dc9/fda 373 1 2023-10-21T17:20:19.474 INFO:tasks.workunit.client.0.smithi012.stdout:9/709: read - d0/df/d8d/dcb/d25/d39/fdc zero size 2023-10-21T17:20:19.633 INFO:tasks.workunit.client.0.smithi012.stdout:5/737: symlink d2/d4f/d7e/d87/d57/dc7/dd0/lec 0 2023-10-21T17:20:19.889 INFO:tasks.workunit.client.0.smithi012.stdout:2/846: link d1/d4/f7 d1/d95/f119 0 2023-10-21T17:20:20.009 INFO:tasks.workunit.client.0.smithi012.stdout:2/847: dwrite d1/d4/d93/fb4 [4194304,4194304] 0 2023-10-21T17:20:20.525 INFO:tasks.workunit.client.0.smithi012.stdout:9/710: mknod d0/d15/ceb 0 2023-10-21T17:20:20.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/711: dwrite d0/df/d8d/dcb/d25/d39/f86 [4194304,4194304] 0 2023-10-21T17:20:20.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/712: truncate d0/d4/d4b/d6a/d89/de2/fe7 310500 0 2023-10-21T17:20:20.649 INFO:tasks.workunit.client.0.smithi012.stdout:5/738: creat d2/d2c/d73/d49/d96/fed x:0 0 0 2023-10-21T17:20:20.909 INFO:tasks.workunit.client.0.smithi012.stdout:2/848: truncate d1/d8/ff 182921 0 2023-10-21T17:20:20.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/852: write d5/d32/d1b/d35/d3a/d5c/fc3 [392212,32993] 0 2023-10-21T17:20:20.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/853: dread - d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fec zero size 2023-10-21T17:20:21.017 INFO:tasks.workunit.client.0.smithi012.stdout:1/854: dwrite d5/d30/da9/fb5 [0,4194304] 0 2023-10-21T17:20:21.028 INFO:tasks.workunit.client.0.smithi012.stdout:0/851: truncate d7/d55/d23/d27/d31/f91 29530 0 2023-10-21T17:20:21.061 INFO:tasks.workunit.client.0.smithi012.stdout:0/852: dread d7/d55/d23/dce/ddc/d114/f1e [0,4194304] 0 2023-10-21T17:20:21.137 INFO:tasks.workunit.client.0.smithi012.stdout:3/742: symlink d0/d96/da0/lde 0 2023-10-21T17:20:21.138 INFO:tasks.workunit.client.0.smithi012.stdout:3/743: getdents d0/d32/d43/dca 0 2023-10-21T17:20:21.235 INFO:tasks.workunit.client.0.smithi012.stdout:3/744: dwrite d0/d82/fc1 [0,4194304] 0 2023-10-21T17:20:21.337 INFO:tasks.workunit.client.0.smithi012.stdout:9/713: symlink d0/df/d8d/dcb/d25/d39/d3b/d67/lec 0 2023-10-21T17:20:21.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/739: unlink d2/d4f/d59/d5b/d15/f8d 0 2023-10-21T17:20:21.751 INFO:tasks.workunit.client.0.smithi012.stdout:6/740: write d13/d29/d78/f99 [234701,81215] 0 2023-10-21T17:20:21.752 INFO:tasks.workunit.client.0.smithi012.stdout:6/741: write d13/d15/d1d/d28/d5b/d75/ff1 [250682,64306] 0 2023-10-21T17:20:22.229 INFO:tasks.workunit.client.0.smithi012.stdout:1/855: mkdir d5/d26/d64/d120 0 2023-10-21T17:20:22.257 INFO:tasks.workunit.client.0.smithi012.stdout:1/856: read d5/d32/d1b/d27/d86/f99 [6891582,86577] 0 2023-10-21T17:20:22.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/857: dwrite d5/d61/f9e [0,4194304] 0 2023-10-21T17:20:22.430 INFO:tasks.workunit.client.0.smithi012.stdout:0/853: dread d7/d55/d23/dce/ddc/d114/d63/f6d [0,4194304] 0 2023-10-21T17:20:22.457 INFO:tasks.workunit.client.0.smithi012.stdout:0/854: dread d7/d55/d23/d27/f5d [0,4194304] 0 2023-10-21T17:20:22.493 INFO:tasks.workunit.client.0.smithi012.stdout:0/855: dread d7/d55/d23/dce/ddc/d114/df9/f11b [0,4194304] 0 2023-10-21T17:20:23.121 INFO:tasks.workunit.client.0.smithi012.stdout:3/745: truncate d0/da/fe 4463649 0 2023-10-21T17:20:23.122 INFO:tasks.workunit.client.0.smithi012.stdout:3/746: fdatasync d0/d9d/fc6 0 2023-10-21T17:20:23.169 INFO:tasks.workunit.client.0.smithi012.stdout:5/740: truncate d2/d4f/d59/d5b/d15/f9d 3396426 0 2023-10-21T17:20:23.521 INFO:tasks.workunit.client.0.smithi012.stdout:6/742: mknod d13/c102 0 2023-10-21T17:20:23.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/849: mkdir d1/d4/d11a 0 2023-10-21T17:20:23.708 INFO:tasks.workunit.client.0.smithi012.stdout:1/858: getdents d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1 0 2023-10-21T17:20:23.814 INFO:tasks.workunit.client.0.smithi012.stdout:1/859: dwrite d5/d32/dce/de0/f10a [0,4194304] 0 2023-10-21T17:20:23.928 INFO:tasks.workunit.client.0.smithi012.stdout:0/856: mkdir d7/d55/da2/d142 0 2023-10-21T17:20:24.982 INFO:tasks.workunit.client.0.smithi012.stdout:3/747: unlink d0/d96/da0/ld7 0 2023-10-21T17:20:24.982 INFO:tasks.workunit.client.0.smithi012.stdout:4/807: sync 2023-10-21T17:20:25.083 INFO:tasks.workunit.client.0.smithi012.stdout:9/714: mkdir d0/d4/d4b/ded 0 2023-10-21T17:20:25.083 INFO:tasks.workunit.client.0.smithi012.stdout:9/715: write d0/df/d8d/dcb/d25/fe9 [705980,20006] 0 2023-10-21T17:20:25.308 INFO:tasks.workunit.client.0.smithi012.stdout:5/741: truncate d2/d4f/d59/fa5 29309 0 2023-10-21T17:20:25.559 INFO:tasks.workunit.client.0.smithi012.stdout:2/850: chown d1/d4/d3f/c33 1474414 1 2023-10-21T17:20:25.560 INFO:tasks.workunit.client.0.smithi012.stdout:6/743: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/f103 x:0 0 0 2023-10-21T17:20:25.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/748: creat d0/d32/d43/dca/fdf x:0 0 0 2023-10-21T17:20:25.798 INFO:tasks.workunit.client.0.smithi012.stdout:9/716: creat d0/df/d44/fee x:0 0 0 2023-10-21T17:20:25.798 INFO:tasks.workunit.client.0.smithi012.stdout:1/860: truncate d5/d32/d1b/d27/d86/f7a 297970 0 2023-10-21T17:20:25.809 INFO:tasks.workunit.client.0.smithi012.stdout:1/861: dread d5/d32/d1b/d27/d21/f31 [0,4194304] 0 2023-10-21T17:20:26.011 INFO:tasks.workunit.client.0.smithi012.stdout:5/742: mknod d2/d4f/d7e/d87/dce/cee 0 2023-10-21T17:20:26.035 INFO:tasks.workunit.client.0.smithi012.stdout:5/743: dread d2/d2c/d73/d49/fac [0,4194304] 0 2023-10-21T17:20:26.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/744: dwrite d2/d4f/d7e/d87/d57/dc7/dd0/de3/fe4 [0,4194304] 0 2023-10-21T17:20:26.181 INFO:tasks.workunit.client.0.smithi012.stdout:5/745: dwrite d2/d2c/d73/d49/d96/fed [0,4194304] 0 2023-10-21T17:20:26.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/744: mknod d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/c104 0 2023-10-21T17:20:26.810 INFO:tasks.workunit.client.0.smithi012.stdout:3/749: creat d0/d96/da0/fe0 x:0 0 0 2023-10-21T17:20:27.105 INFO:tasks.workunit.client.0.smithi012.stdout:8/716: write d0/d12/f2b [507068,104369] 0 2023-10-21T17:20:27.912 INFO:tasks.workunit.client.0.smithi012.stdout:5/746: mkdir d2/d2c/d8c/db3/def 0 2023-10-21T17:20:27.912 INFO:tasks.workunit.client.0.smithi012.stdout:5/747: fdatasync d2/d4f/d7e/d87/d57/dc7/dd0/f95 0 2023-10-21T17:20:28.170 INFO:tasks.workunit.client.0.smithi012.stdout:6/745: getdents d13/d15/d1d/d28/d5b 0 2023-10-21T17:20:28.171 INFO:tasks.workunit.client.0.smithi012.stdout:3/750: creat d0/da/d28/fe1 x:0 0 0 2023-10-21T17:20:28.710 INFO:tasks.workunit.client.0.smithi012.stdout:8/717: mkdir d0/d1a/db0/dec 0 2023-10-21T17:20:28.710 INFO:tasks.workunit.client.0.smithi012.stdout:8/718: stat d0/d29/cdc 0 2023-10-21T17:20:28.808 INFO:tasks.workunit.client.0.smithi012.stdout:5/748: getdents d2/d4f/d7e/d87/d57/dc7/dd0 0 2023-10-21T17:20:28.809 INFO:tasks.workunit.client.0.smithi012.stdout:5/749: write d2/d1d/d4e/fdf [162435,113454] 0 2023-10-21T17:20:29.000 INFO:tasks.workunit.client.0.smithi012.stdout:3/751: dread d0/da/f54 [0,4194304] 0 2023-10-21T17:20:29.085 INFO:tasks.workunit.client.0.smithi012.stdout:6/746: mknod d13/d42/d89/db8/d9f/c105 0 2023-10-21T17:20:29.086 INFO:tasks.workunit.client.0.smithi012.stdout:6/747: chown d13/d29/d37/d3b/f57 17398 1 2023-10-21T17:20:29.374 INFO:tasks.workunit.client.0.smithi012.stdout:8/719: link d0/d1a/fc1 d0/d62/d83/fed 0 2023-10-21T17:20:29.374 INFO:tasks.workunit.client.0.smithi012.stdout:8/720: write d0/d62/d7d/dcf/fd6 [41951,91211] 0 2023-10-21T17:20:29.375 INFO:tasks.workunit.client.0.smithi012.stdout:8/721: write d0/d62/fd1 [946921,51406] 0 2023-10-21T17:20:29.737 INFO:tasks.workunit.client.0.smithi012.stdout:5/750: mknod d2/d4f/d59/d5b/d1e/cf0 0 2023-10-21T17:20:29.737 INFO:tasks.workunit.client.0.smithi012.stdout:6/748: creat d13/d15/d1d/f106 x:0 0 0 2023-10-21T17:20:29.973 INFO:tasks.workunit.client.0.smithi012.stdout:8/722: getdents d0/d12 0 2023-10-21T17:20:30.079 INFO:tasks.workunit.client.0.smithi012.stdout:5/751: unlink d2/d4f/d59/d5b/d15/l3f 0 2023-10-21T17:20:30.259 INFO:tasks.workunit.client.0.smithi012.stdout:8/723: creat d0/d1a/db0/db7/dd8/dda/fee x:0 0 0 2023-10-21T17:20:30.259 INFO:tasks.workunit.client.0.smithi012.stdout:8/724: read - d0/d1a/d54/fe1 zero size 2023-10-21T17:20:30.406 INFO:tasks.workunit.client.0.smithi012.stdout:5/752: mkdir d2/d4f/d59/df1 0 2023-10-21T17:20:30.799 INFO:tasks.workunit.client.0.smithi012.stdout:7/815: rename d3/d6/dc/d19/d1e/dc9/c2c to d3/d6/c108 0 2023-10-21T17:20:30.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/816: dwrite d3/d6/dc/d19/fb9 [4194304,4194304] 0 2023-10-21T17:20:30.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/817: write d3/d6/dc/d19/d1e/d34/da8/db4/dce/ff8 [856010,117230] 0 2023-10-21T17:20:31.215 INFO:tasks.workunit.client.0.smithi012.stdout:0/857: rmdir d7/d55/d23/dce/ddc/d114/d48 39 2023-10-21T17:20:31.215 INFO:tasks.workunit.client.0.smithi012.stdout:0/858: creat d7/d55/d23/dce/ddc/f143 x:0 0 0 2023-10-21T17:20:31.235 INFO:tasks.workunit.client.0.smithi012.stdout:9/717: unlink d0/d5/c24 0 2023-10-21T17:20:31.268 INFO:tasks.workunit.client.0.smithi012.stdout:9/718: dread d0/df/d8d/dcb/d25/f56 [0,4194304] 0 2023-10-21T17:20:31.375 INFO:tasks.workunit.client.0.smithi012.stdout:9/719: dwrite d0/f3e [0,4194304] 0 2023-10-21T17:20:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:8/725: mkdir d0/d62/d83/d4e/def 0 2023-10-21T17:20:31.690 INFO:tasks.workunit.client.0.smithi012.stdout:5/753: mkdir d2/db5/df2 0 2023-10-21T17:20:31.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/754: dwrite d2/d4f/d59/d5b/f41 [0,4194304] 0 2023-10-21T17:20:32.230 INFO:tasks.workunit.client.0.smithi012.stdout:7/818: dread d3/d29/f52 [0,4194304] 0 2023-10-21T17:20:33.500 INFO:tasks.workunit.client.0.smithi012.stdout:8/726: mknod d0/d62/d83/d4e/dc5/cf0 0 2023-10-21T17:20:33.622 INFO:tasks.workunit.client.0.smithi012.stdout:5/755: creat d2/d4f/d7e/d87/dce/ff3 x:0 0 0 2023-10-21T17:20:34.277 INFO:tasks.workunit.client.0.smithi012.stdout:4/808: rename dc/d15/d18/d4c to dc/d1e/dc7/dcc/d10f 0 2023-10-21T17:20:34.677 INFO:tasks.workunit.client.0.smithi012.stdout:7/819: chown d3/d6/dc/d19/d43/l4b 7 1 2023-10-21T17:20:35.158 INFO:tasks.workunit.client.0.smithi012.stdout:5/756: mkdir d2/d4f/d59/d5b/d15/df4 0 2023-10-21T17:20:35.363 INFO:tasks.workunit.client.0.smithi012.stdout:2/851: rename d1/d4/d3f/d41/d59/c7b to d1/d14/d16/d58/dec/da5/d34/c11b 0 2023-10-21T17:20:35.708 INFO:tasks.workunit.client.0.smithi012.stdout:7/820: truncate d3/d6/dc/d19/d1e/d34/fd5 3732612 0 2023-10-21T17:20:35.774 INFO:tasks.workunit.client.0.smithi012.stdout:8/727: rmdir d0/d1a/d54 39 2023-10-21T17:20:35.958 INFO:tasks.workunit.client.0.smithi012.stdout:2/852: rmdir d1/d14/d17/da6 39 2023-10-21T17:20:36.523 INFO:tasks.workunit.client.0.smithi012.stdout:3/752: rename d0/d32/d43/c81 to d0/da/d28/ce2 0 2023-10-21T17:20:36.524 INFO:tasks.workunit.client.0.smithi012.stdout:3/753: truncate d0/d9d/fc6 3900 0 2023-10-21T17:20:36.553 INFO:tasks.workunit.client.0.smithi012.stdout:8/728: dread d0/d62/f6b [0,4194304] 0 2023-10-21T17:20:37.115 INFO:tasks.workunit.client.0.smithi012.stdout:6/749: rename d13/d42/c8d to d13/d15/d1d/d5d/df8/c107 0 2023-10-21T17:20:37.115 INFO:tasks.workunit.client.0.smithi012.stdout:3/754: truncate d0/f7 2908175 0 2023-10-21T17:20:37.157 INFO:tasks.workunit.client.0.smithi012.stdout:3/755: write d0/f2b [2175693,125108] 0 2023-10-21T17:20:37.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/729: symlink d0/d62/d7d/lf1 0 2023-10-21T17:20:37.350 INFO:tasks.workunit.client.0.smithi012.stdout:6/750: dread d13/d42/d89/db8/fa7 [0,4194304] 0 2023-10-21T17:20:37.350 INFO:tasks.workunit.client.0.smithi012.stdout:6/751: chown d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/c104 88018084 1 2023-10-21T17:20:37.350 INFO:tasks.workunit.client.0.smithi012.stdout:6/752: truncate d13/d15/d1d/d28/fdf 934433 0 2023-10-21T17:20:37.351 INFO:tasks.workunit.client.0.smithi012.stdout:6/753: truncate d13/d64/d6d/f83 969828 0 2023-10-21T17:20:37.351 INFO:tasks.workunit.client.0.smithi012.stdout:6/754: read d13/d64/d6d/f86 [1108405,4503] 0 2023-10-21T17:20:37.494 INFO:tasks.workunit.client.0.smithi012.stdout:8/730: mknod d0/d1a/db0/dea/cf2 0 2023-10-21T17:20:37.591 INFO:tasks.workunit.client.0.smithi012.stdout:8/731: dwrite d0/d62/d83/d4e/fe4 [0,4194304] 0 2023-10-21T17:20:37.686 INFO:tasks.workunit.client.0.smithi012.stdout:6/755: unlink d13/d15/d1d/d28/d5b/d75/ff1 0 2023-10-21T17:20:37.686 INFO:tasks.workunit.client.0.smithi012.stdout:6/756: write d13/d35/f3a [875697,39641] 0 2023-10-21T17:20:37.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/757: dread d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/fc2 [0,4194304] 0 2023-10-21T17:20:37.776 INFO:tasks.workunit.client.0.smithi012.stdout:3/756: rename d0/d9d/dba/cc9 to d0/d32/ce3 0 2023-10-21T17:20:37.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:20:37.969 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:20:38.063 INFO:tasks.workunit.client.0.smithi012.stdout:1/862: sync 2023-10-21T17:20:38.063 INFO:tasks.workunit.client.0.smithi012.stdout:1/863: chown d5/d32/d62/f82 494 1 2023-10-21T17:20:39.059 INFO:tasks.workunit.client.0.smithi012.stdout:6/758: creat d13/d42/d89/f108 x:0 0 0 2023-10-21T17:20:39.198 INFO:tasks.workunit.client.0.smithi012.stdout:1/864: creat d5/d32/d1b/d27/d21/f121 x:0 0 0 2023-10-21T17:20:39.199 INFO:tasks.workunit.client.0.smithi012.stdout:1/865: readlink d5/d32/d1b/d27/lfc 0 2023-10-21T17:20:39.421 INFO:tasks.workunit.client.0.smithi012.stdout:6/759: mkdir d13/d15/d1d/d28/d5b/dee/d109 0 2023-10-21T17:20:39.483 INFO:tasks.workunit.client.0.smithi012.stdout:3/757: truncate d0/d32/fa8 315168 0 2023-10-21T17:20:39.484 INFO:tasks.workunit.client.0.smithi012.stdout:3/758: readlink d0/d96/da0/lde 0 2023-10-21T17:20:39.484 INFO:tasks.workunit.client.0.smithi012.stdout:3/759: chown d0/da/d28/ce2 11 1 2023-10-21T17:20:39.502 INFO:tasks.workunit.client.0.smithi012.stdout:6/760: dwrite d13/f47 [4194304,4194304] 0 2023-10-21T17:20:39.624 INFO:tasks.workunit.client.0.smithi012.stdout:1/866: truncate d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fe4 1536668 0 2023-10-21T17:20:39.822 INFO:tasks.workunit.client.0.smithi012.stdout:3/760: mknod d0/d32/dd0/ce4 0 2023-10-21T17:20:40.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/761: rmdir d13/d15/d1d/d28/d5b/dee 39 2023-10-21T17:20:40.118 INFO:tasks.workunit.client.0.smithi012.stdout:1/867: truncate d5/d30/da9/fb5 1236110 0 2023-10-21T17:20:40.852 INFO:tasks.workunit.client.0.smithi012.stdout:0/859: sync 2023-10-21T17:20:40.864 INFO:tasks.workunit.client.0.smithi012.stdout:5/757: write d2/d4f/f94 [238969,37602] 0 2023-10-21T17:20:40.950 INFO:tasks.workunit.client.0.smithi012.stdout:7/821: dwrite d3/d64/f8a [0,4194304] 0 2023-10-21T17:20:40.952 INFO:tasks.workunit.client.0.smithi012.stdout:4/809: dwrite dc/d1e/dc7/dcc/d10f/d75/fcd [0,4194304] 0 2023-10-21T17:20:41.005 INFO:tasks.workunit.client.0.smithi012.stdout:7/822: dread d3/da7/fd1 [0,4194304] 0 2023-10-21T17:20:41.036 INFO:tasks.workunit.client.0.smithi012.stdout:4/810: dwrite dc/d1e/f85 [0,4194304] 0 2023-10-21T17:20:41.040 INFO:tasks.workunit.client.0.smithi012.stdout:7/823: dread d3/d16/f31 [0,4194304] 0 2023-10-21T17:20:41.062 INFO:tasks.workunit.client.0.smithi012.stdout:7/824: dread d3/f41 [0,4194304] 0 2023-10-21T17:20:41.081 INFO:tasks.workunit.client.0.smithi012.stdout:6/762: creat d13/d29/f10a x:0 0 0 2023-10-21T17:20:41.288 INFO:tasks.workunit.client.0.smithi012.stdout:1/868: unlink d5/d32/d1b/d2c/c8c 0 2023-10-21T17:20:41.338 INFO:tasks.workunit.client.0.smithi012.stdout:3/761: symlink d0/le5 0 2023-10-21T17:20:41.338 INFO:tasks.workunit.client.0.smithi012.stdout:3/762: read - d0/d32/f6e zero size 2023-10-21T17:20:41.942 INFO:tasks.workunit.client.0.smithi012.stdout:4/811: symlink dc/d1e/d33/d7a/l110 0 2023-10-21T17:20:41.984 INFO:tasks.workunit.client.0.smithi012.stdout:4/812: write dc/d15/d18/f82 [3149844,52662] 0 2023-10-21T17:20:42.106 INFO:tasks.workunit.client.0.smithi012.stdout:7/825: mkdir d3/d6/d73/d8e/d102/d109 0 2023-10-21T17:20:42.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/869: fdatasync d5/d26/da3/fb6 0 2023-10-21T17:20:42.880 INFO:tasks.workunit.client.0.smithi012.stdout:3/763: creat d0/d96/fe6 x:0 0 0 2023-10-21T17:20:43.163 INFO:tasks.workunit.client.0.smithi012.stdout:5/758: getdents d2/d4f/d7e/d87/dce 0 2023-10-21T17:20:43.163 INFO:tasks.workunit.client.0.smithi012.stdout:5/759: stat d2/d4f/d7e/d87/d57/dc7/dd0/l38 0 2023-10-21T17:20:43.227 INFO:tasks.workunit.client.0.smithi012.stdout:5/760: dwrite d2/d1d/fa8 [0,4194304] 0 2023-10-21T17:20:43.268 INFO:tasks.workunit.client.0.smithi012.stdout:4/813: link dc/d1e/d33/d7a/c9d dc/d15/d2a/d58/df8/c111 0 2023-10-21T17:20:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:0/860: rename d7/d55/d23/dce/ddc/d114/da8 to d7/d55/d23/dce/ddc/d114/d48/d88/d144 0 2023-10-21T17:20:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:0/861: write d7/d55/d23/dce/ddc/d114/d82/fff [509142,103234] 0 2023-10-21T17:20:44.696 INFO:tasks.workunit.client.0.smithi012.stdout:3/764: rename d0/da/lac to d0/d1c/le7 0 2023-10-21T17:20:44.720 INFO:tasks.workunit.client.0.smithi012.stdout:3/765: dread d0/f2b [0,4194304] 0 2023-10-21T17:20:44.745 INFO:tasks.workunit.client.0.smithi012.stdout:3/766: dread d0/d1c/d5e/fb1 [0,4194304] 0 2023-10-21T17:20:44.746 INFO:tasks.workunit.client.0.smithi012.stdout:3/767: write d0/da/d28/f38 [2173154,26919] 0 2023-10-21T17:20:44.855 INFO:tasks.workunit.client.0.smithi012.stdout:0/862: creat d7/d55/d23/d27/dc6/d112/d130/f145 x:0 0 0 2023-10-21T17:20:44.855 INFO:tasks.workunit.client.0.smithi012.stdout:0/863: readlink d7/ld 0 2023-10-21T17:20:44.855 INFO:tasks.workunit.client.0.smithi012.stdout:0/864: dread - d7/d55/d23/d30/ff3 zero size 2023-10-21T17:20:44.962 INFO:tasks.workunit.client.0.smithi012.stdout:0/865: dwrite d7/d55/d23/d27/f5d [4194304,4194304] 0 2023-10-21T17:20:44.962 INFO:tasks.workunit.client.0.smithi012.stdout:0/866: creat d7/d55/d23/dce/ddc/f146 x:0 0 0 2023-10-21T17:20:44.962 INFO:tasks.workunit.client.0.smithi012.stdout:0/867: fsync d7/f1d 0 2023-10-21T17:20:44.963 INFO:tasks.workunit.client.0.smithi012.stdout:0/868: chown d7/d55/d23/d27/d40 9698 1 2023-10-21T17:20:44.963 INFO:tasks.workunit.client.0.smithi012.stdout:0/869: chown d7/d55/d23/dce/ddc/d114/d48 12 1 2023-10-21T17:20:45.093 INFO:tasks.workunit.client.0.smithi012.stdout:3/768: creat d0/d32/d43/d47/fe8 x:0 0 0 2023-10-21T17:20:45.093 INFO:tasks.workunit.client.0.smithi012.stdout:3/769: chown d0/d32/f6e 154 1 2023-10-21T17:20:45.428 INFO:tasks.workunit.client.0.smithi012.stdout:0/870: unlink d7/d55/d23/d30/d8c/ca3 0 2023-10-21T17:20:45.531 INFO:tasks.workunit.client.0.smithi012.stdout:0/871: dwrite d7/d55/d1f/fe4 [0,4194304] 0 2023-10-21T17:20:45.532 INFO:tasks.workunit.client.0.smithi012.stdout:0/872: write d7/d52/d53/f117 [929310,123351] 0 2023-10-21T17:20:45.585 INFO:tasks.workunit.client.0.smithi012.stdout:0/873: dwrite d7/d55/d23/d27/dc6/d112/d130/f145 [0,4194304] 0 2023-10-21T17:20:45.607 INFO:tasks.workunit.client.0.smithi012.stdout:3/770: stat d0/d1c/l1d 0 2023-10-21T17:20:46.273 INFO:tasks.workunit.client.0.smithi012.stdout:0/874: mknod d7/d55/d23/c147 0 2023-10-21T17:20:46.346 INFO:tasks.workunit.client.0.smithi012.stdout:0/875: dwrite d7/d55/d23/d27/d31/f3c [0,4194304] 0 2023-10-21T17:20:46.598 INFO:tasks.workunit.client.0.smithi012.stdout:9/720: mknod d0/df/d8d/dcb/d25/cef 0 2023-10-21T17:20:46.993 INFO:tasks.workunit.client.0.smithi012.stdout:9/721: mkdir d0/d5/d9c/df0 0 2023-10-21T17:20:47.088 INFO:tasks.workunit.client.0.smithi012.stdout:9/722: dwrite d0/d4/d4b/d6a/fae [0,4194304] 0 2023-10-21T17:20:47.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/763: dwrite d13/d15/f67 [4194304,4194304] 0 2023-10-21T17:20:47.638 INFO:tasks.workunit.client.0.smithi012.stdout:0/876: getdents d7/d55/d23/d30 0 2023-10-21T17:20:48.137 INFO:tasks.workunit.client.0.smithi012.stdout:9/723: unlink d0/df/d8d/dcb/d25/d39/d3b/f81 0 2023-10-21T17:20:48.138 INFO:tasks.workunit.client.0.smithi012.stdout:6/764: rename d13/d29/f10a to d13/d42/f10b 0 2023-10-21T17:20:48.755 INFO:tasks.workunit.client.0.smithi012.stdout:0/877: mknod d7/d52/dd3/c148 0 2023-10-21T17:20:49.097 INFO:tasks.workunit.client.0.smithi012.stdout:9/724: rename d0/df/d8d/dcb/d25/d39/d3b/f70 to d0/dcd/ff1 0 2023-10-21T17:20:49.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/878: getdents d7/d55/d23/dce/ddc/d114/d63 0 2023-10-21T17:20:49.166 INFO:tasks.workunit.client.0.smithi012.stdout:1/870: dwrite d5/d32/d1b/d35/d49/d69/f9b [0,4194304] 0 2023-10-21T17:20:49.167 INFO:tasks.workunit.client.0.smithi012.stdout:1/871: readlink d5/d32/d62/l77 0 2023-10-21T17:20:49.167 INFO:tasks.workunit.client.0.smithi012.stdout:1/872: chown d5/d32/d1b/d35/d49/d69/ldf 39136 1 2023-10-21T17:20:49.493 INFO:tasks.workunit.client.0.smithi012.stdout:5/761: write d2/d4f/d7e/d87/d57/d66/f7f [1002776,52566] 0 2023-10-21T17:20:49.765 INFO:tasks.workunit.client.0.smithi012.stdout:9/725: mknod d0/cf2 0 2023-10-21T17:20:49.766 INFO:tasks.workunit.client.0.smithi012.stdout:9/726: readlink d0/df/d8d/dcb/d25/d39/d76/la0 0 2023-10-21T17:20:49.766 INFO:tasks.workunit.client.0.smithi012.stdout:9/727: write d0/d4/d4b/f50 [5196780,116201] 0 2023-10-21T17:20:49.807 INFO:tasks.workunit.client.0.smithi012.stdout:9/728: dread d0/df/d44/f51 [0,4194304] 0 2023-10-21T17:20:50.122 INFO:tasks.workunit.client.0.smithi012.stdout:3/771: dwrite d0/d1c/f71 [0,4194304] 0 2023-10-21T17:20:50.308 INFO:tasks.workunit.client.0.smithi012.stdout:8/732: sync 2023-10-21T17:20:50.309 INFO:tasks.workunit.client.0.smithi012.stdout:7/826: sync 2023-10-21T17:20:50.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/853: sync 2023-10-21T17:20:50.309 INFO:tasks.workunit.client.0.smithi012.stdout:8/733: fsync d0/f36 0 2023-10-21T17:20:50.309 INFO:tasks.workunit.client.0.smithi012.stdout:7/827: fsync d3/da7/daf/dcd/fe4 0 2023-10-21T17:20:50.310 INFO:tasks.workunit.client.0.smithi012.stdout:8/734: dread - d0/f8f zero size 2023-10-21T17:20:50.310 INFO:tasks.workunit.client.0.smithi012.stdout:2/854: fdatasync d1/d4/d3f/d41/d59/fb5 0 2023-10-21T17:20:50.598 INFO:tasks.workunit.client.0.smithi012.stdout:5/762: mkdir d2/d1d/d4e/df5 0 2023-10-21T17:20:50.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/763: creat d2/d4f/d7e/d87/d57/d66/daa/ff6 x:0 0 0 2023-10-21T17:20:50.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/764: write d2/d4f/d7e/daf/fe7 [506695,10156] 0 2023-10-21T17:20:50.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/765: fsync d2/f18 0 2023-10-21T17:20:50.833 INFO:tasks.workunit.client.0.smithi012.stdout:9/729: unlink d0/d5/l1e 0 2023-10-21T17:20:50.834 INFO:tasks.workunit.client.0.smithi012.stdout:9/730: fsync d0/df/d8d/dcb/d25/d39/d8e/f91 0 2023-10-21T17:20:50.834 INFO:tasks.workunit.client.0.smithi012.stdout:9/731: chown d0/df/d8d/dcb/d25/d39/d8e/ca3 0 1 2023-10-21T17:20:51.252 INFO:tasks.workunit.client.0.smithi012.stdout:3/772: truncate d0/f2b 6491755 0 2023-10-21T17:20:51.252 INFO:tasks.workunit.client.0.smithi012.stdout:3/773: read - d0/d32/d43/dca/fdf zero size 2023-10-21T17:20:51.291 INFO:tasks.workunit.client.0.smithi012.stdout:3/774: dread d0/d32/d43/f79 [0,4194304] 0 2023-10-21T17:20:51.292 INFO:tasks.workunit.client.0.smithi012.stdout:3/775: creat d0/d1c/fe9 x:0 0 0 2023-10-21T17:20:51.292 INFO:tasks.workunit.client.0.smithi012.stdout:3/776: write d0/d1c/fbd [944234,126172] 0 2023-10-21T17:20:51.293 INFO:tasks.workunit.client.0.smithi012.stdout:3/777: chown d0/da/f54 76 1 2023-10-21T17:20:51.520 INFO:tasks.workunit.client.0.smithi012.stdout:8/735: symlink d0/d12/d80/lf3 0 2023-10-21T17:20:51.600 INFO:tasks.workunit.client.0.smithi012.stdout:2/855: mkdir d1/d4/d3f/d107/d11c 0 2023-10-21T17:20:52.092 INFO:tasks.workunit.client.0.smithi012.stdout:5/766: creat d2/d4f/d59/d5b/d15/ff7 x:0 0 0 2023-10-21T17:20:52.092 INFO:tasks.workunit.client.0.smithi012.stdout:5/767: write d2/d4f/d7e/d87/d57/d66/daa/ff6 [894439,47824] 0 2023-10-21T17:20:52.205 INFO:tasks.workunit.client.0.smithi012.stdout:5/768: dwrite d2/d1d/f8e [0,4194304] 0 2023-10-21T17:20:52.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/769: dread d2/d4f/d7e/daf/fe7 [0,4194304] 0 2023-10-21T17:20:52.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/770: creat d2/d4f/d7e/d87/d57/d66/daa/ff8 x:0 0 0 2023-10-21T17:20:52.655 INFO:tasks.workunit.client.0.smithi012.stdout:6/765: dwrite d13/d15/d1d/d28/fdf [0,4194304] 0 2023-10-21T17:20:52.779 INFO:tasks.workunit.client.0.smithi012.stdout:3/778: symlink d0/d32/dd0/lea 0 2023-10-21T17:20:53.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/736: link d0/d1a/l1c d0/d29/d79/lf4 0 2023-10-21T17:20:53.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/737: chown d0/d1a/db0/db7/dd8/dda/fcb 51301 1 2023-10-21T17:20:53.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/738: fdatasync d0/d29/f59 0 2023-10-21T17:20:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/739: chown d0/d1a/db0/dca 288929532 1 2023-10-21T17:20:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/740: fdatasync d0/d62/f76 0 2023-10-21T17:20:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/741: chown d0/f35 63 1 2023-10-21T17:20:53.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/742: chown d0/l44 4340101 1 2023-10-21T17:20:53.108 INFO:tasks.workunit.client.0.smithi012.stdout:2/856: symlink d1/d14/d16/d58/dec/da5/d50/l11d 0 2023-10-21T17:20:53.108 INFO:tasks.workunit.client.0.smithi012.stdout:2/857: write d1/f9 [3848504,456] 0 2023-10-21T17:20:53.395 INFO:tasks.workunit.client.0.smithi012.stdout:5/771: symlink d2/d4f/d7e/daf/lf9 0 2023-10-21T17:20:53.561 INFO:tasks.workunit.client.0.smithi012.stdout:9/732: getdents d0/df/d44 0 2023-10-21T17:20:53.562 INFO:tasks.workunit.client.0.smithi012.stdout:9/733: read - d0/d5/f59 zero size 2023-10-21T17:20:53.973 INFO:tasks.workunit.client.0.smithi012.stdout:6/766: chown d13/d15/c7f 3230 1 2023-10-21T17:20:54.086 INFO:tasks.workunit.client.0.smithi012.stdout:3/779: creat d0/d82/feb x:0 0 0 2023-10-21T17:20:54.200 INFO:tasks.workunit.client.0.smithi012.stdout:8/743: dread d0/d1a/db0/fe0 [4194304,4194304] 0 2023-10-21T17:20:54.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/879: dwrite d7/d55/fb2 [0,4194304] 0 2023-10-21T17:20:54.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/880: chown d7/d55/d23/dce/ddc/d114/d63/lc5 208 1 2023-10-21T17:20:54.483 INFO:tasks.workunit.client.0.smithi012.stdout:9/734: write d0/df/d8d/dcb/d25/d39/d3b/f6f [5087358,92622] 0 2023-10-21T17:20:55.347 INFO:tasks.workunit.client.0.smithi012.stdout:3/780: symlink d0/d96/d97/d9b/lec 0 2023-10-21T17:20:55.576 INFO:tasks.workunit.client.0.smithi012.stdout:8/744: rename d0/d12/d80/l66 to d0/d62/d83/d4e/dc5/lf5 0 2023-10-21T17:20:55.907 INFO:tasks.workunit.client.0.smithi012.stdout:7/828: write d3/d16/f65 [2390781,36501] 0 2023-10-21T17:20:55.907 INFO:tasks.workunit.client.0.smithi012.stdout:2/858: symlink d1/d4/d3f/l11e 0 2023-10-21T17:20:56.031 INFO:tasks.workunit.client.0.smithi012.stdout:5/772: truncate d2/d4f/d59/d5b/d15/f9d 3333854 0 2023-10-21T17:20:56.041 INFO:tasks.workunit.client.0.smithi012.stdout:5/773: dread d2/fa0 [0,4194304] 0 2023-10-21T17:20:56.052 INFO:tasks.workunit.client.0.smithi012.stdout:5/774: dread d2/d4f/d7e/d87/d57/dc7/dd0/fc8 [0,4194304] 0 2023-10-21T17:20:56.072 INFO:tasks.workunit.client.0.smithi012.stdout:5/775: read d2/d4f/d7e/f8a [336947,110568] 0 2023-10-21T17:20:56.148 INFO:tasks.workunit.client.0.smithi012.stdout:3/781: rmdir d0/da 39 2023-10-21T17:20:56.373 INFO:tasks.workunit.client.0.smithi012.stdout:0/881: rename d7/d55/d23/d27/d40/c86 to d7/d55/d23/dce/ddc/d114/d48/d88/d144/c149 0 2023-10-21T17:20:56.475 INFO:tasks.workunit.client.0.smithi012.stdout:0/882: dwrite d7/d55/d23/d27/d31/f3c [0,4194304] 0 2023-10-21T17:20:56.479 INFO:tasks.workunit.client.0.smithi012.stdout:8/745: creat d0/d12/ff6 x:0 0 0 2023-10-21T17:20:56.515 INFO:tasks.workunit.client.0.smithi012.stdout:8/746: dread d0/d1a/fd9 [0,4194304] 0 2023-10-21T17:20:56.673 INFO:tasks.workunit.client.0.smithi012.stdout:4/814: symlink dc/l112 0 2023-10-21T17:20:56.674 INFO:tasks.workunit.client.0.smithi012.stdout:4/815: write dc/d1e/dc7/dcc/d10f/f81 [1973936,29947] 0 2023-10-21T17:20:56.674 INFO:tasks.workunit.client.0.smithi012.stdout:4/816: readlink dc/d1e/d65/l8e 0 2023-10-21T17:20:57.559 INFO:tasks.workunit.client.0.smithi012.stdout:3/782: mkdir d0/d32/d43/dca/ded 0 2023-10-21T17:20:57.560 INFO:tasks.workunit.client.0.smithi012.stdout:3/783: write d0/d32/d43/fbb [571037,129254] 0 2023-10-21T17:20:57.560 INFO:tasks.workunit.client.0.smithi012.stdout:3/784: dread - d0/d32/d43/f61 zero size 2023-10-21T17:20:57.560 INFO:tasks.workunit.client.0.smithi012.stdout:3/785: dread - d0/d32/d43/d47/dd6/fda zero size 2023-10-21T17:20:57.590 INFO:tasks.workunit.client.0.smithi012.stdout:3/786: dread d0/da/f1f [4194304,4194304] 0 2023-10-21T17:20:57.590 INFO:tasks.workunit.client.0.smithi012.stdout:3/787: readlink d0/d32/d43/d47/d50/l69 0 2023-10-21T17:20:58.112 INFO:tasks.workunit.client.0.smithi012.stdout:8/747: symlink d0/d1a/db0/db7/lf7 0 2023-10-21T17:20:58.112 INFO:tasks.workunit.client.0.smithi012.stdout:8/748: write d0/f35 [7003376,125196] 0 2023-10-21T17:20:58.147 INFO:tasks.workunit.client.0.smithi012.stdout:8/749: dread d0/f4 [0,4194304] 0 2023-10-21T17:20:58.148 INFO:tasks.workunit.client.0.smithi012.stdout:8/750: fdatasync d0/d1a/f33 0 2023-10-21T17:20:58.306 INFO:tasks.workunit.client.0.smithi012.stdout:4/817: link dc/d1e/dc7/dcc/d10f/l5b dc/d93/l113 0 2023-10-21T17:20:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:3/788: link d0/d32/d43/f79 d0/d1c/d5e/fee 0 2023-10-21T17:20:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:3/789: dread - d0/d32/d43/d47/fe8 zero size 2023-10-21T17:20:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:3/790: write d0/d82/faf [627852,65088] 0 2023-10-21T17:20:58.529 INFO:tasks.workunit.client.0.smithi012.stdout:3/791: write d0/d32/f8b [492835,92824] 0 2023-10-21T17:20:59.400 INFO:tasks.workunit.client.0.smithi012.stdout:8/751: truncate d0/f36 2365481 0 2023-10-21T17:20:59.400 INFO:tasks.workunit.client.0.smithi012.stdout:8/752: truncate d0/d1a/db0/dca/fd5 1313584 0 2023-10-21T17:20:59.400 INFO:tasks.workunit.client.0.smithi012.stdout:8/753: chown d0/d62/d83/l89 70535 1 2023-10-21T17:20:59.400 INFO:tasks.workunit.client.0.smithi012.stdout:8/754: chown d0/d1a/db0/dea/fa4 14013 1 2023-10-21T17:21:00.246 INFO:tasks.workunit.client.0.smithi012.stdout:8/755: mknod d0/d12/d6c/ddb/cf8 0 2023-10-21T17:21:00.346 INFO:tasks.workunit.client.0.smithi012.stdout:8/756: rmdir d0/d12/d6c 39 2023-10-21T17:21:00.376 INFO:tasks.workunit.client.0.smithi012.stdout:8/757: write d0/f90 [3814514,6516] 0 2023-10-21T17:21:00.994 INFO:tasks.workunit.client.0.smithi012.stdout:9/735: write d0/df/d44/f7c [808394,86527] 0 2023-10-21T17:21:00.996 INFO:tasks.workunit.client.0.smithi012.stdout:1/873: sync 2023-10-21T17:21:00.996 INFO:tasks.workunit.client.0.smithi012.stdout:6/767: sync 2023-10-21T17:21:00.996 INFO:tasks.workunit.client.0.smithi012.stdout:2/859: sync 2023-10-21T17:21:00.996 INFO:tasks.workunit.client.0.smithi012.stdout:6/768: fdatasync d13/d15/d1d/d5d/d66/d7a/d97/fe4 0 2023-10-21T17:21:00.997 INFO:tasks.workunit.client.0.smithi012.stdout:2/860: write d1/de7/f118 [228622,14288] 0 2023-10-21T17:21:01.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/736: dwrite d0/df/d8d/dcb/d25/f56 [4194304,4194304] 0 2023-10-21T17:21:01.093 INFO:tasks.workunit.client.0.smithi012.stdout:9/737: fsync d0/d4/d4b/fbf 0 2023-10-21T17:21:01.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/829: dwrite d3/d6/dc/f63 [0,4194304] 0 2023-10-21T17:21:01.093 INFO:tasks.workunit.client.0.smithi012.stdout:7/830: chown d3/d6/dc/d19/d1e/d9d/dec/fb6 169717981 1 2023-10-21T17:21:01.106 INFO:tasks.workunit.client.0.smithi012.stdout:5/776: dwrite d2/d4f/d59/fa5 [0,4194304] 0 2023-10-21T17:21:01.639 INFO:tasks.workunit.client.0.smithi012.stdout:0/883: dwrite d7/d55/fb3 [0,4194304] 0 2023-10-21T17:21:01.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/861: dread d1/d4/d65/dea/d5f/f109 [0,4194304] 0 2023-10-21T17:21:01.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/862: getdents d1/d4/d3f/d107/d11c 0 2023-10-21T17:21:01.867 INFO:tasks.workunit.client.0.smithi012.stdout:2/863: chown d1/d14/d17/da6/df9 2541 1 2023-10-21T17:21:02.221 INFO:tasks.workunit.client.0.smithi012.stdout:1/874: truncate d5/d32/d1b/d2c/d48/ff2 2670885 0 2023-10-21T17:21:02.448 INFO:tasks.workunit.client.0.smithi012.stdout:7/831: symlink d3/d6/d73/l10a 0 2023-10-21T17:21:02.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/832: dread d3/d6/f81 [0,4194304] 0 2023-10-21T17:21:02.477 INFO:tasks.workunit.client.0.smithi012.stdout:9/738: write d0/df/d8d/dcb/d25/d2f/f62 [2752719,110727] 0 2023-10-21T17:21:02.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/777: truncate d2/d4f/d59/d5b/f77 1217113 0 2023-10-21T17:21:02.695 INFO:tasks.workunit.client.0.smithi012.stdout:5/778: truncate d2/d4f/d59/feb 508569 0 2023-10-21T17:21:02.720 INFO:tasks.workunit.client.0.smithi012.stdout:4/818: sync 2023-10-21T17:21:02.720 INFO:tasks.workunit.client.0.smithi012.stdout:4/819: stat dc/d1e/dc7/dcc/d10f/d55/d6c/d77 0 2023-10-21T17:21:03.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/884: link d7/d55/d23/d27/d31/f4f d7/d55/d23/dce/ddc/d114/df9/f14a 0 2023-10-21T17:21:03.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/885: write d7/f1d [1939339,63180] 0 2023-10-21T17:21:03.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/886: chown d7/d55/d23/dce/ddc/d114/df9/f14a 336 1 2023-10-21T17:21:03.149 INFO:tasks.workunit.client.0.smithi012.stdout:6/769: symlink d13/d35/d4c/l10c 0 2023-10-21T17:21:03.240 INFO:tasks.workunit.client.0.smithi012.stdout:6/770: dwrite d13/d42/f8c [0,4194304] 0 2023-10-21T17:21:03.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/771: dwrite d13/d15/d1d/d28/fca [0,4194304] 0 2023-10-21T17:21:03.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/864: mkdir d1/d14/d17/db9/dd6/d11f 0 2023-10-21T17:21:03.313 INFO:tasks.workunit.client.0.smithi012.stdout:2/865: fdatasync d1/d14/d16/d58/dec/da5/d50/da3/da9/fc1 0 2023-10-21T17:21:03.413 INFO:tasks.workunit.client.0.smithi012.stdout:2/866: dwrite d1/d4/f81 [0,4194304] 0 2023-10-21T17:21:03.419 INFO:tasks.workunit.client.0.smithi012.stdout:2/867: write d1/d14/d16/d58/dec/da5/d50/f68 [728938,32994] 0 2023-10-21T17:21:03.421 INFO:tasks.workunit.client.0.smithi012.stdout:2/868: write d1/d14/d16/d58/dec/d82/d86/fd5 [490551,17789] 0 2023-10-21T17:21:03.484 INFO:tasks.workunit.client.0.smithi012.stdout:1/875: link d5/d32/d1b/c5e d5/d32/d1b/d27/dfb/d108/c122 0 2023-10-21T17:21:03.484 INFO:tasks.workunit.client.0.smithi012.stdout:1/876: chown d5/d32/d62/l16 37 1 2023-10-21T17:21:03.484 INFO:tasks.workunit.client.0.smithi012.stdout:1/877: stat d5/d26/d54/d101 0 2023-10-21T17:21:03.666 INFO:tasks.workunit.client.0.smithi012.stdout:7/833: symlink d3/d64/l10b 0 2023-10-21T17:21:03.688 INFO:tasks.workunit.client.0.smithi012.stdout:7/834: dread d3/d6/dc/d19/d43/f61 [0,4194304] 0 2023-10-21T17:21:03.689 INFO:tasks.workunit.client.0.smithi012.stdout:7/835: dread - d3/d6/dc/d19/d1e/d9d/dec/fb7 zero size 2023-10-21T17:21:03.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/739: truncate d0/d4/d4b/d6a/d89/de2/fe7 185518 0 2023-10-21T17:21:03.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/740: chown d0/ld7 1351 1 2023-10-21T17:21:03.921 INFO:tasks.workunit.client.0.smithi012.stdout:5/779: mknod d2/d4f/d7e/d87/d57/dc7/dd0/de3/cfa 0 2023-10-21T17:21:03.952 INFO:tasks.workunit.client.0.smithi012.stdout:5/780: dread d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:21:03.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/781: getdents d2/d4f/d7e/dea 0 2023-10-21T17:21:03.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/782: fsync d2/fe1 0 2023-10-21T17:21:03.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/783: chown d2/d1d/d20/l50 985 1 2023-10-21T17:21:03.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/784: read d2/d2c/d73/d49/da9/fcb [114730,36077] 0 2023-10-21T17:21:04.124 INFO:tasks.workunit.client.0.smithi012.stdout:4/820: write dc/d1e/d2b/f5c [2891000,84014] 0 2023-10-21T17:21:04.124 INFO:tasks.workunit.client.0.smithi012.stdout:4/821: chown dc/d1e/d2b/fa3 42606892 1 2023-10-21T17:21:04.124 INFO:tasks.workunit.client.0.smithi012.stdout:4/822: read - dc/d15/d2a/d31/df3/f108 zero size 2023-10-21T17:21:04.124 INFO:tasks.workunit.client.0.smithi012.stdout:4/823: fsync dc/d15/d2a/d31/f87 0 2023-10-21T17:21:04.125 INFO:tasks.workunit.client.0.smithi012.stdout:4/824: chown dc/d1e/d33/d7a/l110 483 1 2023-10-21T17:21:04.327 INFO:tasks.workunit.client.0.smithi012.stdout:0/887: symlink d7/d52/df7/l14b 0 2023-10-21T17:21:04.832 INFO:tasks.workunit.client.0.smithi012.stdout:6/772: mkdir d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/d10d 0 2023-10-21T17:21:05.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/869: creat d1/d14/d17/da6/df9/f120 x:0 0 0 2023-10-21T17:21:05.308 INFO:tasks.workunit.client.0.smithi012.stdout:1/878: symlink d5/d26/d54/d101/l123 0 2023-10-21T17:21:06.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/741: getdents d0/df/d8d/dcb/d25/d2f/d8c 0 2023-10-21T17:21:06.710 INFO:tasks.workunit.client.0.smithi012.stdout:9/742: dwrite d0/f6b [0,4194304] 0 2023-10-21T17:21:06.906 INFO:tasks.workunit.client.0.smithi012.stdout:5/785: symlink d2/d4f/lfb 0 2023-10-21T17:21:06.906 INFO:tasks.workunit.client.0.smithi012.stdout:5/786: read - d2/d1d/d4e/fc0 zero size 2023-10-21T17:21:06.907 INFO:tasks.workunit.client.0.smithi012.stdout:5/787: stat d2/d2c/d73/d49/da9/fd7 0 2023-10-21T17:21:06.934 INFO:tasks.workunit.client.0.smithi012.stdout:5/788: dread d2/d2c/db6/fdd [4194304,4194304] 0 2023-10-21T17:21:06.952 INFO:tasks.workunit.client.0.smithi012.stdout:4/825: truncate dc/d1e/dc7/dcc/d10f/f81 2354152 0 2023-10-21T17:21:06.952 INFO:tasks.workunit.client.0.smithi012.stdout:4/826: dread - dc/d15/d2a/d31/df3/f108 zero size 2023-10-21T17:21:07.127 INFO:tasks.workunit.client.0.smithi012.stdout:2/870: getdents d1/d14/d16/d58/dec/da5/dbe 0 2023-10-21T17:21:07.238 INFO:tasks.workunit.client.0.smithi012.stdout:1/879: dread d5/d26/f112 [0,4194304] 0 2023-10-21T17:21:07.358 INFO:tasks.workunit.client.0.smithi012.stdout:1/880: dwrite d5/f8d [0,4194304] 0 2023-10-21T17:21:07.494 INFO:tasks.workunit.client.0.smithi012.stdout:9/743: mkdir d0/d5/df3 0 2023-10-21T17:21:07.581 INFO:tasks.workunit.client.0.smithi012.stdout:9/744: dwrite d0/da7/fd2 [0,4194304] 0 2023-10-21T17:21:07.581 INFO:tasks.workunit.client.0.smithi012.stdout:9/745: fdatasync d0/df/d8d/dcb/d25/dc9/fda 0 2023-10-21T17:21:08.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:21:08.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:21:08.132 INFO:tasks.workunit.client.0.smithi012.stdout:4/827: mknod dc/d1e/dc7/dcc/d10f/d55/d6c/d83/c114 0 2023-10-21T17:21:08.133 INFO:tasks.workunit.client.0.smithi012.stdout:6/773: unlink d13/d35/d4c/l59 0 2023-10-21T17:21:08.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/828: readlink dc/lb7 0 2023-10-21T17:21:08.155 INFO:tasks.workunit.client.0.smithi012.stdout:6/774: dread d13/d42/d89/db8/d9f/fea [0,4194304] 0 2023-10-21T17:21:08.172 INFO:tasks.workunit.client.0.smithi012.stdout:6/775: dread d13/d42/d89/db8/f45 [0,4194304] 0 2023-10-21T17:21:08.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/776: read d13/d15/d1d/d28/d5b/f68 [3358292,102698] 0 2023-10-21T17:21:08.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/871: creat d1/d14/f121 x:0 0 0 2023-10-21T17:21:08.231 INFO:tasks.workunit.client.0.smithi012.stdout:2/872: stat d1/d14/d16/d58/dec/da5/dbe/lf7 0 2023-10-21T17:21:08.231 INFO:tasks.workunit.client.0.smithi012.stdout:2/873: creat d1/d95/f122 x:0 0 0 2023-10-21T17:21:08.267 INFO:tasks.workunit.client.0.smithi012.stdout:6/777: dwrite d13/d15/d1d/d28/fad [0,4194304] 0 2023-10-21T17:21:08.268 INFO:tasks.workunit.client.0.smithi012.stdout:6/778: chown d13/d42/d89/db8/d9f/fe3 204835568 1 2023-10-21T17:21:08.902 INFO:tasks.workunit.client.0.smithi012.stdout:9/746: fdatasync d0/df/d8d/dcb/d25/d2f/f65 0 2023-10-21T17:21:09.000 INFO:tasks.workunit.client.0.smithi012.stdout:9/747: dwrite d0/df/d8d/dcb/d25/f71 [4194304,4194304] 0 2023-10-21T17:21:09.133 INFO:tasks.workunit.client.0.smithi012.stdout:4/829: mkdir dc/d1e/dc7/dcc/d10f/d55/d6c/de6/d115 0 2023-10-21T17:21:09.421 INFO:tasks.workunit.client.0.smithi012.stdout:2/874: creat d1/d4/d65/dea/f123 x:0 0 0 2023-10-21T17:21:09.422 INFO:tasks.workunit.client.0.smithi012.stdout:2/875: write d1/d14/d16/d58/dec/da5/d50/da3/fd3 [341887,36889] 0 2023-10-21T17:21:09.422 INFO:tasks.workunit.client.0.smithi012.stdout:2/876: chown d1/d14/d16/d58/dec/d82/d86/la8 11389 1 2023-10-21T17:21:09.595 INFO:tasks.workunit.client.0.smithi012.stdout:6/779: creat d13/d42/d89/db8/f10e x:0 0 0 2023-10-21T17:21:09.632 INFO:tasks.workunit.client.0.smithi012.stdout:6/780: dread fd [0,4194304] 0 2023-10-21T17:21:10.068 INFO:tasks.workunit.client.0.smithi012.stdout:5/789: rename d2/d1d/c21 to d2/d4f/d7e/d87/d57/d66/cfc 0 2023-10-21T17:21:10.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/748: mkdir d0/d15/df4 0 2023-10-21T17:21:10.068 INFO:tasks.workunit.client.0.smithi012.stdout:2/877: mkdir d1/d4/d3f/d4a/d124 0 2023-10-21T17:21:10.068 INFO:tasks.workunit.client.0.smithi012.stdout:2/878: stat d1/d4/d65/fc3 0 2023-10-21T17:21:10.246 INFO:tasks.workunit.client.0.smithi012.stdout:6/781: creat d13/d29/d37/f10f x:0 0 0 2023-10-21T17:21:10.520 INFO:tasks.workunit.client.0.smithi012.stdout:3/792: creat d0/fef x:0 0 0 2023-10-21T17:21:10.686 INFO:tasks.workunit.client.0.smithi012.stdout:9/749: rmdir d0/df/d8d/dcb/d25/d2f/de3 0 2023-10-21T17:21:11.303 INFO:tasks.workunit.client.0.smithi012.stdout:6/782: symlink d13/d15/d1d/d5d/d66/d70/d74/d98/l110 0 2023-10-21T17:21:11.343 INFO:tasks.workunit.client.0.smithi012.stdout:6/783: write f7 [7735994,7530] 0 2023-10-21T17:21:11.476 INFO:tasks.workunit.client.0.smithi012.stdout:5/790: rmdir d2/d4f/d7e/d87/d57/dc7/dd0/de3 39 2023-10-21T17:21:11.476 INFO:tasks.workunit.client.0.smithi012.stdout:0/888: symlink d7/l14c 0 2023-10-21T17:21:11.476 INFO:tasks.workunit.client.0.smithi012.stdout:0/889: fsync d7/d52/fc1 0 2023-10-21T17:21:11.583 INFO:tasks.workunit.client.0.smithi012.stdout:3/793: link d0/d96/d97/f9a d0/d32/d43/ff0 0 2023-10-21T17:21:11.583 INFO:tasks.workunit.client.0.smithi012.stdout:3/794: fdatasync d0/d1c/f1e 0 2023-10-21T17:21:11.729 INFO:tasks.workunit.client.0.smithi012.stdout:6/784: dread d13/d42/d89/db8/f8e [0,4194304] 0 2023-10-21T17:21:11.729 INFO:tasks.workunit.client.0.smithi012.stdout:6/785: chown d13/d15/d1d/d5d/d66/d70/l90 71554365 1 2023-10-21T17:21:11.889 INFO:tasks.workunit.client.0.smithi012.stdout:0/890: truncate d7/f36 1368609 0 2023-10-21T17:21:12.129 INFO:tasks.workunit.client.0.smithi012.stdout:5/791: link d2/d4f/d59/d5b/l17 d2/d4f/d7e/d87/d93/dc3/lfd 0 2023-10-21T17:21:12.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/792: readlink d2/d4f/d59/d5b/d1e/l82 0 2023-10-21T17:21:12.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/793: getdents d2/d2c/d8c 0 2023-10-21T17:21:12.162 INFO:tasks.workunit.client.0.smithi012.stdout:5/794: dread d2/d2c/d73/d49/fac [0,4194304] 0 2023-10-21T17:21:12.392 INFO:tasks.workunit.client.0.smithi012.stdout:3/795: mkdir d0/d96/d97/d9b/df1 0 2023-10-21T17:21:12.618 INFO:tasks.workunit.client.0.smithi012.stdout:5/795: creat d2/d4f/d7e/d87/ffe x:0 0 0 2023-10-21T17:21:12.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/750: write d0/f6b [5005082,42046] 0 2023-10-21T17:21:12.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/891: getdents d7/d55/da2 0 2023-10-21T17:21:12.933 INFO:tasks.workunit.client.0.smithi012.stdout:0/892: dwrite d7/d55/d23/d27/d31/f3e [0,4194304] 0 2023-10-21T17:21:13.034 INFO:tasks.workunit.client.0.smithi012.stdout:5/796: mkdir d2/d2c/d8c/dff 0 2023-10-21T17:21:13.121 INFO:tasks.workunit.client.0.smithi012.stdout:9/751: truncate d0/df/d8d/dcb/f55 921372 0 2023-10-21T17:21:13.122 INFO:tasks.workunit.client.0.smithi012.stdout:9/752: chown d0/f3e 126269 1 2023-10-21T17:21:13.686 INFO:tasks.workunit.client.0.smithi012.stdout:0/893: creat d7/d55/d1f/d28/d9b/d8a/f14d x:0 0 0 2023-10-21T17:21:14.103 INFO:tasks.workunit.client.0.smithi012.stdout:9/753: creat d0/df/d8d/dcb/d25/d39/d8e/ff5 x:0 0 0 2023-10-21T17:21:14.272 INFO:tasks.workunit.client.0.smithi012.stdout:1/881: dwrite d5/fbb [0,4194304] 0 2023-10-21T17:21:14.272 INFO:tasks.workunit.client.0.smithi012.stdout:1/882: write d5/d30/d51/f73 [843725,112975] 0 2023-10-21T17:21:14.491 INFO:tasks.workunit.client.0.smithi012.stdout:0/894: creat d7/d55/d23/dce/ddc/d114/d82/d8d/f14e x:0 0 0 2023-10-21T17:21:14.536 INFO:tasks.workunit.client.0.smithi012.stdout:9/754: dread d0/d5/f7e [0,4194304] 0 2023-10-21T17:21:15.084 INFO:tasks.workunit.client.0.smithi012.stdout:4/830: rename dc/l112 to dc/d1e/d33/d7a/l116 0 2023-10-21T17:21:15.571 INFO:tasks.workunit.client.0.smithi012.stdout:0/895: dread d7/d55/d23/dce/ddc/d114/d63/fae [0,4194304] 0 2023-10-21T17:21:15.571 INFO:tasks.workunit.client.0.smithi012.stdout:0/896: chown d7/d55/d23/c7d 21763 1 2023-10-21T17:21:15.963 INFO:tasks.workunit.client.0.smithi012.stdout:3/796: rename d0/d9d/dba to d0/d32/d43/d47/d50/d52/df2 0 2023-10-21T17:21:15.963 INFO:tasks.workunit.client.0.smithi012.stdout:3/797: truncate d0/d32/d43/d47/d50/d52/fa1 450504 0 2023-10-21T17:21:16.047 INFO:tasks.workunit.client.0.smithi012.stdout:3/798: dwrite d0/da/f26 [0,4194304] 0 2023-10-21T17:21:16.047 INFO:tasks.workunit.client.0.smithi012.stdout:3/799: readlink d0/d1c/l25 0 2023-10-21T17:21:16.047 INFO:tasks.workunit.client.0.smithi012.stdout:3/800: write d0/da/f86 [1906107,26693] 0 2023-10-21T17:21:16.047 INFO:tasks.workunit.client.0.smithi012.stdout:3/801: chown d0/d9d 220 1 2023-10-21T17:21:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/802: truncate d0/fbe 97675 0 2023-10-21T17:21:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/803: chown d0/d32/fa9 4946029 1 2023-10-21T17:21:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/804: chown d0/d96/da0/fe0 56 1 2023-10-21T17:21:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/805: creat d0/d96/ff3 x:0 0 0 2023-10-21T17:21:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/806: readlink d0/d32/d43/l99 0 2023-10-21T17:21:16.049 INFO:tasks.workunit.client.0.smithi012.stdout:3/807: dread - d0/d32/d43/d47/dd6/fda zero size 2023-10-21T17:21:16.067 INFO:tasks.workunit.client.0.smithi012.stdout:4/831: creat dc/d1e/dc7/dcc/d10f/d55/f117 x:0 0 0 2023-10-21T17:21:16.281 INFO:tasks.workunit.client.0.smithi012.stdout:9/755: link d0/df/d8d/dcb/d25/d2f/l45 d0/dcd/lf6 0 2023-10-21T17:21:16.282 INFO:tasks.workunit.client.0.smithi012.stdout:9/756: chown d0/d4/d4b/ccc 107792629 1 2023-10-21T17:21:16.282 INFO:tasks.workunit.client.0.smithi012.stdout:9/757: fdatasync d0/d4/d4b/d6a/d89/dbb/fca 0 2023-10-21T17:21:16.282 INFO:tasks.workunit.client.0.smithi012.stdout:9/758: write d0/d4/d4b/f50 [841205,120974] 0 2023-10-21T17:21:16.282 INFO:tasks.workunit.client.0.smithi012.stdout:9/759: write d0/fe6 [540103,34990] 0 2023-10-21T17:21:16.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/760: dwrite d0/d4/f2e [0,4194304] 0 2023-10-21T17:21:16.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/758: sync 2023-10-21T17:21:16.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/836: sync 2023-10-21T17:21:17.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/808: read d0/da/fe [985246,29148] 0 2023-10-21T17:21:17.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/809: write d0/d32/d43/f79 [2692860,60671] 0 2023-10-21T17:21:17.202 INFO:tasks.workunit.client.0.smithi012.stdout:4/832: mknod dc/d1e/dc7/dcc/d10f/d55/d6c/dbb/c118 0 2023-10-21T17:21:17.202 INFO:tasks.workunit.client.0.smithi012.stdout:4/833: readlink dc/d28/l41 0 2023-10-21T17:21:17.203 INFO:tasks.workunit.client.0.smithi012.stdout:4/834: write dc/d93/d99/ff2 [113786,87017] 0 2023-10-21T17:21:17.204 INFO:tasks.workunit.client.0.smithi012.stdout:4/835: stat dc/d1e/dc7/dcc/d10f/d55/fb1 0 2023-10-21T17:21:17.204 INFO:tasks.workunit.client.0.smithi012.stdout:4/836: readlink dc/d93/l113 0 2023-10-21T17:21:17.204 INFO:tasks.workunit.client.0.smithi012.stdout:4/837: truncate dc/d28/fd8 1527253 0 2023-10-21T17:21:17.204 INFO:tasks.workunit.client.0.smithi012.stdout:4/838: chown dc/l10a 462369 1 2023-10-21T17:21:17.487 INFO:tasks.workunit.client.0.smithi012.stdout:9/761: chown d0/df/d8d/dcb/d25/d39/d3b/d67/cac 10601 1 2023-10-21T17:21:17.713 INFO:tasks.workunit.client.0.smithi012.stdout:8/759: creat d0/d1a/db0/dec/ff9 x:0 0 0 2023-10-21T17:21:17.713 INFO:tasks.workunit.client.0.smithi012.stdout:8/760: readlink d0/l44 0 2023-10-21T17:21:17.714 INFO:tasks.workunit.client.0.smithi012.stdout:8/761: readlink d0/d1a/d54/l63 0 2023-10-21T17:21:17.925 INFO:tasks.workunit.client.0.smithi012.stdout:7/837: link d3/da7/daf/lc7 d3/da7/l10c 0 2023-10-21T17:21:18.042 INFO:tasks.workunit.client.0.smithi012.stdout:3/810: symlink d0/d32/d43/d47/d50/d52/lf4 0 2023-10-21T17:21:18.136 INFO:tasks.workunit.client.0.smithi012.stdout:3/811: dwrite d0/f62 [0,4194304] 0 2023-10-21T17:21:18.136 INFO:tasks.workunit.client.0.smithi012.stdout:3/812: fsync d0/d96/d97/f9a 0 2023-10-21T17:21:18.175 INFO:tasks.workunit.client.0.smithi012.stdout:3/813: write d0/d1c/f71 [2808510,75943] 0 2023-10-21T17:21:18.175 INFO:tasks.workunit.client.0.smithi012.stdout:3/814: truncate d0/d32/d43/d47/d50/d52/fc2 340793 0 2023-10-21T17:21:18.212 INFO:tasks.workunit.client.0.smithi012.stdout:4/839: symlink dc/d1e/d33/d7a/l119 0 2023-10-21T17:21:18.289 INFO:tasks.workunit.client.0.smithi012.stdout:9/762: truncate d0/d15/f23 598313 0 2023-10-21T17:21:18.393 INFO:tasks.workunit.client.0.smithi012.stdout:6/786: dwrite d13/d35/d4c/f65 [0,4194304] 0 2023-10-21T17:21:18.393 INFO:tasks.workunit.client.0.smithi012.stdout:6/787: chown d13/d15/d1d/d5d/df8/c101 594496 1 2023-10-21T17:21:18.393 INFO:tasks.workunit.client.0.smithi012.stdout:6/788: creat d13/d15/d1d/d28/d5b/d75/f111 x:0 0 0 2023-10-21T17:21:18.394 INFO:tasks.workunit.client.0.smithi012.stdout:6/789: creat d13/d15/d1d/d28/d5b/d75/f112 x:0 0 0 2023-10-21T17:21:18.394 INFO:tasks.workunit.client.0.smithi012.stdout:6/790: write d13/d64/d6d/d73/ffe [908239,62677] 0 2023-10-21T17:21:18.394 INFO:tasks.workunit.client.0.smithi012.stdout:6/791: creat d13/d15/d1d/d28/d5b/d75/f113 x:0 0 0 2023-10-21T17:21:18.395 INFO:tasks.workunit.client.0.smithi012.stdout:6/792: chown d13/d15/d1d/d5d/d66/d70/l90 19 1 2023-10-21T17:21:18.400 INFO:tasks.workunit.client.0.smithi012.stdout:8/762: dread d0/d1a/db0/dca/fd5 [0,4194304] 0 2023-10-21T17:21:18.482 INFO:tasks.workunit.client.0.smithi012.stdout:8/763: dwrite d0/d1a/f24 [0,4194304] 0 2023-10-21T17:21:18.579 INFO:tasks.workunit.client.0.smithi012.stdout:7/838: rmdir d3/d6/d73 39 2023-10-21T17:21:19.479 INFO:tasks.workunit.client.0.smithi012.stdout:0/897: rmdir d7/d55/d1f/d28/d9b/d8a 39 2023-10-21T17:21:19.480 INFO:tasks.workunit.client.0.smithi012.stdout:0/898: dread - d7/d55/d23/dce/ddc/d114/d82/d8d/fb9 zero size 2023-10-21T17:21:19.480 INFO:tasks.workunit.client.0.smithi012.stdout:0/899: chown d7/f10 63 1 2023-10-21T17:21:19.884 INFO:tasks.workunit.client.0.smithi012.stdout:6/793: creat d13/d35/d4c/f114 x:0 0 0 2023-10-21T17:21:19.903 INFO:tasks.workunit.client.0.smithi012.stdout:8/764: creat d0/d1a/db0/db7/ffa x:0 0 0 2023-10-21T17:21:19.907 INFO:tasks.workunit.client.0.smithi012.stdout:6/794: dread d13/d42/d89/db8/f45 [0,4194304] 0 2023-10-21T17:21:20.069 INFO:tasks.workunit.client.0.smithi012.stdout:7/839: rmdir d3 39 2023-10-21T17:21:20.558 INFO:tasks.workunit.client.0.smithi012.stdout:3/815: mknod d0/d32/cf5 0 2023-10-21T17:21:20.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/763: unlink d0/df/d8d/dcb/d25/d39/d3b/cc0 0 2023-10-21T17:21:21.008 INFO:tasks.workunit.client.0.smithi012.stdout:0/900: truncate d7/d55/f8b 1856550 0 2023-10-21T17:21:21.008 INFO:tasks.workunit.client.0.smithi012.stdout:0/901: readlink d7/l14c 0 2023-10-21T17:21:21.126 INFO:tasks.workunit.client.0.smithi012.stdout:8/765: dread d0/d1a/f1d [0,4194304] 0 2023-10-21T17:21:21.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/795: rename d13/d35/led to d13/d42/d89/db8/deb/l115 0 2023-10-21T17:21:21.866 INFO:tasks.workunit.client.0.smithi012.stdout:8/766: readlink d0/l20 0 2023-10-21T17:21:21.867 INFO:tasks.workunit.client.0.smithi012.stdout:8/767: write d0/f35 [8839222,94131] 0 2023-10-21T17:21:21.920 INFO:tasks.workunit.client.0.smithi012.stdout:7/840: rename d3/d6/dc/d19/d43/l8b to d3/da7/daf/dcd/l10d 0 2023-10-21T17:21:21.921 INFO:tasks.workunit.client.0.smithi012.stdout:7/841: write d3/d6/dc/d19/fff [55307,81367] 0 2023-10-21T17:21:21.921 INFO:tasks.workunit.client.0.smithi012.stdout:7/842: chown d3/c40 10 1 2023-10-21T17:21:21.921 INFO:tasks.workunit.client.0.smithi012.stdout:7/843: dread - d3/d6/dc/d19/d1e/d9d/dda/ff4 zero size 2023-10-21T17:21:22.010 INFO:tasks.workunit.client.0.smithi012.stdout:2/879: sync 2023-10-21T17:21:22.010 INFO:tasks.workunit.client.0.smithi012.stdout:5/797: sync 2023-10-21T17:21:22.011 INFO:tasks.workunit.client.0.smithi012.stdout:5/798: truncate d2/d4f/d59/d5b/f41 4490413 0 2023-10-21T17:21:22.011 INFO:tasks.workunit.client.0.smithi012.stdout:1/883: sync 2023-10-21T17:21:22.011 INFO:tasks.workunit.client.0.smithi012.stdout:5/799: fdatasync d2/d4f/d7e/d87/d57/dc7/dd0/f51 0 2023-10-21T17:21:22.011 INFO:tasks.workunit.client.0.smithi012.stdout:5/800: chown d2/d1d/d4e/fc4 1805864 1 2023-10-21T17:21:22.031 INFO:tasks.workunit.client.0.smithi012.stdout:1/884: dread d5/d30/d51/fb4 [0,4194304] 0 2023-10-21T17:21:22.031 INFO:tasks.workunit.client.0.smithi012.stdout:1/885: creat d5/d32/d1b/d35/d49/d69/f124 x:0 0 0 2023-10-21T17:21:22.083 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:54:48.066 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.095 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:54:48.180 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.099 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:54:48.184 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.106 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:54:48.191 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.110 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:54:48.194 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.110 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:54:48.093 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.184 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:54:48.269 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.185 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:54:48.270 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.260 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:54:48.243 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:21:22.872 INFO:tasks.workunit.client.0.smithi012.stdout:8/768: mknod d0/d62/d83/d4e/cfb 0 2023-10-21T17:21:22.989 INFO:tasks.workunit.client.0.smithi012.stdout:0/902: rename d7/d55/d23/dce/ddc/d114/d48/db7/lbb to d7/dbd/l14f 0 2023-10-21T17:21:23.160 INFO:tasks.workunit.client.0.smithi012.stdout:6/796: symlink d13/d42/d89/db8/l116 0 2023-10-21T17:21:23.161 INFO:tasks.workunit.client.0.smithi012.stdout:6/797: write d13/d15/d1d/f106 [639716,53684] 0 2023-10-21T17:21:23.269 INFO:tasks.workunit.client.0.smithi012.stdout:7/844: link d3/d6/dc/d19/lb5 d3/d6/dc/d19/d1e/d9d/l10e 0 2023-10-21T17:21:23.269 INFO:tasks.workunit.client.0.smithi012.stdout:7/845: creat d3/d6/dc/d19/d1e/d34/da8/db4/dce/f10f x:0 0 0 2023-10-21T17:21:23.536 INFO:tasks.workunit.client.0.smithi012.stdout:2/880: mkdir d1/d14/d16/d58/dec/d82/d125 0 2023-10-21T17:21:23.537 INFO:tasks.workunit.client.0.smithi012.stdout:2/881: truncate d1/d95/fa2 407218 0 2023-10-21T17:21:23.537 INFO:tasks.workunit.client.0.smithi012.stdout:2/882: truncate d1/d14/d16/d58/dec/da5/d50/f9c 431789 0 2023-10-21T17:21:24.385 INFO:tasks.workunit.client.0.smithi012.stdout:0/903: mkdir d7/d55/d23/dce/ddc/d114/d82/d8d/d150 0 2023-10-21T17:21:24.385 INFO:tasks.workunit.client.0.smithi012.stdout:0/904: readlink d7/d52/d53/lfa 0 2023-10-21T17:21:25.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/846: creat d3/da7/daf/dcd/f110 x:0 0 0 2023-10-21T17:21:25.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/847: chown d3/da7/daf/dcd/fbb 17613185 1 2023-10-21T17:21:25.818 INFO:tasks.workunit.client.0.smithi012.stdout:2/883: rename d1/d4/d65/dea/d5f/l101 to d1/d4/d11a/l126 0 2023-10-21T17:21:25.818 INFO:tasks.workunit.client.0.smithi012.stdout:2/884: chown d1/de7 1 1 2023-10-21T17:21:26.254 INFO:tasks.workunit.client.0.smithi012.stdout:8/769: getdents d0/d62/d83/d4e/dc5 0 2023-10-21T17:21:26.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/770: read d0/f16 [6853254,10188] 0 2023-10-21T17:21:26.331 INFO:tasks.workunit.client.0.smithi012.stdout:1/886: mknod d5/d32/d1b/d35/d49/c125 0 2023-10-21T17:21:26.364 INFO:tasks.workunit.client.0.smithi012.stdout:1/887: dread d5/d32/d1b/d2c/d4b/f70 [0,4194304] 0 2023-10-21T17:21:26.413 INFO:tasks.workunit.client.0.smithi012.stdout:0/905: symlink d7/d55/da2/l151 0 2023-10-21T17:21:26.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/906: dwrite d7/d55/d1f/d28/f101 [0,4194304] 0 2023-10-21T17:21:26.552 INFO:tasks.workunit.client.0.smithi012.stdout:4/840: dwrite dc/d93/f50 [0,4194304] 0 2023-10-21T17:21:26.589 INFO:tasks.workunit.client.0.smithi012.stdout:7/848: getdents d3/d6 0 2023-10-21T17:21:26.625 INFO:tasks.workunit.client.0.smithi012.stdout:7/849: dread d3/d16/f32 [0,4194304] 0 2023-10-21T17:21:26.625 INFO:tasks.workunit.client.0.smithi012.stdout:7/850: chown d3/d6/fae 138944 1 2023-10-21T17:21:26.626 INFO:tasks.workunit.client.0.smithi012.stdout:7/851: readlink d3/d6/d73/l10a 0 2023-10-21T17:21:26.702 INFO:tasks.workunit.client.0.smithi012.stdout:7/852: dwrite d3/dd9/ffc [0,4194304] 0 2023-10-21T17:21:26.883 INFO:tasks.workunit.client.0.smithi012.stdout:2/885: symlink d1/d14/d16/d58/dec/d82/l127 0 2023-10-21T17:21:27.052 INFO:tasks.workunit.client.0.smithi012.stdout:8/771: stat d0/d12/l18 0 2023-10-21T17:21:27.134 INFO:tasks.workunit.client.0.smithi012.stdout:1/888: unlink d5/d32/d1b/d35/d3a/d93/fcf 0 2023-10-21T17:21:27.135 INFO:tasks.workunit.client.0.smithi012.stdout:1/889: write d5/d32/d1b/d35/d49/f11e [16171,70804] 0 2023-10-21T17:21:27.201 INFO:tasks.workunit.client.0.smithi012.stdout:1/890: dwrite d5/d32/d1b/d35/d49/d69/f124 [0,4194304] 0 2023-10-21T17:21:27.778 INFO:tasks.workunit.client.0.smithi012.stdout:7/853: mkdir d3/d6/d73/d8e/d111 0 2023-10-21T17:21:28.036 INFO:tasks.workunit.client.0.smithi012.stdout:2/886: creat d1/d4/f128 x:0 0 0 2023-10-21T17:21:28.037 INFO:tasks.workunit.client.0.smithi012.stdout:8/772: mkdir d0/d29/d79/dfc 0 2023-10-21T17:21:28.037 INFO:tasks.workunit.client.0.smithi012.stdout:8/773: read - d0/d62/f76 zero size 2023-10-21T17:21:28.444 INFO:tasks.workunit.client.0.smithi012.stdout:1/891: mkdir d5/d32/d1b/d27/dfb/d108/d126 0 2023-10-21T17:21:28.444 INFO:tasks.workunit.client.0.smithi012.stdout:1/892: chown d5/d32/dce/df9/lc4 5153939 1 2023-10-21T17:21:28.522 INFO:tasks.workunit.client.0.smithi012.stdout:4/841: getdents dc/d1e/da7 0 2023-10-21T17:21:28.522 INFO:tasks.workunit.client.0.smithi012.stdout:4/842: write dc/d15/d2a/d31/df3/f108 [383929,77245] 0 2023-10-21T17:21:28.907 INFO:tasks.workunit.client.0.smithi012.stdout:7/854: creat d3/d6/d73/d8e/d102/d109/f112 x:0 0 0 2023-10-21T17:21:28.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/907: dread d7/d55/f8b [0,4194304] 0 2023-10-21T17:21:29.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/774: mknod d0/d1a/db0/dec/cfd 0 2023-10-21T17:21:29.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/775: dread - d0/d62/d83/d4e/dc5/fe5 zero size 2023-10-21T17:21:29.108 INFO:tasks.workunit.client.0.smithi012.stdout:1/893: truncate d5/d32/d1b/d35/d3a/f3d 2524978 0 2023-10-21T17:21:29.139 INFO:tasks.workunit.client.0.smithi012.stdout:1/894: dread d5/d32/d1b/d2c/d4b/f5d [0,4194304] 0 2023-10-21T17:21:29.385 INFO:tasks.workunit.client.0.smithi012.stdout:4/843: mknod dc/d15/d2a/da9/c11a 0 2023-10-21T17:21:29.834 INFO:tasks.workunit.client.0.smithi012.stdout:7/855: link d3/d6/dc/d19/d43/f61 d3/d6/dc/d19/f113 0 2023-10-21T17:21:29.914 INFO:tasks.workunit.client.0.smithi012.stdout:7/856: dwrite d3/d6/dc/d19/d1e/dc9/feb [0,4194304] 0 2023-10-21T17:21:29.914 INFO:tasks.workunit.client.0.smithi012.stdout:7/857: fsync d3/d16/f1a 0 2023-10-21T17:21:29.997 INFO:tasks.workunit.client.0.smithi012.stdout:9/764: dwrite d0/fe0 [0,4194304] 0 2023-10-21T17:21:29.998 INFO:tasks.workunit.client.0.smithi012.stdout:9/765: write d0/d15/faa [4611753,121085] 0 2023-10-21T17:21:30.401 INFO:tasks.workunit.client.0.smithi012.stdout:0/908: rename d7/dbd/l14f to d7/d55/d23/d27/d40/l152 0 2023-10-21T17:21:31.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/801: dwrite d2/d1d/f56 [8388608,4194304] 0 2023-10-21T17:21:31.395 INFO:tasks.workunit.client.0.smithi012.stdout:7/858: creat d3/d6/dc/d19/d43/f114 x:0 0 0 2023-10-21T17:21:31.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/766: mknod d0/d15/cf7 0 2023-10-21T17:21:31.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/767: fsync d0/da7/fd2 0 2023-10-21T17:21:31.395 INFO:tasks.workunit.client.0.smithi012.stdout:0/909: creat d7/d52/f153 x:0 0 0 2023-10-21T17:21:31.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/910: stat d7/d55/d1f/f104 0 2023-10-21T17:21:31.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/802: mkdir d2/d2c/d73/d49/da9/d100 0 2023-10-21T17:21:32.198 INFO:tasks.workunit.client.0.smithi012.stdout:7/859: creat d3/d6/dc/d19/d1e/d34/da8/f115 x:0 0 0 2023-10-21T17:21:32.199 INFO:tasks.workunit.client.0.smithi012.stdout:7/860: fsync d3/d6/dc/d19/d1e/d34/da8/db4/dce/f10f 0 2023-10-21T17:21:32.320 INFO:tasks.workunit.client.0.smithi012.stdout:9/768: symlink d0/d5/df3/lf8 0 2023-10-21T17:21:32.496 INFO:tasks.workunit.client.0.smithi012.stdout:0/911: rename d7/d55/d1f/c110 to d7/d55/d23/dce/ddc/d114/d82/c154 0 2023-10-21T17:21:32.496 INFO:tasks.workunit.client.0.smithi012.stdout:0/912: readlink d7/d55/d1f/l4e 0 2023-10-21T17:21:32.497 INFO:tasks.workunit.client.0.smithi012.stdout:0/913: fsync d7/d55/d1f/d28/fd4 0 2023-10-21T17:21:33.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/861: symlink d3/d64/l116 0 2023-10-21T17:21:33.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/862: creat d3/d6/dc/d19/d1e/d9d/dda/f117 x:0 0 0 2023-10-21T17:21:33.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/863: dread - d3/d6/dc/d19/d1e/d9d/dda/f117 zero size 2023-10-21T17:21:33.287 INFO:tasks.workunit.client.0.smithi012.stdout:9/769: symlink d0/d4/d4b/ded/lf9 0 2023-10-21T17:21:33.318 INFO:tasks.workunit.client.0.smithi012.stdout:5/803: getdents d2/d2c/d73/d49/d96 0 2023-10-21T17:21:33.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/770: dwrite d0/d15/f92 [0,4194304] 0 2023-10-21T17:21:33.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/771: creat d0/d4/d4b/d6a/d89/de2/ffa x:0 0 0 2023-10-21T17:21:33.406 INFO:tasks.workunit.client.0.smithi012.stdout:5/804: dwrite d2/fe1 [0,4194304] 0 2023-10-21T17:21:33.406 INFO:tasks.workunit.client.0.smithi012.stdout:5/805: truncate d2/d4f/d7e/d87/ffe 382113 0 2023-10-21T17:21:33.680 INFO:tasks.workunit.client.0.smithi012.stdout:7/864: creat d3/d6/dc/d19/d1e/d34/da8/db4/f118 x:0 0 0 2023-10-21T17:21:33.847 INFO:tasks.workunit.client.0.smithi012.stdout:2/887: dwrite d1/d4/d65/dea/d5f/f89 [0,4194304] 0 2023-10-21T17:21:33.847 INFO:tasks.workunit.client.0.smithi012.stdout:2/888: creat d1/de7/f129 x:0 0 0 2023-10-21T17:21:34.406 INFO:tasks.workunit.client.0.smithi012.stdout:9/772: creat d0/d4/d4b/ded/ffb x:0 0 0 2023-10-21T17:21:34.488 INFO:tasks.workunit.client.0.smithi012.stdout:5/806: creat d2/d2c/f101 x:0 0 0 2023-10-21T17:21:34.513 INFO:tasks.workunit.client.0.smithi012.stdout:5/807: write d2/d4f/d7e/d87/d57/d66/daa/fb2 [1278890,16773] 0 2023-10-21T17:21:34.682 INFO:tasks.workunit.client.0.smithi012.stdout:7/865: dread d3/d6/dc/d19/f72 [0,4194304] 0 2023-10-21T17:21:34.682 INFO:tasks.workunit.client.0.smithi012.stdout:7/866: fdatasync d3/d6/fae 0 2023-10-21T17:21:34.712 INFO:tasks.workunit.client.0.smithi012.stdout:7/867: dread d3/d6/dc/d19/d43/f4e [0,4194304] 0 2023-10-21T17:21:34.942 INFO:tasks.workunit.client.0.smithi012.stdout:8/776: write d0/f32 [4779891,36736] 0 2023-10-21T17:21:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/777: dread d0/d29/f7a [0,4194304] 0 2023-10-21T17:21:34.993 INFO:tasks.workunit.client.0.smithi012.stdout:8/778: dread d0/d1a/d54/f5f [0,4194304] 0 2023-10-21T17:21:35.281 INFO:tasks.workunit.client.0.smithi012.stdout:2/889: truncate d1/d14/d16/d58/dec/da5/d34/fb1 1590627 0 2023-10-21T17:21:35.968 INFO:tasks.workunit.client.0.smithi012.stdout:9/773: creat d0/d15/df4/ffc x:0 0 0 2023-10-21T17:21:36.000 INFO:tasks.workunit.client.0.smithi012.stdout:9/774: dread d0/d5/d9d/fb5 [0,4194304] 0 2023-10-21T17:21:36.302 INFO:tasks.workunit.client.0.smithi012.stdout:5/808: truncate d2/d4f/d7e/d87/d57/f9b 514686 0 2023-10-21T17:21:36.828 INFO:tasks.workunit.client.0.smithi012.stdout:7/868: mkdir d3/d6/dc/d19/d1e/d34/da8/db4/dce/d119 0 2023-10-21T17:21:36.828 INFO:tasks.workunit.client.0.smithi012.stdout:7/869: stat d3/d6/dc/d19/d1e/d34/da8/db4 0 2023-10-21T17:21:36.855 INFO:tasks.workunit.client.0.smithi012.stdout:7/870: write d3/d6/dc/d19/d1e/d34/da8/db4/dce/fe2 [3386795,18629] 0 2023-10-21T17:21:36.979 INFO:tasks.workunit.client.0.smithi012.stdout:1/895: dwrite d5/d32/d1b/d35/d49/f7b [4194304,4194304] 0 2023-10-21T17:21:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:2/890: creat d1/d14/d16/f12a x:0 0 0 2023-10-21T17:21:37.101 INFO:tasks.workunit.client.0.smithi012.stdout:4/844: write dc/d93/ff5 [298361,81942] 0 2023-10-21T17:21:37.424 INFO:tasks.workunit.client.0.smithi012.stdout:5/809: mkdir d2/d2c/db6/d102 0 2023-10-21T17:21:37.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/810: write d2/d4f/d7e/d87/d57/d66/f7f [831120,97984] 0 2023-10-21T17:21:37.593 INFO:tasks.workunit.client.0.smithi012.stdout:7/871: mknod d3/da7/de0/c11a 0 2023-10-21T17:21:37.594 INFO:tasks.workunit.client.0.smithi012.stdout:7/872: fdatasync d3/d6/dc/d19/f113 0 2023-10-21T17:21:37.594 INFO:tasks.workunit.client.0.smithi012.stdout:7/873: fdatasync d3/d16/f50 0 2023-10-21T17:21:37.639 INFO:tasks.workunit.client.0.smithi012.stdout:7/874: dread d3/dd9/ffc [0,4194304] 0 2023-10-21T17:21:37.856 INFO:tasks.workunit.client.0.smithi012.stdout:1/896: rename d5/d32/d1b/d35/d3a/d5c/d7c/db7/l11b to d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/d10f/l127 0 2023-10-21T17:21:37.856 INFO:tasks.workunit.client.0.smithi012.stdout:2/891: symlink d1/de7/l12b 0 2023-10-21T17:21:37.856 INFO:tasks.workunit.client.0.smithi012.stdout:2/892: fsync d1/d4/d65/dea/d5f/f109 0 2023-10-21T17:21:38.055 INFO:tasks.workunit.client.0.smithi012.stdout:4/845: link dc/d15/d2a/d58/df8/c111 dc/d15/d18/c11b 0 2023-10-21T17:21:38.187 INFO:tasks.workunit.client.0.smithi012.stdout:4/846: dwrite dc/d1e/dc7/dcc/d10f/fdf [0,4194304] 0 2023-10-21T17:21:38.211 INFO:tasks.workunit.client.0.smithi012.stdout:4/847: write dc/d1e/f3e [2323575,7055] 0 2023-10-21T17:21:38.267 INFO:tasks.workunit.client.0.smithi012.stdout:5/811: truncate d2/d2c/db6/fdd 749499 0 2023-10-21T17:21:38.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:21:38.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:21:38.487 INFO:tasks.workunit.client.0.smithi012.stdout:1/897: mknod d5/d32/d1b/d27/d47/de9/c128 0 2023-10-21T17:21:38.487 INFO:tasks.workunit.client.0.smithi012.stdout:1/898: chown d5/d32/d1b/d35/d49/d69/f124 3 1 2023-10-21T17:21:38.763 INFO:tasks.workunit.client.0.smithi012.stdout:3/816: rmdir d0/da 39 2023-10-21T17:21:38.765 INFO:tasks.workunit.client.0.smithi012.stdout:6/798: sync 2023-10-21T17:21:39.227 INFO:tasks.workunit.client.0.smithi012.stdout:4/848: mknod dc/d1e/dc7/dcc/d10f/c11c 0 2023-10-21T17:21:39.452 INFO:tasks.workunit.client.0.smithi012.stdout:0/914: dwrite d7/d55/d23/dce/ddc/d114/da9/fba [0,4194304] 0 2023-10-21T17:21:39.452 INFO:tasks.workunit.client.0.smithi012.stdout:0/915: dread - d7/d55/d23/dce/ddc/d114/d82/d8d/dea/f106 zero size 2023-10-21T17:21:39.521 INFO:tasks.workunit.client.0.smithi012.stdout:5/812: creat d2/d4f/d7e/d87/dce/f103 x:0 0 0 2023-10-21T17:21:39.522 INFO:tasks.workunit.client.0.smithi012.stdout:5/813: write d2/d4f/d7e/d87/d57/dc7/dd0/f95 [961050,88353] 0 2023-10-21T17:21:39.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/814: dwrite d2/d4f/d7e/d87/d57/dc7/dd0/f69 [0,4194304] 0 2023-10-21T17:21:39.677 INFO:tasks.workunit.client.0.smithi012.stdout:1/899: creat d5/d26/d64/d120/f129 x:0 0 0 2023-10-21T17:21:39.718 INFO:tasks.workunit.client.0.smithi012.stdout:1/900: dread d5/d32/d1b/d35/d3a/d5c/d7c/db7/f107 [4194304,4194304] 0 2023-10-21T17:21:39.788 INFO:tasks.workunit.client.0.smithi012.stdout:3/817: mknod d0/d32/d43/d47/dd6/cf6 0 2023-10-21T17:21:39.900 INFO:tasks.workunit.client.0.smithi012.stdout:6/799: getdents d13/d29/d37/d3b 0 2023-10-21T17:21:40.043 INFO:tasks.workunit.client.0.smithi012.stdout:4/849: mkdir dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/d11d 0 2023-10-21T17:21:40.230 INFO:tasks.workunit.client.0.smithi012.stdout:0/916: chown d7/d52/dd3/fdb 257 1 2023-10-21T17:21:40.230 INFO:tasks.workunit.client.0.smithi012.stdout:0/917: dread - d7/d55/d1f/f50 zero size 2023-10-21T17:21:40.230 INFO:tasks.workunit.client.0.smithi012.stdout:0/918: stat d7/d55/d1f/dfd/l13f 0 2023-10-21T17:21:40.584 INFO:tasks.workunit.client.0.smithi012.stdout:5/815: link d2/d4f/d59/d5b/f41 d2/d4f/d7e/d87/d93/dc3/f104 0 2023-10-21T17:21:40.584 INFO:tasks.workunit.client.0.smithi012.stdout:5/816: readlink d2/lb 0 2023-10-21T17:21:40.584 INFO:tasks.workunit.client.0.smithi012.stdout:5/817: chown d2/d4f/d7e/d87/d93/dc3/f104 179686233 1 2023-10-21T17:21:40.585 INFO:tasks.workunit.client.0.smithi012.stdout:5/818: chown d2/d1d/d4e/fdf 13604422 1 2023-10-21T17:21:40.585 INFO:tasks.workunit.client.0.smithi012.stdout:5/819: fdatasync d2/d4f/d7e/d87/d57/dc7/dd0/f7 0 2023-10-21T17:21:40.585 INFO:tasks.workunit.client.0.smithi012.stdout:5/820: write d2/d1d/d4e/f85 [1926635,50543] 0 2023-10-21T17:21:40.672 INFO:tasks.workunit.client.0.smithi012.stdout:1/901: getdents d5/d32/d1b/d35/d49/d69/df0 0 2023-10-21T17:21:40.673 INFO:tasks.workunit.client.0.smithi012.stdout:1/902: write d5/d32/d1b/d35/fb3 [721119,76618] 0 2023-10-21T17:21:41.166 INFO:tasks.workunit.client.0.smithi012.stdout:6/800: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/f117 x:0 0 0 2023-10-21T17:21:41.232 INFO:tasks.workunit.client.0.smithi012.stdout:4/850: creat dc/d1e/dc7/dcc/f11e x:0 0 0 2023-10-21T17:21:41.351 INFO:tasks.workunit.client.0.smithi012.stdout:0/919: creat d7/d55/d23/dce/ddc/d114/d82/d8d/f155 x:0 0 0 2023-10-21T17:21:41.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/821: getdents d2/d4f/d59 0 2023-10-21T17:21:42.097 INFO:tasks.workunit.client.0.smithi012.stdout:6/801: symlink d13/d15/d1d/d5d/d66/d70/l118 0 2023-10-21T17:21:42.315 INFO:tasks.workunit.client.0.smithi012.stdout:4/851: mknod dc/d93/c11f 0 2023-10-21T17:21:42.415 INFO:tasks.workunit.client.0.smithi012.stdout:5/822: creat d2/d2c/d73/d49/f105 x:0 0 0 2023-10-21T17:21:42.417 INFO:tasks.workunit.client.0.smithi012.stdout:5/823: read d2/d4f/f94 [142665,127346] 0 2023-10-21T17:21:43.272 INFO:tasks.workunit.client.0.smithi012.stdout:6/802: symlink d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/l119 0 2023-10-21T17:21:43.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/852: creat dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/f120 x:0 0 0 2023-10-21T17:21:43.636 INFO:tasks.workunit.client.0.smithi012.stdout:5/824: truncate d2/d4f/fa4 1147340 0 2023-10-21T17:21:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/803: rmdir d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dcf 0 2023-10-21T17:21:44.722 INFO:tasks.workunit.client.0.smithi012.stdout:5/825: unlink d2/d4f/d7e/d87/d93/dc3/f104 0 2023-10-21T17:21:44.723 INFO:tasks.workunit.client.0.smithi012.stdout:5/826: write d2/d2c/db6/fd5 [446950,116262] 0 2023-10-21T17:21:44.723 INFO:tasks.workunit.client.0.smithi012.stdout:5/827: fdatasync d2/d4f/d59/fa5 0 2023-10-21T17:21:44.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/828: write d2/d1d/d20/f48 [1995121,128126] 0 2023-10-21T17:21:44.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/829: fdatasync d2/d4f/d7e/d87/d57/dc7/dd0/de3/fe4 0 2023-10-21T17:21:44.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/830: fsync d2/d4f/d7e/d87/d57/d66/daa/ff8 0 2023-10-21T17:21:44.822 INFO:tasks.workunit.client.0.smithi012.stdout:7/875: dwrite d3/d6/dc/d19/d1e/d7b/f85 [0,4194304] 0 2023-10-21T17:21:44.822 INFO:tasks.workunit.client.0.smithi012.stdout:7/876: chown d3/d6/la 150706 1 2023-10-21T17:21:44.825 INFO:tasks.workunit.client.0.smithi012.stdout:5/831: dwrite d2/d1d/d4e/fdf [0,4194304] 0 2023-10-21T17:21:44.825 INFO:tasks.workunit.client.0.smithi012.stdout:5/832: dread - d2/d1d/d4e/fae zero size 2023-10-21T17:21:44.879 INFO:tasks.workunit.client.0.smithi012.stdout:5/833: dwrite d2/d4f/d7e/d87/fbf [0,4194304] 0 2023-10-21T17:21:44.919 INFO:tasks.workunit.client.0.smithi012.stdout:6/804: symlink d13/d15/d1d/d5d/d66/d70/d74/dc9/l11a 0 2023-10-21T17:21:44.920 INFO:tasks.workunit.client.0.smithi012.stdout:6/805: fsync d13/d15/d1d/d5d/d66/d7a/d97/fe4 0 2023-10-21T17:21:44.920 INFO:tasks.workunit.client.0.smithi012.stdout:6/806: fdatasync d13/d29/d37/f10f 0 2023-10-21T17:21:45.156 INFO:tasks.workunit.client.0.smithi012.stdout:4/853: mknod dc/d15/c121 0 2023-10-21T17:21:45.229 INFO:tasks.workunit.client.0.smithi012.stdout:2/893: dwrite d1/d14/f6e [0,4194304] 0 2023-10-21T17:21:45.229 INFO:tasks.workunit.client.0.smithi012.stdout:2/894: stat d1/d4/f128 0 2023-10-21T17:21:45.254 INFO:tasks.workunit.client.0.smithi012.stdout:7/877: symlink d3/d6/d73/d8e/d102/d109/l11b 0 2023-10-21T17:21:45.745 INFO:tasks.workunit.client.0.smithi012.stdout:5/834: symlink d2/d4f/d7e/d87/d57/dc7/l106 0 2023-10-21T17:21:45.745 INFO:tasks.workunit.client.0.smithi012.stdout:5/835: fdatasync d2/d4f/d7e/d87/d93/dc3/fde 0 2023-10-21T17:21:46.260 INFO:tasks.workunit.client.0.smithi012.stdout:4/854: mknod dc/d1e/da7/c122 0 2023-10-21T17:21:46.261 INFO:tasks.workunit.client.0.smithi012.stdout:4/855: chown dc/l10a 24258760 1 2023-10-21T17:21:46.514 INFO:tasks.workunit.client.0.smithi012.stdout:2/895: mknod d1/d14/d17/d8a/c12c 0 2023-10-21T17:21:47.019 INFO:tasks.workunit.client.0.smithi012.stdout:4/856: mkdir dc/d93/d99/d123 0 2023-10-21T17:21:47.020 INFO:tasks.workunit.client.0.smithi012.stdout:4/857: dread - dc/d1e/dc7/dcc/d10f/d75/de3/fff zero size 2023-10-21T17:21:47.469 INFO:tasks.workunit.client.0.smithi012.stdout:4/858: truncate dc/d15/d2a/d31/f49 2542701 0 2023-10-21T17:21:47.469 INFO:tasks.workunit.client.0.smithi012.stdout:4/859: fdatasync dc/d15/d18/d57/fcf 0 2023-10-21T17:21:47.505 INFO:tasks.workunit.client.0.smithi012.stdout:2/896: dread d1/d4/f7 [0,4194304] 0 2023-10-21T17:21:47.615 INFO:tasks.workunit.client.0.smithi012.stdout:2/897: dwrite d1/f9 [0,4194304] 0 2023-10-21T17:21:48.460 INFO:tasks.workunit.client.0.smithi012.stdout:2/898: mknod d1/d4/d11a/c12d 0 2023-10-21T17:21:48.461 INFO:tasks.workunit.client.0.smithi012.stdout:2/899: fsync d1/d4/d65/dea/ffc 0 2023-10-21T17:21:48.545 INFO:tasks.workunit.client.0.smithi012.stdout:1/903: dwrite d5/d26/d54/f65 [0,4194304] 0 2023-10-21T17:21:48.733 INFO:tasks.workunit.client.0.smithi012.stdout:9/775: creat d0/df/ffd x:0 0 0 2023-10-21T17:21:49.029 INFO:tasks.workunit.client.0.smithi012.stdout:0/920: creat d7/d55/f156 x:0 0 0 2023-10-21T17:21:49.470 INFO:tasks.workunit.client.0.smithi012.stdout:4/860: getdents dc/d1e/dc7/dcc/d10f/d55 0 2023-10-21T17:21:49.471 INFO:tasks.workunit.client.0.smithi012.stdout:4/861: getdents dc/d6b 0 2023-10-21T17:21:49.494 INFO:tasks.workunit.client.0.smithi012.stdout:4/862: write dc/d1e/dc7/dcc/d10f/d75/fcd [1405691,13969] 0 2023-10-21T17:21:49.630 INFO:tasks.workunit.client.0.smithi012.stdout:2/900: symlink d1/d14/d16/d58/dec/da5/d34/dc2/dd9/l12e 0 2023-10-21T17:21:49.844 INFO:tasks.workunit.client.0.smithi012.stdout:9/776: creat d0/d5/d9c/ffe x:0 0 0 2023-10-21T17:21:50.260 INFO:tasks.workunit.client.0.smithi012.stdout:4/863: truncate dc/d15/f5e 2943312 0 2023-10-21T17:21:50.300 INFO:tasks.workunit.client.0.smithi012.stdout:2/901: dread d1/d4/d93/fb4 [4194304,4194304] 0 2023-10-21T17:21:50.329 INFO:tasks.workunit.client.0.smithi012.stdout:2/902: dread d1/d4/f7 [0,4194304] 0 2023-10-21T17:21:50.330 INFO:tasks.workunit.client.0.smithi012.stdout:2/903: stat d1/d14/d17/db9 0 2023-10-21T17:21:50.386 INFO:tasks.workunit.client.0.smithi012.stdout:4/864: dwrite dc/d1e/d33/fd9 [0,4194304] 0 2023-10-21T17:21:50.511 INFO:tasks.workunit.client.0.smithi012.stdout:9/777: creat d0/dcd/fff x:0 0 0 2023-10-21T17:21:50.512 INFO:tasks.workunit.client.0.smithi012.stdout:9/778: stat d0/d15/l66 0 2023-10-21T17:21:50.812 INFO:tasks.workunit.client.0.smithi012.stdout:7/878: dwrite d3/d6/dc/d19/d1e/dc9/f3b [0,4194304] 0 2023-10-21T17:21:50.917 INFO:tasks.workunit.client.0.smithi012.stdout:7/879: dwrite d3/d6/dc/f63 [4194304,4194304] 0 2023-10-21T17:21:51.339 INFO:tasks.workunit.client.0.smithi012.stdout:9/779: mkdir d0/df/d8d/dcb/d25/d100 0 2023-10-21T17:21:51.528 INFO:tasks.workunit.client.0.smithi012.stdout:2/904: mkdir d1/d4/d3f/d41/d59/d12f 0 2023-10-21T17:21:51.576 INFO:tasks.workunit.client.0.smithi012.stdout:2/905: dwrite d1/d14/d16/d58/dec/ff4 [0,4194304] 0 2023-10-21T17:21:51.729 INFO:tasks.workunit.client.0.smithi012.stdout:8/779: unlink d0/l7 0 2023-10-21T17:21:52.417 INFO:tasks.workunit.client.0.smithi012.stdout:8/780: creat d0/d1a/d54/ffe x:0 0 0 2023-10-21T17:21:52.834 INFO:tasks.workunit.client.0.smithi012.stdout:9/780: unlink d0/df/d8d/dcb/d25/d2f/c3d 0 2023-10-21T17:21:52.835 INFO:tasks.workunit.client.0.smithi012.stdout:2/906: mknod d1/d4/d3f/d41/d59/c130 0 2023-10-21T17:21:52.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/781: write d0/df/ffd [670184,52256] 0 2023-10-21T17:21:52.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/782: dread - d0/d4/d4b/fba zero size 2023-10-21T17:21:53.137 INFO:tasks.workunit.client.0.smithi012.stdout:2/907: mknod d1/d14/d17/db9/dd6/d11f/c131 0 2023-10-21T17:21:53.214 INFO:tasks.workunit.client.0.smithi012.stdout:2/908: dwrite d1/d14/d16/d58/dec/da5/d50/ff1 [0,4194304] 0 2023-10-21T17:21:53.215 INFO:tasks.workunit.client.0.smithi012.stdout:2/909: stat d1/d4/d65/dea/ffc 0 2023-10-21T17:21:53.299 INFO:tasks.workunit.client.0.smithi012.stdout:9/783: mkdir d0/d4/d4b/d6a/d89/de2/d101 0 2023-10-21T17:21:53.408 INFO:tasks.workunit.client.0.smithi012.stdout:8/781: getdents d0/d1a/db0/db7 0 2023-10-21T17:21:53.578 INFO:tasks.workunit.client.0.smithi012.stdout:0/921: getdents d7/d55 0 2023-10-21T17:21:53.995 INFO:tasks.workunit.client.0.smithi012.stdout:2/910: symlink d1/d14/d16/d58/dec/da5/d34/l132 0 2023-10-21T17:21:54.185 INFO:tasks.workunit.client.0.smithi012.stdout:8/782: dread d0/d29/d79/f97 [0,4194304] 0 2023-10-21T17:21:54.186 INFO:tasks.workunit.client.0.smithi012.stdout:8/783: truncate d0/f32 5001499 0 2023-10-21T17:21:54.545 INFO:tasks.workunit.client.0.smithi012.stdout:5/836: rmdir d2/d4f/d7e/d87/d57/dc7/dd0 39 2023-10-21T17:21:54.546 INFO:tasks.workunit.client.0.smithi012.stdout:0/922: mkdir d7/d55/d1f/d28/d9b/d8a/d157 0 2023-10-21T17:21:54.546 INFO:tasks.workunit.client.0.smithi012.stdout:2/911: rmdir d1/d14/d17/da6/df9 39 2023-10-21T17:21:55.379 INFO:tasks.workunit.client.0.smithi012.stdout:1/904: unlink d5/c71 0 2023-10-21T17:21:55.379 INFO:tasks.workunit.client.0.smithi012.stdout:1/905: creat d5/d61/f12a x:0 0 0 2023-10-21T17:21:55.379 INFO:tasks.workunit.client.0.smithi012.stdout:1/906: dread - d5/d32/d1b/d27/d86/f115 zero size 2023-10-21T17:21:55.380 INFO:tasks.workunit.client.0.smithi012.stdout:1/907: creat d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/dfd/f12b x:0 0 0 2023-10-21T17:21:55.380 INFO:tasks.workunit.client.0.smithi012.stdout:1/908: truncate d5/d32/d1b/d35/d49/d69/fc9 87541 0 2023-10-21T17:21:55.382 INFO:tasks.workunit.client.0.smithi012.stdout:3/818: rename d0/fef to d0/da/d28/ff7 0 2023-10-21T17:21:55.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/912: stat d1/d14/c31 0 2023-10-21T17:21:55.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/913: write d1/d8/f51 [3623096,84820] 0 2023-10-21T17:21:55.390 INFO:tasks.workunit.client.0.smithi012.stdout:2/914: creat d1/d14/d16/f133 x:0 0 0 2023-10-21T17:21:55.484 INFO:tasks.workunit.client.0.smithi012.stdout:5/837: mknod d2/d4f/d7e/d87/d57/dc7/c107 0 2023-10-21T17:21:55.688 INFO:tasks.workunit.client.0.smithi012.stdout:0/923: truncate d7/d55/d23/dce/ddc/d114/f49 3401886 0 2023-10-21T17:21:56.148 INFO:tasks.workunit.client.0.smithi012.stdout:1/909: rmdir d5/d30 39 2023-10-21T17:21:56.184 INFO:tasks.workunit.client.0.smithi012.stdout:1/910: write d5/fbb [24906,15666] 0 2023-10-21T17:21:56.185 INFO:tasks.workunit.client.0.smithi012.stdout:1/911: truncate d5/d32/d1b/d27/d47/f11c 4926454 0 2023-10-21T17:21:56.275 INFO:tasks.workunit.client.0.smithi012.stdout:1/912: dwrite d5/d32/d1b/d2c/d4b/d8a/f11a [0,4194304] 0 2023-10-21T17:21:56.275 INFO:tasks.workunit.client.0.smithi012.stdout:1/913: stat d5/d32/d1b/d35/d49/f11e 0 2023-10-21T17:21:58.582 INFO:tasks.workunit.client.0.smithi012.stdout:5/838: creat d2/d2c/d73/d49/da9/d100/f108 x:0 0 0 2023-10-21T17:21:58.851 INFO:tasks.workunit.client.0.smithi012.stdout:0/924: mknod d7/d55/d23/dce/ddc/d114/c158 0 2023-10-21T17:21:58.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/914: creat d5/d32/d1b/d27/f12c x:0 0 0 2023-10-21T17:21:58.852 INFO:tasks.workunit.client.0.smithi012.stdout:0/925: fdatasync d7/d55/d23/d27/fc7 0 2023-10-21T17:21:58.902 INFO:tasks.workunit.client.0.smithi012.stdout:6/807: rename d13/d35/f3a to d13/d42/d89/db8/f11b 0 2023-10-21T17:21:58.903 INFO:tasks.workunit.client.0.smithi012.stdout:6/808: fdatasync d13/d64/fd1 0 2023-10-21T17:21:59.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/784: write d0/d62/f6b [4775256,61590] 0 2023-10-21T17:21:59.483 INFO:tasks.workunit.client.0.smithi012.stdout:1/915: creat d5/d32/dce/f12d x:0 0 0 2023-10-21T17:21:59.570 INFO:tasks.workunit.client.0.smithi012.stdout:0/926: symlink d7/d55/d23/dce/ddc/d114/d48/d88/d11d/l159 0 2023-10-21T17:21:59.859 INFO:tasks.workunit.client.0.smithi012.stdout:6/809: dread d13/d15/d1d/d5d/d92/fd9 [0,4194304] 0 2023-10-21T17:22:00.250 INFO:tasks.workunit.client.0.smithi012.stdout:8/785: truncate d0/d62/f73 4791491 0 2023-10-21T17:22:00.250 INFO:tasks.workunit.client.0.smithi012.stdout:8/786: chown d0/d12/d80/l5c 480060 1 2023-10-21T17:22:00.250 INFO:tasks.workunit.client.0.smithi012.stdout:8/787: chown d0/d12/ld0 233946978 1 2023-10-21T17:22:00.631 INFO:tasks.workunit.client.0.smithi012.stdout:6/810: truncate d13/d35/d4c/f65 3992465 0 2023-10-21T17:22:00.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/927: dread d7/f36 [0,4194304] 0 2023-10-21T17:22:00.770 INFO:tasks.workunit.client.0.smithi012.stdout:0/928: dwrite d7/d55/d23/dce/ddc/d114/d48/de2/f105 [4194304,4194304] 0 2023-10-21T17:22:00.778 INFO:tasks.workunit.client.0.smithi012.stdout:0/929: write d7/d52/df7/ff8 [861550,24353] 0 2023-10-21T17:22:00.778 INFO:tasks.workunit.client.0.smithi012.stdout:0/930: write d7/d52/df7/ff8 [1785895,65197] 0 2023-10-21T17:22:02.225 INFO:tasks.workunit.client.0.smithi012.stdout:5/839: dwrite d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:22:02.226 INFO:tasks.workunit.client.0.smithi012.stdout:0/931: truncate d7/d52/d90/fbe 4051276 0 2023-10-21T17:22:02.226 INFO:tasks.workunit.client.0.smithi012.stdout:0/932: fdatasync d7/d52/dd3/fdb 0 2023-10-21T17:22:02.261 INFO:tasks.workunit.client.0.smithi012.stdout:0/933: write d7/d55/d1f/d28/d9b/f6f [312096,28914] 0 2023-10-21T17:22:02.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/840: dread d2/d2c/fab [0,4194304] 0 2023-10-21T17:22:02.270 INFO:tasks.workunit.client.0.smithi012.stdout:5/841: chown d2/d4f/lfb 19 1 2023-10-21T17:22:02.270 INFO:tasks.workunit.client.0.smithi012.stdout:5/842: truncate d2/d4f/d7e/d87/d57/d66/daa/ff8 699717 0 2023-10-21T17:22:02.289 INFO:tasks.workunit.client.0.smithi012.stdout:5/843: dread d2/d4f/d7e/d87/fbf [0,4194304] 0 2023-10-21T17:22:02.289 INFO:tasks.workunit.client.0.smithi012.stdout:5/844: fdatasync d2/d4f/d59/d5b/d1e/f26 0 2023-10-21T17:22:02.289 INFO:tasks.workunit.client.0.smithi012.stdout:5/845: fdatasync d2/d4f/fb0 0 2023-10-21T17:22:02.511 INFO:tasks.workunit.client.0.smithi012.stdout:4/865: link dc/d1e/d33/d8a/lba dc/l124 0 2023-10-21T17:22:02.512 INFO:tasks.workunit.client.0.smithi012.stdout:4/866: write dc/d93/d99/fb0 [1028527,34057] 0 2023-10-21T17:22:02.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/867: write dc/d1e/dc7/dcc/d10f/d75/fcd [7158124,110198] 0 2023-10-21T17:22:02.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/868: fsync dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/f120 0 2023-10-21T17:22:02.548 INFO:tasks.workunit.client.0.smithi012.stdout:4/869: creat dc/d93/d99/f125 x:0 0 0 2023-10-21T17:22:02.548 INFO:tasks.workunit.client.0.smithi012.stdout:4/870: stat dc/d1e/dc7/dcc/d10f/c11c 0 2023-10-21T17:22:03.093 INFO:tasks.workunit.client.0.smithi012.stdout:5/846: unlink d2/d2c/l70 0 2023-10-21T17:22:03.799 INFO:tasks.workunit.client.0.smithi012.stdout:4/871: creat dc/d1e/dc7/dcc/d10f/d55/f126 x:0 0 0 2023-10-21T17:22:03.863 INFO:tasks.workunit.client.0.smithi012.stdout:4/872: dwrite dc/d1e/d33/d8a/fb9 [0,4194304] 0 2023-10-21T17:22:03.864 INFO:tasks.workunit.client.0.smithi012.stdout:4/873: dread - dc/d1e/d91/fc8 zero size 2023-10-21T17:22:03.921 INFO:tasks.workunit.client.0.smithi012.stdout:4/874: dwrite dc/d93/d99/fb0 [0,4194304] 0 2023-10-21T17:22:03.958 INFO:tasks.workunit.client.0.smithi012.stdout:5/847: stat d2/d4f/d7e/d87/d93/dc3/lfd 0 2023-10-21T17:22:03.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/916: creat d5/d32/f12e x:0 0 0 2023-10-21T17:22:03.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/917: chown d5/d32/d1b/d35/d3a/d5c/d7c/db7/fc6 82131 1 2023-10-21T17:22:03.995 INFO:tasks.workunit.client.0.smithi012.stdout:5/848: dread d2/d1d/d4e/f5c [0,4194304] 0 2023-10-21T17:22:03.996 INFO:tasks.workunit.client.0.smithi012.stdout:5/849: dread - d2/d4f/d7e/d87/dce/f103 zero size 2023-10-21T17:22:04.012 INFO:tasks.workunit.client.0.smithi012.stdout:6/811: dread d13/d35/d4c/f65 [0,4194304] 0 2023-10-21T17:22:04.033 INFO:tasks.workunit.client.0.smithi012.stdout:5/850: dread d2/d1d/d4e/f85 [0,4194304] 0 2023-10-21T17:22:04.033 INFO:tasks.workunit.client.0.smithi012.stdout:5/851: fdatasync d2/d1d/fa8 0 2023-10-21T17:22:04.034 INFO:tasks.workunit.client.0.smithi012.stdout:5/852: stat d2/d1d/d4e/lbe 0 2023-10-21T17:22:04.065 INFO:tasks.workunit.client.0.smithi012.stdout:8/788: dwrite d0/d29/d79/f97 [0,4194304] 0 2023-10-21T17:22:04.092 INFO:tasks.workunit.client.0.smithi012.stdout:8/789: read d0/d1a/f24 [2949075,111572] 0 2023-10-21T17:22:04.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/875: symlink dc/d1e/d33/d8a/ddb/l127 0 2023-10-21T17:22:04.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/876: dread - dc/d1e/dc7/dcc/d10f/d55/f117 zero size 2023-10-21T17:22:04.670 INFO:tasks.workunit.client.0.smithi012.stdout:1/918: mknod d5/d61/c12f 0 2023-10-21T17:22:04.703 INFO:tasks.workunit.client.0.smithi012.stdout:1/919: dread d5/d32/d1b/d27/dfb/d108/d4f/fac [0,4194304] 0 2023-10-21T17:22:04.821 INFO:tasks.workunit.client.0.smithi012.stdout:6/812: mknod d13/d64/d6d/d73/c11c 0 2023-10-21T17:22:04.821 INFO:tasks.workunit.client.0.smithi012.stdout:6/813: readlink d13/d15/d1d/d5d/d66/l9d 0 2023-10-21T17:22:04.957 INFO:tasks.workunit.client.0.smithi012.stdout:3/819: sync 2023-10-21T17:22:04.957 INFO:tasks.workunit.client.0.smithi012.stdout:3/820: dread - d0/d32/d43/d47/d50/d52/f53 zero size 2023-10-21T17:22:04.989 INFO:tasks.workunit.client.0.smithi012.stdout:5/853: mkdir d2/d2c/d73/d109 0 2023-10-21T17:22:04.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/854: chown d2/d4f/d7e/d87/d57/dc7/dd0/de3/cfa 9465 1 2023-10-21T17:22:05.216 INFO:tasks.workunit.client.0.smithi012.stdout:7/880: rename d3/l107 to d3/d64/l11c 0 2023-10-21T17:22:05.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/790: mknod d0/d12/d80/cff 0 2023-10-21T17:22:05.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/791: fdatasync d0/d29/f3c 0 2023-10-21T17:22:05.696 INFO:tasks.workunit.client.0.smithi012.stdout:1/920: link d5/d32/d1b/d27/fcd d5/d32/dce/df9/de7/f130 0 2023-10-21T17:22:05.697 INFO:tasks.workunit.client.0.smithi012.stdout:1/921: chown d5/d32/f17 3552 1 2023-10-21T17:22:05.800 INFO:tasks.workunit.client.0.smithi012.stdout:3/821: creat d0/da/ff8 x:0 0 0 2023-10-21T17:22:05.971 INFO:tasks.workunit.client.0.smithi012.stdout:5/855: symlink d2/d2c/d8c/db3/l10a 0 2023-10-21T17:22:06.094 INFO:tasks.workunit.client.0.smithi012.stdout:7/881: dwrite d3/d16/f1a [0,4194304] 0 2023-10-21T17:22:06.228 INFO:tasks.workunit.client.0.smithi012.stdout:9/784: rename d0/f78 to d0/d5/f102 0 2023-10-21T17:22:06.369 INFO:tasks.workunit.client.0.smithi012.stdout:8/792: mknod d0/d12/d80/c100 0 2023-10-21T17:22:06.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/877: truncate dc/d15/f47 698779 0 2023-10-21T17:22:06.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/878: chown dc/d1e/f4b 19893589 1 2023-10-21T17:22:06.943 INFO:tasks.workunit.client.0.smithi012.stdout:3/822: write d0/da/d28/fe1 [991528,108198] 0 2023-10-21T17:22:07.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/856: unlink d2/d1d/d4e/f65 0 2023-10-21T17:22:07.825 INFO:tasks.workunit.client.0.smithi012.stdout:2/915: rename d1/d14/d16/d58/dec/da5/d50/f68 to d1/d14/d16/d58/dec/da5/d34/dc2/f134 0 2023-10-21T17:22:07.826 INFO:tasks.workunit.client.0.smithi012.stdout:2/916: write d1/d95/f9e [400951,82541] 0 2023-10-21T17:22:07.826 INFO:tasks.workunit.client.0.smithi012.stdout:2/917: chown d1/d4/d3f/d41/d59/cee 1329519 1 2023-10-21T17:22:07.940 INFO:tasks.workunit.client.0.smithi012.stdout:9/785: mkdir d0/d15/d103 0 2023-10-21T17:22:07.958 INFO:tasks.workunit.client.0.smithi012.stdout:9/786: dread d0/df/ffd [0,4194304] 0 2023-10-21T17:22:07.989 INFO:tasks.workunit.client.0.smithi012.stdout:8/793: creat d0/d1a/db0/dca/f101 x:0 0 0 2023-10-21T17:22:08.243 INFO:tasks.workunit.client.0.smithi012.stdout:4/879: mkdir dc/d15/d2a/dce/d128 0 2023-10-21T17:22:08.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:22:08.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:22:08.529 INFO:tasks.workunit.client.0.smithi012.stdout:5/857: truncate d2/d1d/d4e/f78 1978348 0 2023-10-21T17:22:08.566 INFO:tasks.workunit.client.0.smithi012.stdout:5/858: dwrite d2/d2c/d73/d49/da9/d100/f108 [0,4194304] 0 2023-10-21T17:22:08.574 INFO:tasks.workunit.client.0.smithi012.stdout:7/882: truncate d3/d6/dc/d19/d1e/f5c 5154006 0 2023-10-21T17:22:08.714 INFO:tasks.workunit.client.0.smithi012.stdout:0/934: rename d7/dbd/fc3 to d7/d55/d23/dce/ddc/d114/da9/d107/f15a 0 2023-10-21T17:22:08.715 INFO:tasks.workunit.client.0.smithi012.stdout:0/935: write d7/d81/fc4 [2956732,117680] 0 2023-10-21T17:22:08.754 INFO:tasks.workunit.client.0.smithi012.stdout:0/936: read d7/d81/fc9 [3767293,111157] 0 2023-10-21T17:22:08.783 INFO:tasks.workunit.client.0.smithi012.stdout:2/918: symlink d1/d14/d17/db9/l135 0 2023-10-21T17:22:08.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/787: dread d0/df/d8d/dcb/d25/d39/f86 [0,4194304] 0 2023-10-21T17:22:08.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/788: chown d0/df/d8d/dcb/d2a/f7f 112578010 1 2023-10-21T17:22:08.867 INFO:tasks.workunit.client.0.smithi012.stdout:9/789: read d0/d4/d4b/d6a/fae [4563870,31297] 0 2023-10-21T17:22:08.954 INFO:tasks.workunit.client.0.smithi012.stdout:8/794: getdents d0/d1a/db0/db7/dd8/dda 0 2023-10-21T17:22:09.072 INFO:tasks.workunit.client.0.smithi012.stdout:4/880: mkdir dc/d15/d2a/d129 0 2023-10-21T17:22:09.633 INFO:tasks.workunit.client.0.smithi012.stdout:7/883: mkdir d3/d6/dc/d19/d11d 0 2023-10-21T17:22:09.633 INFO:tasks.workunit.client.0.smithi012.stdout:6/814: rename d13/d42/d89/c9c to d13/d29/d37/d3b/c11d 0 2023-10-21T17:22:09.660 INFO:tasks.workunit.client.0.smithi012.stdout:7/884: dread d3/d6/dc/d19/d1e/dc9/f87 [0,4194304] 0 2023-10-21T17:22:09.736 INFO:tasks.workunit.client.0.smithi012.stdout:7/885: dwrite d3/d16/fe5 [0,4194304] 0 2023-10-21T17:22:09.736 INFO:tasks.workunit.client.0.smithi012.stdout:7/886: chown d3/d6/dc/d19/d1e/d9d/dec/fe3 122 1 2023-10-21T17:22:09.795 INFO:tasks.workunit.client.0.smithi012.stdout:0/937: read d7/d55/d23/d27/d31/f91 [18705,106942] 0 2023-10-21T17:22:09.795 INFO:tasks.workunit.client.0.smithi012.stdout:9/790: symlink d0/df/d8d/dcb/d25/d39/l104 0 2023-10-21T17:22:09.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/795: creat d0/d12/d51/f102 x:0 0 0 2023-10-21T17:22:10.025 INFO:tasks.workunit.client.0.smithi012.stdout:8/796: dwrite d0/d12/ff6 [0,4194304] 0 2023-10-21T17:22:10.025 INFO:tasks.workunit.client.0.smithi012.stdout:8/797: readlink d0/d12/d80/le7 0 2023-10-21T17:22:10.026 INFO:tasks.workunit.client.0.smithi012.stdout:8/798: fsync d0/d12/d6c/db1/fbd 0 2023-10-21T17:22:10.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/815: rmdir d13/d15/d1d/d28/d5b/dee 39 2023-10-21T17:22:11.003 INFO:tasks.workunit.client.0.smithi012.stdout:7/887: mknod d3/d6/d73/d8e/d102/d109/c11e 0 2023-10-21T17:22:11.137 INFO:tasks.workunit.client.0.smithi012.stdout:2/919: link d1/d14/d16/d58/dec/da5/f57 d1/d4/d3f/f136 0 2023-10-21T17:22:11.138 INFO:tasks.workunit.client.0.smithi012.stdout:2/920: creat d1/d8/f137 x:0 0 0 2023-10-21T17:22:11.306 INFO:tasks.workunit.client.0.smithi012.stdout:0/938: creat d7/d55/d23/dce/ddc/d114/d82/d8d/dea/f15b x:0 0 0 2023-10-21T17:22:11.999 INFO:tasks.workunit.client.0.smithi012.stdout:8/799: mkdir d0/d29/d79/dfc/d103 0 2023-10-21T17:22:12.107 INFO:tasks.workunit.client.0.smithi012.stdout:8/800: dwrite d0/d62/d7d/dcf/fd6 [0,4194304] 0 2023-10-21T17:22:12.327 INFO:tasks.workunit.client.0.smithi012.stdout:1/922: rename d5/d26/l98 to d5/d32/d1b/d35/d3a/d5c/d7c/l131 0 2023-10-21T17:22:12.408 INFO:tasks.workunit.client.0.smithi012.stdout:1/923: dwrite d5/d32/d1b/d2c/d4b/d8a/fe6 [0,4194304] 0 2023-10-21T17:22:12.705 INFO:tasks.workunit.client.0.smithi012.stdout:2/921: unlink d1/d14/d16/d58/dec/da5/d50/f9c 0 2023-10-21T17:22:12.705 INFO:tasks.workunit.client.0.smithi012.stdout:0/939: symlink d7/d52/df7/l15c 0 2023-10-21T17:22:12.778 INFO:tasks.workunit.client.0.smithi012.stdout:0/940: dwrite d7/d55/d23/dce/ddc/d114/d48/d88/d144/f123 [0,4194304] 0 2023-10-21T17:22:12.779 INFO:tasks.workunit.client.0.smithi012.stdout:0/941: truncate d7/d55/d23/dce/f138 150929 0 2023-10-21T17:22:12.779 INFO:tasks.workunit.client.0.smithi012.stdout:0/942: dread - d7/d55/d23/d27/d31/d5f/fad zero size 2023-10-21T17:22:13.875 INFO:tasks.workunit.client.0.smithi012.stdout:2/922: chown d1/d4/d3f/d41/fdd 9497 1 2023-10-21T17:22:14.244 INFO:tasks.workunit.client.0.smithi012.stdout:0/943: creat d7/d55/d23/dce/ddc/d114/d82/f15d x:0 0 0 2023-10-21T17:22:14.574 INFO:tasks.workunit.client.0.smithi012.stdout:3/823: rename d0/d32/d43/d47/d50/d52/df2 to d0/da/d28/df9 0 2023-10-21T17:22:14.671 INFO:tasks.workunit.client.0.smithi012.stdout:2/923: readlink d1/d14/l26 0 2023-10-21T17:22:14.747 INFO:tasks.workunit.client.0.smithi012.stdout:2/924: dwrite d1/d14/d16/d58/dec/da5/d50/ff1 [0,4194304] 0 2023-10-21T17:22:14.748 INFO:tasks.workunit.client.0.smithi012.stdout:2/925: write d1/d14/d16/d58/dec/da5/d34/fa1 [144663,48804] 0 2023-10-21T17:22:14.748 INFO:tasks.workunit.client.0.smithi012.stdout:2/926: readlink d1/d14/d16/d58/dec/d82/l127 0 2023-10-21T17:22:14.749 INFO:tasks.workunit.client.0.smithi012.stdout:2/927: dread - d1/d4/d3f/d41/d59/ff3 zero size 2023-10-21T17:22:14.749 INFO:tasks.workunit.client.0.smithi012.stdout:2/928: dread - d1/d4/d65/dea/f42 zero size 2023-10-21T17:22:14.749 INFO:tasks.workunit.client.0.smithi012.stdout:2/929: chown d1/d14/d16/d58/dec/da5/ff8 6499 1 2023-10-21T17:22:14.795 INFO:tasks.workunit.client.0.smithi012.stdout:2/930: read d1/d14/d16/d58/dec/da5/d34/fa4 [2157960,51646] 0 2023-10-21T17:22:14.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/944: creat d7/d55/d23/dce/ddc/d114/df9/f15e x:0 0 0 2023-10-21T17:22:15.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/945: creat d7/d55/da2/f15f x:0 0 0 2023-10-21T17:22:15.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/946: readlink d7/d52/l9a 0 2023-10-21T17:22:15.564 INFO:tasks.workunit.client.0.smithi012.stdout:0/947: creat d7/d55/d23/d27/dcf/f160 x:0 0 0 2023-10-21T17:22:15.564 INFO:tasks.workunit.client.0.smithi012.stdout:0/948: truncate d7/d81/fc4 3309803 0 2023-10-21T17:22:15.955 INFO:tasks.workunit.client.0.smithi012.stdout:3/824: truncate d0/da/f26 2239437 0 2023-10-21T17:22:15.955 INFO:tasks.workunit.client.0.smithi012.stdout:3/825: write d0/d32/d43/f79 [2849865,82531] 0 2023-10-21T17:22:16.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/949: dread d7/d52/d53/fdd [0,4194304] 0 2023-10-21T17:22:16.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/950: chown d7/d55/da2/cd8 48 1 2023-10-21T17:22:16.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/951: chown d7/d81/fc4 2767710 1 2023-10-21T17:22:16.401 INFO:tasks.workunit.client.0.smithi012.stdout:0/952: dread d7/f19 [0,4194304] 0 2023-10-21T17:22:17.212 INFO:tasks.workunit.client.0.smithi012.stdout:3/826: unlink d0/l3 0 2023-10-21T17:22:17.607 INFO:tasks.workunit.client.0.smithi012.stdout:0/953: mknod d7/d55/d23/d30/c161 0 2023-10-21T17:22:17.841 INFO:tasks.workunit.client.0.smithi012.stdout:8/801: write d0/d1a/f41 [66811,13412] 0 2023-10-21T17:22:17.967 INFO:tasks.workunit.client.0.smithi012.stdout:2/931: write d1/d8/ff [439421,9487] 0 2023-10-21T17:22:18.317 INFO:tasks.workunit.client.0.smithi012.stdout:3/827: truncate d0/d32/d43/d47/d50/d52/fa1 237104 0 2023-10-21T17:22:18.317 INFO:tasks.workunit.client.0.smithi012.stdout:8/802: mknod d0/d62/d83/d4e/dc5/c104 0 2023-10-21T17:22:18.429 INFO:tasks.workunit.client.0.smithi012.stdout:8/803: dwrite d0/f11 [4194304,4194304] 0 2023-10-21T17:22:18.450 INFO:tasks.workunit.client.0.smithi012.stdout:2/932: mkdir d1/d14/d16/d58/dec/da5/d50/da3/d138 0 2023-10-21T17:22:18.743 INFO:tasks.workunit.client.0.smithi012.stdout:2/933: mknod d1/d14/d16/d58/dec/da5/d34/dc2/dd9/c139 0 2023-10-21T17:22:18.743 INFO:tasks.workunit.client.0.smithi012.stdout:2/934: getdents d1/d14/d16/d58/dec/da5/d50/da3/d138 0 2023-10-21T17:22:19.814 INFO:tasks.workunit.client.0.smithi012.stdout:8/804: creat d0/d12/f105 x:0 0 0 2023-10-21T17:22:19.913 INFO:tasks.workunit.client.0.smithi012.stdout:5/859: rename d2/f18 to d2/d2c/d8c/dff/f10b 0 2023-10-21T17:22:20.118 INFO:tasks.workunit.client.0.smithi012.stdout:3/828: write d0/d32/d43/d47/f83 [939103,80357] 0 2023-10-21T17:22:20.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/805: rmdir d0/d62/d83/d4e/dc5 39 2023-10-21T17:22:20.639 INFO:tasks.workunit.client.0.smithi012.stdout:4/881: rename dc/f67 to dc/d1e/dc7/f12a 0 2023-10-21T17:22:20.639 INFO:tasks.workunit.client.0.smithi012.stdout:4/882: fdatasync dc/d1e/dc7/dcc/d10f/d55/f9c 0 2023-10-21T17:22:20.674 INFO:tasks.workunit.client.0.smithi012.stdout:4/883: dread dc/d1e/dc7/dcc/d10f/d55/f90 [0,4194304] 0 2023-10-21T17:22:20.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/860: dread d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:22:20.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/861: write d2/d1d/d4e/f5c [4572655,126995] 0 2023-10-21T17:22:20.678 INFO:tasks.workunit.client.0.smithi012.stdout:3/829: creat d0/d96/d97/d9b/ffa x:0 0 0 2023-10-21T17:22:20.890 INFO:tasks.workunit.client.0.smithi012.stdout:9/791: rename d0/df/cea to d0/d4/d4b/d6a/d89/dbb/c105 0 2023-10-21T17:22:21.480 INFO:tasks.workunit.client.0.smithi012.stdout:4/884: link dc/d1e/dc7/dcc/d10f/d55/f9c dc/d93/d99/d123/f12b 0 2023-10-21T17:22:21.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/862: link d2/d4f/d59/d5b/d1e/cf0 d2/d4f/d7e/d87/d93/dc3/c10c 0 2023-10-21T17:22:23.172 INFO:tasks.workunit.client.0.smithi012.stdout:6/816: rename d13/d42/d89/db8/fa7 to d13/d64/d6d/f11e 0 2023-10-21T17:22:23.419 INFO:tasks.workunit.client.0.smithi012.stdout:5/863: creat d2/d4f/d59/f10d x:0 0 0 2023-10-21T17:22:23.419 INFO:tasks.workunit.client.0.smithi012.stdout:5/864: truncate d2/d1d/d4e/fae 290296 0 2023-10-21T17:22:23.419 INFO:tasks.workunit.client.0.smithi012.stdout:5/865: write d2/d4f/d7e/d87/dce/ff3 [217736,65042] 0 2023-10-21T17:22:24.308 INFO:tasks.workunit.client.0.smithi012.stdout:7/888: rename d3/d6/dc/d19/f22 to d3/d6/dc/f11f 0 2023-10-21T17:22:24.327 INFO:tasks.workunit.client.0.smithi012.stdout:3/830: write d0/da/f26 [2163981,128866] 0 2023-10-21T17:22:24.327 INFO:tasks.workunit.client.0.smithi012.stdout:3/831: write d0/d96/da0/fe0 [278339,65499] 0 2023-10-21T17:22:24.327 INFO:tasks.workunit.client.0.smithi012.stdout:3/832: truncate d0/d96/fe6 445039 0 2023-10-21T17:22:24.552 INFO:tasks.workunit.client.0.smithi012.stdout:9/792: symlink d0/df/d8d/dcb/d25/d39/d3b/l106 0 2023-10-21T17:22:24.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/866: creat d2/db5/f10e x:0 0 0 2023-10-21T17:22:24.752 INFO:tasks.workunit.client.0.smithi012.stdout:4/885: truncate dc/d1e/dc7/dcc/d10f/d55/d6c/dbb/fcb 1611039 0 2023-10-21T17:22:24.784 INFO:tasks.workunit.client.0.smithi012.stdout:5/867: dread d2/d2c/d73/d49/da9/fcb [0,4194304] 0 2023-10-21T17:22:24.841 INFO:tasks.workunit.client.0.smithi012.stdout:4/886: dwrite dc/d15/d2a/d58/de1/ffb [0,4194304] 0 2023-10-21T17:22:25.428 INFO:tasks.workunit.client.0.smithi012.stdout:3/833: mknod d0/d32/d43/dca/cfb 0 2023-10-21T17:22:25.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/868: mknod d2/d4f/d7e/d87/dce/c10f 0 2023-10-21T17:22:25.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/869: creat d2/d4f/d7e/d87/d93/dc3/f110 x:0 0 0 2023-10-21T17:22:25.604 INFO:tasks.workunit.client.0.smithi012.stdout:5/870: readlink d2/d1d/d20/l50 0 2023-10-21T17:22:25.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/871: dread d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:22:26.057 INFO:tasks.workunit.client.0.smithi012.stdout:8/806: sync 2023-10-21T17:22:26.600 INFO:tasks.workunit.client.0.smithi012.stdout:3/834: link d0/da/d28/df9/ld3 d0/d96/d97/d9b/df1/lfc 0 2023-10-21T17:22:26.600 INFO:tasks.workunit.client.0.smithi012.stdout:3/835: write d0/da/d28/f38 [435762,39511] 0 2023-10-21T17:22:26.629 INFO:tasks.workunit.client.0.smithi012.stdout:3/836: dread d0/d1c/f1e [4194304,4194304] 0 2023-10-21T17:22:26.775 INFO:tasks.workunit.client.0.smithi012.stdout:9/793: link d0/df/d8d/dcb/d25/d39/d3b/cb3 d0/d4/c107 0 2023-10-21T17:22:27.292 INFO:tasks.workunit.client.0.smithi012.stdout:5/872: truncate d2/d2c/d73/d49/fac 2344405 0 2023-10-21T17:22:27.365 INFO:tasks.workunit.client.0.smithi012.stdout:5/873: dwrite d2/d2c/d73/d49/f105 [0,4194304] 0 2023-10-21T17:22:27.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/807: rmdir d0/d1a/db0/dea 39 2023-10-21T17:22:27.686 INFO:tasks.workunit.client.0.smithi012.stdout:6/817: dwrite f10 [0,4194304] 0 2023-10-21T17:22:27.778 INFO:tasks.workunit.client.0.smithi012.stdout:7/889: link d3/d29/l86 d3/l120 0 2023-10-21T17:22:27.983 INFO:tasks.workunit.client.0.smithi012.stdout:1/924: rename d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/d10f to d5/d32/d1b/dfa/d132 0 2023-10-21T17:22:28.311 INFO:tasks.workunit.client.0.smithi012.stdout:3/837: chown d0/da/l10 0 1 2023-10-21T17:22:28.627 INFO:tasks.workunit.client.0.smithi012.stdout:4/887: rmdir dc/d1e/dc7/dcc/d10f/d55 39 2023-10-21T17:22:29.185 INFO:tasks.workunit.client.0.smithi012.stdout:6/818: creat d13/d29/d77/f11f x:0 0 0 2023-10-21T17:22:29.357 INFO:tasks.workunit.client.0.smithi012.stdout:7/890: mknod d3/d6/d6a/def/c121 0 2023-10-21T17:22:29.557 INFO:tasks.workunit.client.0.smithi012.stdout:0/954: rename d7/d55/d23/d27/dc6/ld2 to d7/d52/d90/d13d/l162 0 2023-10-21T17:22:29.739 INFO:tasks.workunit.client.0.smithi012.stdout:3/838: creat d0/d32/d43/d47/d50/dcc/ffd x:0 0 0 2023-10-21T17:22:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:6/819: link d13/d15/d1d/d5d/d66/d7a/f87 d13/d15/d1d/d5d/d66/d7a/f120 0 2023-10-21T17:22:30.743 INFO:tasks.workunit.client.0.smithi012.stdout:6/820: dwrite d13/d15/f21 [0,4194304] 0 2023-10-21T17:22:30.744 INFO:tasks.workunit.client.0.smithi012.stdout:6/821: stat d13/f69 0 2023-10-21T17:22:30.744 INFO:tasks.workunit.client.0.smithi012.stdout:6/822: stat d13/d29/l63 0 2023-10-21T17:22:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:7/891: read d3/d6/dc/d19/d1e/d34/da8/db4/dce/ffd [1991975,103814] 0 2023-10-21T17:22:31.374 INFO:tasks.workunit.client.0.smithi012.stdout:2/935: rename d1/d14/d16/d58/dec/da5/dbe/ce6 to d1/d14/d17/db9/dd6/c13a 0 2023-10-21T17:22:31.519 INFO:tasks.workunit.client.0.smithi012.stdout:1/925: mkdir d5/d26/da3/d133 0 2023-10-21T17:22:31.520 INFO:tasks.workunit.client.0.smithi012.stdout:1/926: dread - d5/d32/d1b/dfa/d132/f113 zero size 2023-10-21T17:22:31.520 INFO:tasks.workunit.client.0.smithi012.stdout:1/927: creat d5/d26/d64/d8f/dd6/f134 x:0 0 0 2023-10-21T17:22:31.679 INFO:tasks.workunit.client.0.smithi012.stdout:3/839: link d0/l16 d0/d96/d97/d9b/lfe 0 2023-10-21T17:22:31.712 INFO:tasks.workunit.client.0.smithi012.stdout:3/840: dread d0/d96/d97/fa4 [0,4194304] 0 2023-10-21T17:22:31.720 INFO:tasks.workunit.client.0.smithi012.stdout:3/841: read d0/d96/d97/f9a [169303,13667] 0 2023-10-21T17:22:32.819 INFO:tasks.workunit.client.0.smithi012.stdout:7/892: unlink d3/d16/f65 0 2023-10-21T17:22:33.174 INFO:tasks.workunit.client.0.smithi012.stdout:9/794: rename d0/df/d8d/dcb/d25/d39/d3b/d67/cac to d0/d5/c108 0 2023-10-21T17:22:33.174 INFO:tasks.workunit.client.0.smithi012.stdout:9/795: chown d0/df/d8d/dcb/d25/d39/d76/la0 390428938 1 2023-10-21T17:22:33.310 INFO:tasks.workunit.client.0.smithi012.stdout:2/936: symlink d1/d14/d16/d58/l13b 0 2023-10-21T17:22:33.310 INFO:tasks.workunit.client.0.smithi012.stdout:2/937: creat d1/d95/f13c x:0 0 0 2023-10-21T17:22:33.350 INFO:tasks.workunit.client.0.smithi012.stdout:2/938: dread d1/d4/d93/fa7 [0,4194304] 0 2023-10-21T17:22:33.350 INFO:tasks.workunit.client.0.smithi012.stdout:2/939: getdents d1/d14/d17/db9/dd6/d10f 0 2023-10-21T17:22:33.350 INFO:tasks.workunit.client.0.smithi012.stdout:2/940: fsync d1/d14/d16/d58/dec/da5/d50/f79 0 2023-10-21T17:22:33.572 INFO:tasks.workunit.client.0.smithi012.stdout:3/842: symlink d0/d1c/d5e/lff 0 2023-10-21T17:22:33.595 INFO:tasks.workunit.client.0.smithi012.stdout:3/843: write d0/f5 [1574948,12021] 0 2023-10-21T17:22:33.862 INFO:tasks.workunit.client.0.smithi012.stdout:7/893: mknod d3/d6/dc/d19/d1e/d34/da8/db4/dc3/c122 0 2023-10-21T17:22:34.013 INFO:tasks.workunit.client.0.smithi012.stdout:8/808: rename d0/f11 to d0/d1a/db0/f106 0 2023-10-21T17:22:34.013 INFO:tasks.workunit.client.0.smithi012.stdout:8/809: readlink d0/d62/d83/l89 0 2023-10-21T17:22:34.089 INFO:tasks.workunit.client.0.smithi012.stdout:9/796: creat d0/d5/df3/f109 x:0 0 0 2023-10-21T17:22:34.089 INFO:tasks.workunit.client.0.smithi012.stdout:9/797: read - d0/d4/d4b/fba zero size 2023-10-21T17:22:34.089 INFO:tasks.workunit.client.0.smithi012.stdout:9/798: chown d0/d5 49347056 1 2023-10-21T17:22:34.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/941: creat d1/d4/d3f/d41/d59/d12f/f13d x:0 0 0 2023-10-21T17:22:34.842 INFO:tasks.workunit.client.0.smithi012.stdout:3/844: dread d0/f2b [0,4194304] 0 2023-10-21T17:22:35.212 INFO:tasks.workunit.client.0.smithi012.stdout:4/888: write dc/d1e/dc7/dcc/d10f/d55/d6c/fa1 [499896,60246] 0 2023-10-21T17:22:35.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/874: write d2/d4f/d7e/d87/d57/f5f [378348,71952] 0 2023-10-21T17:22:35.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/875: chown d2/d4f/d7e/d87/dce/ff3 90528 1 2023-10-21T17:22:35.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/876: chown d2/d1d/d4e/f78 24842465 1 2023-10-21T17:22:35.237 INFO:tasks.workunit.client.0.smithi012.stdout:5/877: chown d2/d4f/d7e/d87/lb7 77 1 2023-10-21T17:22:35.240 INFO:tasks.workunit.client.0.smithi012.stdout:4/889: dread dc/d1e/dc7/dcc/d10f/fdf [0,4194304] 0 2023-10-21T17:22:35.376 INFO:tasks.workunit.client.0.smithi012.stdout:0/955: write d7/d55/d23/dce/ddc/d114/d63/fae [1104542,20204] 0 2023-10-21T17:22:35.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/928: rename d5/d32/d1b/d2c/d4b/d8a/fe6 to d5/d32/d1b/dfa/f135 0 2023-10-21T17:22:35.789 INFO:tasks.workunit.client.0.smithi012.stdout:8/810: unlink d0/d12/d40/d91/c98 0 2023-10-21T17:22:35.879 INFO:tasks.workunit.client.0.smithi012.stdout:1/929: dwrite d5/d26/f2f [0,4194304] 0 2023-10-21T17:22:36.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/799: creat d0/df/d8d/dcb/d25/d100/f10a x:0 0 0 2023-10-21T17:22:36.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/800: truncate d0/d5/d9c/ffe 988216 0 2023-10-21T17:22:36.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/942: symlink d1/d14/d16/d58/dec/d82/d125/l13e 0 2023-10-21T17:22:36.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/943: dread d1/d95/f119 [0,4194304] 0 2023-10-21T17:22:36.541 INFO:tasks.workunit.client.0.smithi012.stdout:7/894: unlink d3/da7/daf/dcd/fbb 0 2023-10-21T17:22:36.542 INFO:tasks.workunit.client.0.smithi012.stdout:7/895: write d3/d6/dc/d19/d1e/d9d/fb0 [1803567,78066] 0 2023-10-21T17:22:36.641 INFO:tasks.workunit.client.0.smithi012.stdout:5/878: mknod d2/d4f/d7e/c111 0 2023-10-21T17:22:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:0/956: mknod d7/d55/c163 0 2023-10-21T17:22:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:0/957: truncate d7/d52/f153 29212 0 2023-10-21T17:22:37.367 INFO:tasks.workunit.client.0.smithi012.stdout:9/801: symlink d0/df/d8d/dcb/d25/d39/d3b/d67/l10b 0 2023-10-21T17:22:37.367 INFO:tasks.workunit.client.0.smithi012.stdout:6/823: write d13/d29/d78/fda [1397888,62979] 0 2023-10-21T17:22:37.368 INFO:tasks.workunit.client.0.smithi012.stdout:6/824: stat d13/d15/d1d/d5d 0 2023-10-21T17:22:37.480 INFO:tasks.workunit.client.0.smithi012.stdout:9/802: dwrite d0/fe0 [0,4194304] 0 2023-10-21T17:22:37.480 INFO:tasks.workunit.client.0.smithi012.stdout:9/803: readlink d0/df/d8d/dcb/d25/d39/d3b/l106 0 2023-10-21T17:22:37.480 INFO:tasks.workunit.client.0.smithi012.stdout:9/804: fdatasync d0/d5/f32 0 2023-10-21T17:22:38.047 INFO:tasks.workunit.client.0.smithi012.stdout:2/944: fsync d1/d14/d17/f1f 0 2023-10-21T17:22:38.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/845: mkdir d0/da/d28/d100 0 2023-10-21T17:22:38.604 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:22:38.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:22:38.632 INFO:tasks.workunit.client.0.smithi012.stdout:5/879: fsync d2/d4f/d7e/d87/d57/f9f 0 2023-10-21T17:22:38.814 INFO:tasks.workunit.client.0.smithi012.stdout:4/890: symlink dc/d15/l12c 0 2023-10-21T17:22:38.814 INFO:tasks.workunit.client.0.smithi012.stdout:4/891: stat dc/d1e/d33/d8a/cbf 0 2023-10-21T17:22:38.814 INFO:tasks.workunit.client.0.smithi012.stdout:4/892: chown dc/d1e/dc7/dcc/d10f/d75/fac 972092333 1 2023-10-21T17:22:39.164 INFO:tasks.workunit.client.0.smithi012.stdout:0/958: creat d7/d55/d23/d30/f164 x:0 0 0 2023-10-21T17:22:39.164 INFO:tasks.workunit.client.0.smithi012.stdout:1/930: truncate d5/d30/da9/fb5 826591 0 2023-10-21T17:22:39.164 INFO:tasks.workunit.client.0.smithi012.stdout:1/931: chown d5/d32/d1b/d2c/d48/c55 0 1 2023-10-21T17:22:39.165 INFO:tasks.workunit.client.0.smithi012.stdout:1/932: write d5/d32/dce/df9/fc7 [285310,121597] 0 2023-10-21T17:22:39.194 INFO:tasks.workunit.client.0.smithi012.stdout:0/959: dread d7/d52/d53/fdd [0,4194304] 0 2023-10-21T17:22:39.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/825: rmdir d13/d15/d1d/d28 39 2023-10-21T17:22:39.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/826: dread - d13/d42/d89/f108 zero size 2023-10-21T17:22:39.318 INFO:tasks.workunit.client.0.smithi012.stdout:6/827: dwrite d13/d42/d89/db8/fb9 [0,4194304] 0 2023-10-21T17:22:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/828: truncate d13/d42/d89/f108 222337 0 2023-10-21T17:22:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/829: write d13/d42/d89/db8/f45 [1761608,41332] 0 2023-10-21T17:22:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/830: fsync d13/d15/d1d/d28/fca 0 2023-10-21T17:22:39.412 INFO:tasks.workunit.client.0.smithi012.stdout:6/831: dwrite d13/d15/f2b [0,4194304] 0 2023-10-21T17:22:39.412 INFO:tasks.workunit.client.0.smithi012.stdout:6/832: readlink d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/lff 0 2023-10-21T17:22:39.412 INFO:tasks.workunit.client.0.smithi012.stdout:6/833: chown d13/d35/d4c/ff5 38248107 1 2023-10-21T17:22:39.416 INFO:tasks.workunit.client.0.smithi012.stdout:6/834: read d13/d29/d78/f99 [78050,40333] 0 2023-10-21T17:22:39.416 INFO:tasks.workunit.client.0.smithi012.stdout:6/835: chown d13/d15/d1d/d28/d5b/d75/cde 4 1 2023-10-21T17:22:39.524 INFO:tasks.workunit.client.0.smithi012.stdout:9/805: mknod d0/d4/d4b/d6a/d89/c10c 0 2023-10-21T17:22:39.721 INFO:tasks.workunit.client.0.smithi012.stdout:3/846: link d0/d32/d43/ff0 d0/d82/f101 0 2023-10-21T17:22:39.945 INFO:tasks.workunit.client.0.smithi012.stdout:4/893: chown dc/lb8 0 1 2023-10-21T17:22:40.201 INFO:tasks.workunit.client.0.smithi012.stdout:0/960: symlink d7/d55/d23/dce/ddc/d114/d48/d88/d144/l165 0 2023-10-21T17:22:40.209 INFO:tasks.workunit.client.0.smithi012.stdout:0/961: write d7/d52/d53/f117 [157996,19460] 0 2023-10-21T17:22:40.210 INFO:tasks.workunit.client.0.smithi012.stdout:0/962: creat d7/d55/d23/dce/ddc/d114/d82/d8d/dea/f166 x:0 0 0 2023-10-21T17:22:40.548 INFO:tasks.workunit.client.0.smithi012.stdout:9/806: mknod d0/d15/df4/c10d 0 2023-10-21T17:22:40.707 INFO:tasks.workunit.client.0.smithi012.stdout:2/945: mkdir d1/d4/d3f/d13f 0 2023-10-21T17:22:41.082 INFO:tasks.workunit.client.0.smithi012.stdout:1/933: truncate d5/f14 1277889 0 2023-10-21T17:22:41.656 INFO:tasks.workunit.client.0.smithi012.stdout:6/836: rename d13/d42/d89/db8/f10e to d13/d29/d78/f121 0 2023-10-21T17:22:41.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/807: mknod d0/df/d8d/de1/c10e 0 2023-10-21T17:22:41.724 INFO:tasks.workunit.client.0.smithi012.stdout:9/808: getdents d0/d5/d9c/df0 0 2023-10-21T17:22:41.728 INFO:tasks.workunit.client.0.smithi012.stdout:9/809: read d0/d4/d4b/fbf [508998,73987] 0 2023-10-21T17:22:41.860 INFO:tasks.workunit.client.0.smithi012.stdout:2/946: symlink d1/d14/d16/d58/dec/da5/dbe/ddc/l140 0 2023-10-21T17:22:42.132 INFO:tasks.workunit.client.0.smithi012.stdout:1/934: creat d5/d32/d1b/d27/dfb/d108/d4f/f136 x:0 0 0 2023-10-21T17:22:42.711 INFO:tasks.workunit.client.0.smithi012.stdout:9/810: symlink d0/d5/df3/l10f 0 2023-10-21T17:22:42.711 INFO:tasks.workunit.client.0.smithi012.stdout:9/811: fdatasync d0/d4/d4b/d6a/fae 0 2023-10-21T17:22:42.711 INFO:tasks.workunit.client.0.smithi012.stdout:9/812: stat d0/df/d8d/dcb/d25/dc9 0 2023-10-21T17:22:42.835 INFO:tasks.workunit.client.0.smithi012.stdout:8/811: dwrite d0/d12/d51/f58 [0,4194304] 0 2023-10-21T17:22:42.843 INFO:tasks.workunit.client.0.smithi012.stdout:9/813: dwrite d0/d4/d4b/f99 [0,4194304] 0 2023-10-21T17:22:42.843 INFO:tasks.workunit.client.0.smithi012.stdout:9/814: dread - d0/df/d8d/dcb/d25/d39/fdc zero size 2023-10-21T17:22:42.843 INFO:tasks.workunit.client.0.smithi012.stdout:9/815: fdatasync d0/d5/d9d/fb5 0 2023-10-21T17:22:43.125 INFO:tasks.workunit.client.0.smithi012.stdout:2/947: mkdir d1/d14/d16/d58/dec/da5/d141 0 2023-10-21T17:22:43.125 INFO:tasks.workunit.client.0.smithi012.stdout:2/948: write d1/de7/f118 [367788,69649] 0 2023-10-21T17:22:43.614 INFO:tasks.workunit.client.0.smithi012.stdout:1/935: unlink d5/d32/d1b/d2c/d4b/c8e 0 2023-10-21T17:22:43.614 INFO:tasks.workunit.client.0.smithi012.stdout:1/936: chown d5/fa5 294 1 2023-10-21T17:22:43.704 INFO:tasks.workunit.client.0.smithi012.stdout:1/937: dwrite d5/fa5 [0,4194304] 0 2023-10-21T17:22:43.704 INFO:tasks.workunit.client.0.smithi012.stdout:1/938: chown d5/d26/d54/d101/l123 63 1 2023-10-21T17:22:43.705 INFO:tasks.workunit.client.0.smithi012.stdout:1/939: write d5/d32/d1b/d2c/d48/f74 [5784477,32107] 0 2023-10-21T17:22:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:8/812: mknod d0/d12/c107 0 2023-10-21T17:22:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:8/813: write d0/d29/d79/f97 [4360907,84833] 0 2023-10-21T17:22:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:8/814: fdatasync d0/d12/d6c/db1/fbd 0 2023-10-21T17:22:44.543 INFO:tasks.workunit.client.0.smithi012.stdout:9/816: creat d0/df/d8d/dcb/d25/dc9/f110 x:0 0 0 2023-10-21T17:22:44.590 INFO:tasks.workunit.client.0.smithi012.stdout:7/896: sync 2023-10-21T17:22:44.605 INFO:tasks.workunit.client.0.smithi012.stdout:7/897: dread d3/d6/dc/f79 [0,4194304] 0 2023-10-21T17:22:44.772 INFO:tasks.workunit.client.0.smithi012.stdout:2/949: read d1/d14/d16/d58/dec/da5/d34/fb1 [1436568,86402] 0 2023-10-21T17:22:44.773 INFO:tasks.workunit.client.0.smithi012.stdout:2/950: dread - d1/d14/d17/d8a/dda/f113 zero size 2023-10-21T17:22:45.061 INFO:tasks.workunit.client.0.smithi012.stdout:1/940: unlink d5/d32/d1b/d35/d3a/d5c/fc3 0 2023-10-21T17:22:45.183 INFO:tasks.workunit.client.0.smithi012.stdout:3/847: rename d0/d32/d43/d47/dd6 to d0/d32/d43/d102 0 2023-10-21T17:22:45.589 INFO:tasks.workunit.client.0.smithi012.stdout:7/898: mknod d3/d6/dc/d19/d1e/d34/da8/db4/dc3/c123 0 2023-10-21T17:22:45.720 INFO:tasks.workunit.client.0.smithi012.stdout:2/951: creat d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/f142 x:0 0 0 2023-10-21T17:22:45.720 INFO:tasks.workunit.client.0.smithi012.stdout:2/952: readlink d1/d14/d16/d58/dec/da5/d50/lc9 0 2023-10-21T17:22:45.863 INFO:tasks.workunit.client.0.smithi012.stdout:1/941: rmdir d5/d26/d64/d8f 39 2023-10-21T17:22:45.937 INFO:tasks.workunit.client.0.smithi012.stdout:1/942: dwrite d5/d32/d1b/d35/d49/d69/f9b [0,4194304] 0 2023-10-21T17:22:46.018 INFO:tasks.workunit.client.0.smithi012.stdout:1/943: dwrite d5/d32/d1b/d27/dfb/d108/d4f/f136 [0,4194304] 0 2023-10-21T17:22:46.170 INFO:tasks.workunit.client.0.smithi012.stdout:3/848: unlink d0/d96/d97/ca5 0 2023-10-21T17:22:46.188 INFO:tasks.workunit.client.0.smithi012.stdout:5/880: write d2/d1d/d20/f4d [1307012,69483] 0 2023-10-21T17:22:46.219 INFO:tasks.workunit.client.0.smithi012.stdout:7/899: chown d3/c1b 272919 1 2023-10-21T17:22:46.345 INFO:tasks.workunit.client.0.smithi012.stdout:7/900: dwrite d3/d6/f66 [0,4194304] 0 2023-10-21T17:22:46.345 INFO:tasks.workunit.client.0.smithi012.stdout:7/901: write d3/d6/dc/d19/fff [63719,7668] 0 2023-10-21T17:22:46.373 INFO:tasks.workunit.client.0.smithi012.stdout:2/953: readlink d1/d14/l44 0 2023-10-21T17:22:46.373 INFO:tasks.workunit.client.0.smithi012.stdout:2/954: write d1/d4/f128 [195972,14674] 0 2023-10-21T17:22:46.452 INFO:tasks.workunit.client.0.smithi012.stdout:2/955: dwrite d1/d95/f122 [0,4194304] 0 2023-10-21T17:22:46.452 INFO:tasks.workunit.client.0.smithi012.stdout:2/956: dread - d1/d4/d93/feb zero size 2023-10-21T17:22:46.453 INFO:tasks.workunit.client.0.smithi012.stdout:2/957: stat d1/d95 0 2023-10-21T17:22:46.523 INFO:tasks.workunit.client.0.smithi012.stdout:6/837: rename d13/d15/d1d/d5d/c62 to d13/d15/d1d/d5d/d66/d70/d74/dc9/c122 0 2023-10-21T17:22:46.962 INFO:tasks.workunit.client.0.smithi012.stdout:1/944: mkdir d5/d32/d1b/d35/d49/d69/d137 0 2023-10-21T17:22:47.377 INFO:tasks.workunit.client.0.smithi012.stdout:7/902: mkdir d3/d6/dc/d19/d11d/d124 0 2023-10-21T17:22:47.954 INFO:tasks.workunit.client.0.smithi012.stdout:2/958: rmdir d1/d4/d3f/d41 39 2023-10-21T17:22:47.955 INFO:tasks.workunit.client.0.smithi012.stdout:2/959: write d1/d4/d3f/f111 [16886,89115] 0 2023-10-21T17:22:47.955 INFO:tasks.workunit.client.0.smithi012.stdout:2/960: chown d1/d14/d16/d58/dec/d82/d86/fa0 120684 1 2023-10-21T17:22:47.990 INFO:tasks.workunit.client.0.smithi012.stdout:6/838: symlink d13/d15/d1d/d5d/d92/l123 0 2023-10-21T17:22:48.077 INFO:tasks.workunit.client.0.smithi012.stdout:0/963: dwrite d7/d55/d1f/d28/d9b/f6f [0,4194304] 0 2023-10-21T17:22:48.078 INFO:tasks.workunit.client.0.smithi012.stdout:0/964: dread - d7/d52/d90/fe1 zero size 2023-10-21T17:22:48.385 INFO:tasks.workunit.client.0.smithi012.stdout:1/945: link d5/d32/d1b/d27/fcd d5/d32/d1b/d27/d21/f138 0 2023-10-21T17:22:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:1/946: write d5/d32/d1b/d2c/d48/fa1 [2241448,8022] 0 2023-10-21T17:22:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:1/947: creat d5/d26/d64/d120/f139 x:0 0 0 2023-10-21T17:22:48.620 INFO:tasks.workunit.client.0.smithi012.stdout:7/903: symlink d3/d6/dc/d19/d1e/d34/da8/db4/dce/l125 0 2023-10-21T17:22:48.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/894: dwrite dc/d1e/dc7/f12a [0,4194304] 0 2023-10-21T17:22:49.420 INFO:tasks.workunit.client.0.smithi012.stdout:2/961: mkdir d1/d14/d17/db9/d143 0 2023-10-21T17:22:49.829 INFO:tasks.workunit.client.0.smithi012.stdout:6/839: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/f124 x:0 0 0 2023-10-21T17:22:49.994 INFO:tasks.workunit.client.0.smithi012.stdout:0/965: rename d7/d55/d23/dce/ddc/d114/d48/db7/df5/cfe to d7/d55/d23/d27/d31/c167 0 2023-10-21T17:22:50.730 INFO:tasks.workunit.client.0.smithi012.stdout:1/948: unlink d5/d32/l52 0 2023-10-21T17:22:50.984 INFO:tasks.workunit.client.0.smithi012.stdout:4/895: creat dc/d6b/f12d x:0 0 0 2023-10-21T17:22:50.985 INFO:tasks.workunit.client.0.smithi012.stdout:4/896: readlink dc/d1e/dc7/dcc/lf7 0 2023-10-21T17:22:51.840 INFO:tasks.workunit.client.0.smithi012.stdout:6/840: dwrite d13/d42/d89/f108 [0,4194304] 0 2023-10-21T17:22:51.988 INFO:tasks.workunit.client.0.smithi012.stdout:7/904: rename d3/d6/dc/d19/d1e/dc9/f87 to d3/da7/daf/dcd/f126 0 2023-10-21T17:22:52.109 INFO:tasks.workunit.client.0.smithi012.stdout:0/966: mknod d7/d55/d23/dce/ddc/d114/df9/c168 0 2023-10-21T17:22:52.209 INFO:tasks.workunit.client.0.smithi012.stdout:0/967: dwrite f6 [0,4194304] 0 2023-10-21T17:22:52.209 INFO:tasks.workunit.client.0.smithi012.stdout:0/968: dread - d7/d55/d1f/f50 zero size 2023-10-21T17:22:52.265 INFO:tasks.workunit.client.0.smithi012.stdout:4/897: mknod dc/d1e/dd6/c12e 0 2023-10-21T17:22:52.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/841: mknod d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/c125 0 2023-10-21T17:22:52.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/842: readlink d13/d64/d6d/lc4 0 2023-10-21T17:22:52.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/843: chown d13/d15/d1d/d5d/d66/d7a/ca9 993783 1 2023-10-21T17:22:52.590 INFO:tasks.workunit.client.0.smithi012.stdout:6/844: stat d13/d29/d37/d3b/f57 0 2023-10-21T17:22:52.590 INFO:tasks.workunit.client.0.smithi012.stdout:6/845: write d13/d29/d78/fda [1811290,82172] 0 2023-10-21T17:22:53.121 INFO:tasks.workunit.client.0.smithi012.stdout:4/898: dread dc/d15/f5e [0,4194304] 0 2023-10-21T17:22:53.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/817: dwrite d0/d4/d4b/d6a/d89/de2/fe7 [0,4194304] 0 2023-10-21T17:22:53.261 INFO:tasks.workunit.client.0.smithi012.stdout:8/815: dwrite d0/d62/f8d [4194304,4194304] 0 2023-10-21T17:22:54.172 INFO:tasks.workunit.client.0.smithi012.stdout:8/816: creat d0/d29/d79/dfc/d103/f108 x:0 0 0 2023-10-21T17:22:54.429 INFO:tasks.workunit.client.0.smithi012.stdout:6/846: symlink d13/d15/d1d/d28/d5b/dee/d109/l126 0 2023-10-21T17:22:54.429 INFO:tasks.workunit.client.0.smithi012.stdout:6/847: getdents d13/d42/d71/dbb 0 2023-10-21T17:22:54.455 INFO:tasks.workunit.client.0.smithi012.stdout:6/848: write d13/d15/f21 [2487674,22824] 0 2023-10-21T17:22:54.483 INFO:tasks.workunit.client.0.smithi012.stdout:6/849: dread f10 [0,4194304] 0 2023-10-21T17:22:54.484 INFO:tasks.workunit.client.0.smithi012.stdout:6/850: chown d13/d42/d71/dbb 57137513 1 2023-10-21T17:22:54.728 INFO:tasks.workunit.client.0.smithi012.stdout:9/818: getdents d0/df/d8d/dcb/d25/d39/d3b 0 2023-10-21T17:22:54.728 INFO:tasks.workunit.client.0.smithi012.stdout:9/819: fdatasync d0/fe6 0 2023-10-21T17:22:54.768 INFO:tasks.workunit.client.0.smithi012.stdout:8/817: mkdir d0/d62/d83/d4e/d109 0 2023-10-21T17:22:54.772 INFO:tasks.workunit.client.0.smithi012.stdout:8/818: read d0/d1a/f41 [1225821,96728] 0 2023-10-21T17:22:55.167 INFO:tasks.workunit.client.0.smithi012.stdout:9/820: link d0/d5/d9c/dc7/ld8 d0/dcd/l111 0 2023-10-21T17:22:55.285 INFO:tasks.workunit.client.0.smithi012.stdout:8/819: creat d0/d1a/db0/f10a x:0 0 0 2023-10-21T17:22:55.899 INFO:tasks.workunit.client.0.smithi012.stdout:7/905: creat d3/f127 x:0 0 0 2023-10-21T17:22:55.900 INFO:tasks.workunit.client.0.smithi012.stdout:7/906: truncate d3/d6/dc/d19/d1e/d7b/ff0 688939 0 2023-10-21T17:22:55.915 INFO:tasks.workunit.client.0.smithi012.stdout:3/849: creat d0/d32/f103 x:0 0 0 2023-10-21T17:22:55.915 INFO:tasks.workunit.client.0.smithi012.stdout:3/850: stat d0/d32/d43/d47/d50/d52/lcb 0 2023-10-21T17:22:56.100 INFO:tasks.workunit.client.0.smithi012.stdout:8/820: getdents d0/d12/d80 0 2023-10-21T17:22:56.100 INFO:tasks.workunit.client.0.smithi012.stdout:8/821: dread - d0/d46/f5d zero size 2023-10-21T17:22:56.101 INFO:tasks.workunit.client.0.smithi012.stdout:8/822: write d0/d29/f7a [3211125,49354] 0 2023-10-21T17:22:56.101 INFO:tasks.workunit.client.0.smithi012.stdout:8/823: fsync d0/d1a/db0/dec/ff9 0 2023-10-21T17:22:56.128 INFO:tasks.workunit.client.0.smithi012.stdout:9/821: dread d0/d15/faa [0,4194304] 0 2023-10-21T17:22:56.128 INFO:tasks.workunit.client.0.smithi012.stdout:9/822: readlink d0/d4/d4b/l96 0 2023-10-21T17:22:56.227 INFO:tasks.workunit.client.0.smithi012.stdout:9/823: dwrite d0/df/d8d/dcb/d25/d39/f5b [4194304,4194304] 0 2023-10-21T17:22:56.253 INFO:tasks.workunit.client.0.smithi012.stdout:9/824: dread d0/df/d8d/dcb/d2a/f87 [0,4194304] 0 2023-10-21T17:22:56.327 INFO:tasks.workunit.client.0.smithi012.stdout:7/907: creat d3/d6/dc/d19/d1e/dc9/f128 x:0 0 0 2023-10-21T17:22:56.779 INFO:tasks.workunit.client.0.smithi012.stdout:9/825: creat d0/d4/d4b/d6a/d89/ddf/f112 x:0 0 0 2023-10-21T17:22:56.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/908: rmdir d3/d6/dc/d19 39 2023-10-21T17:22:56.845 INFO:tasks.workunit.client.0.smithi012.stdout:9/826: dwrite d0/df/d8d/dcb/d25/d39/d8e/f91 [0,4194304] 0 2023-10-21T17:22:56.891 INFO:tasks.workunit.client.0.smithi012.stdout:3/851: unlink d0/da/d28/f77 0 2023-10-21T17:22:57.187 INFO:tasks.workunit.client.0.smithi012.stdout:5/881: creat d2/d4f/f112 x:0 0 0 2023-10-21T17:22:57.206 INFO:tasks.workunit.client.0.smithi012.stdout:7/909: symlink d3/d29/l129 0 2023-10-21T17:22:57.360 INFO:tasks.workunit.client.0.smithi012.stdout:9/827: rename d0/df/f42 to d0/df/d8d/dcb/d25/d39/f113 0 2023-10-21T17:22:57.360 INFO:tasks.workunit.client.0.smithi012.stdout:9/828: fdatasync d0/df/d8d/dcb/d25/d2f/d8c/f9a 0 2023-10-21T17:22:57.360 INFO:tasks.workunit.client.0.smithi012.stdout:9/829: chown d0/d5/d9c/ffe 801 1 2023-10-21T17:22:57.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/852: mkdir d0/d82/d104 0 2023-10-21T17:22:57.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/853: readlink d0/da/d28/df9/ld3 0 2023-10-21T17:22:57.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/854: readlink d0/l30 0 2023-10-21T17:22:57.535 INFO:tasks.workunit.client.0.smithi012.stdout:3/855: chown d0/d32/c41 398 1 2023-10-21T17:22:57.536 INFO:tasks.workunit.client.0.smithi012.stdout:3/856: fsync d0/d82/f9f 0 2023-10-21T17:22:57.979 INFO:tasks.workunit.client.0.smithi012.stdout:5/882: link d2/db5/ld1 d2/d1d/d4e/df5/l113 0 2023-10-21T17:22:58.077 INFO:tasks.workunit.client.0.smithi012.stdout:7/910: creat d3/da7/f12a x:0 0 0 2023-10-21T17:22:58.077 INFO:tasks.workunit.client.0.smithi012.stdout:7/911: fsync d3/d6/dc/d19/f113 0 2023-10-21T17:22:58.208 INFO:tasks.workunit.client.0.smithi012.stdout:9/830: creat d0/df/d8d/dcb/d25/f114 x:0 0 0 2023-10-21T17:22:58.209 INFO:tasks.workunit.client.0.smithi012.stdout:9/831: stat d0/d5/d9c/df0 0 2023-10-21T17:22:58.942 INFO:tasks.workunit.client.0.smithi012.stdout:5/883: creat d2/d4f/d7e/d87/d57/dc7/dd0/de3/f114 x:0 0 0 2023-10-21T17:22:59.095 INFO:tasks.workunit.client.0.smithi012.stdout:7/912: link d3/d6/c93 d3/da7/c12b 0 2023-10-21T17:22:59.302 INFO:tasks.workunit.client.0.smithi012.stdout:9/832: creat d0/d4/d4b/d6a/ddd/f115 x:0 0 0 2023-10-21T17:22:59.344 INFO:tasks.workunit.client.0.smithi012.stdout:9/833: dread d0/d5/f69 [4194304,4194304] 0 2023-10-21T17:22:59.452 INFO:tasks.workunit.client.0.smithi012.stdout:5/884: mkdir d2/db5/df2/d115 0 2023-10-21T17:22:59.668 INFO:tasks.workunit.client.0.smithi012.stdout:9/834: mkdir d0/d4/d4b/ded/d116 0 2023-10-21T17:22:59.697 INFO:tasks.workunit.client.0.smithi012.stdout:9/835: write d0/d4/d4b/d6a/d89/f8b [2746962,6340] 0 2023-10-21T17:22:59.697 INFO:tasks.workunit.client.0.smithi012.stdout:9/836: chown d0/d4/d4b/f4c 6760 1 2023-10-21T17:22:59.768 INFO:tasks.workunit.client.0.smithi012.stdout:9/837: dwrite d0/df/d8d/f64 [0,4194304] 0 2023-10-21T17:23:00.575 INFO:tasks.workunit.client.0.smithi012.stdout:9/838: rmdir d0/df/d44 39 2023-10-21T17:23:00.576 INFO:tasks.workunit.client.0.smithi012.stdout:5/885: getdents d2/d4f/d59 0 2023-10-21T17:23:00.648 INFO:tasks.workunit.client.0.smithi012.stdout:0/969: symlink d7/d55/d23/l169 0 2023-10-21T17:23:00.648 INFO:tasks.workunit.client.0.smithi012.stdout:0/970: creat d7/d55/d23/dce/ddc/d114/d82/d8d/dea/f16a x:0 0 0 2023-10-21T17:23:00.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/971: stat d7/f10 0 2023-10-21T17:23:00.677 INFO:tasks.workunit.client.0.smithi012.stdout:4/899: dwrite dc/d1e/d2b/f5c [0,4194304] 0 2023-10-21T17:23:00.779 INFO:tasks.workunit.client.0.smithi012.stdout:4/900: dwrite dc/d15/d2a/d31/ffd [0,4194304] 0 2023-10-21T17:23:00.810 INFO:tasks.workunit.client.0.smithi012.stdout:9/839: mknod d0/d5/d9c/c117 0 2023-10-21T17:23:01.041 INFO:tasks.workunit.client.0.smithi012.stdout:5/886: creat d2/d4f/d7e/d87/d57/d66/f116 x:0 0 0 2023-10-21T17:23:01.041 INFO:tasks.workunit.client.0.smithi012.stdout:6/851: write d13/d15/d1d/d28/d5b/f68 [940830,99076] 0 2023-10-21T17:23:01.149 INFO:tasks.workunit.client.0.smithi012.stdout:6/852: dwrite d13/d29/d78/fb3 [0,4194304] 0 2023-10-21T17:23:01.688 INFO:tasks.workunit.client.0.smithi012.stdout:4/901: symlink dc/d15/d2a/da9/l12f 0 2023-10-21T17:23:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:9/840: creat d0/d4/d4b/d6a/d89/de2/d101/f118 x:0 0 0 2023-10-21T17:23:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:5/887: unlink d2/d4f/d7e/d87/d57/d66/daa/fb2 0 2023-10-21T17:23:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:5/888: stat d2/d1d/fa8 0 2023-10-21T17:23:01.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/853: truncate d13/d15/d1d/d28/fa8 1888241 0 2023-10-21T17:23:01.920 INFO:tasks.workunit.client.0.smithi012.stdout:9/841: write d0/df/d8d/f38 [3238086,123071] 0 2023-10-21T17:23:01.920 INFO:tasks.workunit.client.0.smithi012.stdout:9/842: write d0/df/d8d/dcb/d25/d39/d8e/ff5 [950564,9080] 0 2023-10-21T17:23:01.970 INFO:tasks.workunit.client.0.smithi012.stdout:5/889: dwrite d2/d4f/f112 [0,4194304] 0 2023-10-21T17:23:01.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/949: sync 2023-10-21T17:23:01.975 INFO:tasks.workunit.client.0.smithi012.stdout:2/962: sync 2023-10-21T17:23:01.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/950: fsync d5/d26/d64/d120/f139 0 2023-10-21T17:23:02.034 INFO:tasks.workunit.client.0.smithi012.stdout:2/963: dwrite d1/d4/fc7 [0,4194304] 0 2023-10-21T17:23:02.050 INFO:tasks.workunit.client.0.smithi012.stdout:8/824: dwrite d0/d1a/db0/dea/fa7 [0,4194304] 0 2023-10-21T17:23:02.110 INFO:tasks.workunit.client.0.smithi012.stdout:4/902: unlink dc/d1e/dc7/dcc/d10f/d55/d6c/fa1 0 2023-10-21T17:23:02.411 INFO:tasks.workunit.client.0.smithi012.stdout:9/843: unlink d0/fe0 0 2023-10-21T17:23:02.412 INFO:tasks.workunit.client.0.smithi012.stdout:9/844: stat d0/d4/l6e 0 2023-10-21T17:23:02.713 INFO:tasks.workunit.client.0.smithi012.stdout:5/890: fdatasync d2/d4f/d7e/d87/d57/d66/f81 0 2023-10-21T17:23:03.759 INFO:tasks.workunit.client.0.smithi012.stdout:2/964: rmdir d1/d14/d17/d8a/dda 39 2023-10-21T17:23:03.790 INFO:tasks.workunit.client.0.smithi012.stdout:2/965: write d1/d14/d16/d58/dec/da5/dbe/ddc/ff5 [2180978,98385] 0 2023-10-21T17:23:04.001 INFO:tasks.workunit.client.0.smithi012.stdout:8/825: creat d0/d12/d80/f10b x:0 0 0 2023-10-21T17:23:04.030 INFO:tasks.workunit.client.0.smithi012.stdout:8/826: dread d0/d62/d83/d4e/f55 [0,4194304] 0 2023-10-21T17:23:04.951 INFO:tasks.workunit.client.0.smithi012.stdout:4/903: creat dc/d15/d2a/d58/f130 x:0 0 0 2023-10-21T17:23:05.364 INFO:tasks.workunit.client.0.smithi012.stdout:5/891: creat d2/d2c/d73/f117 x:0 0 0 2023-10-21T17:23:05.388 INFO:tasks.workunit.client.0.smithi012.stdout:5/892: dread d2/d4f/d7e/d87/d57/d66/f81 [0,4194304] 0 2023-10-21T17:23:05.453 INFO:tasks.workunit.client.0.smithi012.stdout:6/854: rename d13/d42/d89/f108 to d13/d15/d1d/d5d/d66/d7a/f127 0 2023-10-21T17:23:05.715 INFO:tasks.workunit.client.0.smithi012.stdout:2/966: mknod d1/d14/d16/d58/dec/da5/d141/c144 0 2023-10-21T17:23:05.788 INFO:tasks.workunit.client.0.smithi012.stdout:2/967: dwrite d1/d4/d3f/d41/d59/f62 [0,4194304] 0 2023-10-21T17:23:05.829 INFO:tasks.workunit.client.0.smithi012.stdout:8/827: mkdir d0/d62/d7d/dcf/d10c 0 2023-10-21T17:23:05.857 INFO:tasks.workunit.client.0.smithi012.stdout:8/828: write d0/d1a/d54/f5f [1741745,116948] 0 2023-10-21T17:23:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:7/913: write d3/d6/dc/d19/f57 [6747297,48813] 0 2023-10-21T17:23:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:7/914: chown d3/d6/dc/d19/d1e/d9d/dec/fb6 5680 1 2023-10-21T17:23:06.165 INFO:tasks.workunit.client.0.smithi012.stdout:5/893: mkdir d2/d4f/d7e/daf/d118 0 2023-10-21T17:23:06.717 INFO:tasks.workunit.client.0.smithi012.stdout:2/968: creat d1/d14/d16/d58/dec/da5/d50/da3/da9/dcd/f145 x:0 0 0 2023-10-21T17:23:06.889 INFO:tasks.workunit.client.0.smithi012.stdout:7/915: rmdir d3/d6/d73/d8e/d102 39 2023-10-21T17:23:07.186 INFO:tasks.workunit.client.0.smithi012.stdout:2/969: mkdir d1/d14/d17/da6/d146 0 2023-10-21T17:23:07.572 INFO:tasks.workunit.client.0.smithi012.stdout:0/972: write d7/d55/d23/dce/ddc/d114/df9/f14a [6253438,107648] 0 2023-10-21T17:23:07.573 INFO:tasks.workunit.client.0.smithi012.stdout:0/973: dread - d7/d55/d23/dce/ddc/d114/d82/d8d/f155 zero size 2023-10-21T17:23:07.740 INFO:tasks.workunit.client.0.smithi012.stdout:3/857: rmdir d0/d32 39 2023-10-21T17:23:07.740 INFO:tasks.workunit.client.0.smithi012.stdout:3/858: fsync d0/f2b 0 2023-10-21T17:23:08.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/974: unlink d7/d55/da2/f15f 0 2023-10-21T17:23:08.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:23:08.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:23:10.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/975: unlink d7/d55/c12d 0 2023-10-21T17:23:10.192 INFO:tasks.workunit.client.0.smithi012.stdout:0/976: dread d7/d55/d23/dce/ddc/d114/da9/ffb [0,4194304] 0 2023-10-21T17:23:10.513 INFO:tasks.workunit.client.0.smithi012.stdout:2/970: getdents d1/d14/d16/d58/dec/da5/d141 0 2023-10-21T17:23:10.514 INFO:tasks.workunit.client.0.smithi012.stdout:2/971: chown d1/d4/d3f/d41/d59/fb5 324 1 2023-10-21T17:23:10.516 INFO:tasks.workunit.client.0.smithi012.stdout:1/951: sync 2023-10-21T17:23:10.516 INFO:tasks.workunit.client.0.smithi012.stdout:1/952: dread - d5/d32/d1b/d27/d21/f138 zero size 2023-10-21T17:23:10.584 INFO:tasks.workunit.client.0.smithi012.stdout:1/953: dwrite d5/d32/d1b/d35/d49/fd7 [0,4194304] 0 2023-10-21T17:23:10.607 INFO:tasks.workunit.client.0.smithi012.stdout:1/954: write d5/d32/d1b/d35/f3f [4103886,30020] 0 2023-10-21T17:23:10.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/955: write d5/d32/d1b/d35/d49/d69/f9b [4343454,56987] 0 2023-10-21T17:23:10.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/956: dread - d5/d32/d1b/d27/d21/ff5 zero size 2023-10-21T17:23:10.792 INFO:tasks.workunit.client.0.smithi012.stdout:8/829: write d0/d1a/db0/dea/fe2 [35505,6045] 0 2023-10-21T17:23:10.792 INFO:tasks.workunit.client.0.smithi012.stdout:8/830: dread - d0/d12/d51/f102 zero size 2023-10-21T17:23:10.792 INFO:tasks.workunit.client.0.smithi012.stdout:8/831: write d0/d1a/db0/dca/f101 [501057,50576] 0 2023-10-21T17:23:10.792 INFO:tasks.workunit.client.0.smithi012.stdout:8/832: fsync d0/d29/f7a 0 2023-10-21T17:23:10.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/904: write dc/d1e/dc7/dcc/d10f/fd4 [1549539,91137] 0 2023-10-21T17:23:10.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/905: chown dc/d1e/dc7/dcc/d10f/d55/d6c/d83/f86 2 1 2023-10-21T17:23:10.836 INFO:tasks.workunit.client.0.smithi012.stdout:5/894: write d2/d1d/d20/f48 [4302297,79322] 0 2023-10-21T17:23:10.875 INFO:tasks.workunit.client.0.smithi012.stdout:6/855: dwrite d13/d42/d89/db8/d9f/fe3 [0,4194304] 0 2023-10-21T17:23:10.876 INFO:tasks.workunit.client.0.smithi012.stdout:6/856: chown d13/d64/d6d/f83 29655185 1 2023-10-21T17:23:10.876 INFO:tasks.workunit.client.0.smithi012.stdout:7/916: dwrite d3/d6/dc/d19/d1e/d7b/f99 [0,4194304] 0 2023-10-21T17:23:10.889 INFO:tasks.workunit.client.0.smithi012.stdout:7/917: dread d3/d6/dc/d19/f113 [0,4194304] 0 2023-10-21T17:23:10.889 INFO:tasks.workunit.client.0.smithi012.stdout:7/918: chown d3/d6/d73/d8e/d111 715290 1 2023-10-21T17:23:11.583 INFO:tasks.workunit.client.0.smithi012.stdout:1/957: mknod d5/d32/d1b/d35/d49/d69/d137/c13a 0 2023-10-21T17:23:11.722 INFO:tasks.workunit.client.0.smithi012.stdout:8/833: getdents d0/d1a/db0/dea 0 2023-10-21T17:23:12.139 INFO:tasks.workunit.client.0.smithi012.stdout:5/895: mknod d2/d4f/d59/d5b/d15/df4/c119 0 2023-10-21T17:23:12.140 INFO:tasks.workunit.client.0.smithi012.stdout:6/857: mknod d13/d42/d89/db8/dc7/c128 0 2023-10-21T17:23:12.478 INFO:tasks.workunit.client.0.smithi012.stdout:7/919: read - d3/d6/dc/d19/d1e/dc9/f90 zero size 2023-10-21T17:23:12.555 INFO:tasks.workunit.client.0.smithi012.stdout:0/977: getdents d7/d55/d23/d30 0 2023-10-21T17:23:12.556 INFO:tasks.workunit.client.0.smithi012.stdout:0/978: dread - d7/d55/d23/d30/f164 zero size 2023-10-21T17:23:12.623 INFO:tasks.workunit.client.0.smithi012.stdout:0/979: dwrite d7/d55/f156 [0,4194304] 0 2023-10-21T17:23:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:1/958: unlink d5/d32/d1b/d27/d47/c78 0 2023-10-21T17:23:13.877 INFO:tasks.workunit.client.0.smithi012.stdout:5/896: symlink d2/d2c/d73/d49/l11a 0 2023-10-21T17:23:14.462 INFO:tasks.workunit.client.0.smithi012.stdout:0/980: mknod d7/d81/c16b 0 2023-10-21T17:23:14.572 INFO:tasks.workunit.client.0.smithi012.stdout:0/981: dwrite d7/d55/d23/d27/f5d [0,4194304] 0 2023-10-21T17:23:14.634 INFO:tasks.workunit.client.0.smithi012.stdout:1/959: stat d5/c1e 0 2023-10-21T17:23:14.648 INFO:tasks.workunit.client.0.smithi012.stdout:0/982: dwrite d7/d52/fc1 [0,4194304] 0 2023-10-21T17:23:14.657 INFO:tasks.workunit.client.0.smithi012.stdout:0/983: write d7/d55/d23/d27/dc6/f128 [887688,129181] 0 2023-10-21T17:23:14.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/984: dwrite d7/d55/d23/d27/fc7 [0,4194304] 0 2023-10-21T17:23:14.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/985: creat d7/d55/d23/d27/d31/d5f/dde/f16c x:0 0 0 2023-10-21T17:23:14.808 INFO:tasks.workunit.client.0.smithi012.stdout:1/960: dread d5/d32/d1b/d35/d49/f7b [0,4194304] 0 2023-10-21T17:23:14.808 INFO:tasks.workunit.client.0.smithi012.stdout:1/961: fdatasync d5/d32/d1b/d35/fb3 0 2023-10-21T17:23:15.227 INFO:tasks.workunit.client.0.smithi012.stdout:0/986: truncate d7/d55/d23/f2a 2151201 0 2023-10-21T17:23:15.459 INFO:tasks.workunit.client.0.smithi012.stdout:1/962: mknod d5/d26/d64/c13b 0 2023-10-21T17:23:15.460 INFO:tasks.workunit.client.0.smithi012.stdout:1/963: chown d5/d26/d64/d8f/da0/c118 370265261 1 2023-10-21T17:23:15.568 INFO:tasks.workunit.client.0.smithi012.stdout:1/964: dwrite d5/d32/d62/f3b [0,4194304] 0 2023-10-21T17:23:15.600 INFO:tasks.workunit.client.0.smithi012.stdout:9/845: rename d0/d4/d4b/d6a/d89/de2/d101/f118 to d0/df/d8d/dcb/d25/f119 0 2023-10-21T17:23:15.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/846: readlink d0/d15/l66 0 2023-10-21T17:23:15.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/847: chown d0/d4/d4b/d6a/d89/ld1 0 1 2023-10-21T17:23:15.827 INFO:tasks.workunit.client.0.smithi012.stdout:0/987: creat d7/d55/d23/d27/de3/f16d x:0 0 0 2023-10-21T17:23:15.827 INFO:tasks.workunit.client.0.smithi012.stdout:0/988: fdatasync d7/d55/d23/f46 0 2023-10-21T17:23:16.375 INFO:tasks.workunit.client.0.smithi012.stdout:4/906: rename dc/d93/dde/cec to dc/d15/d2a/d129/c131 0 2023-10-21T17:23:16.455 INFO:tasks.workunit.client.0.smithi012.stdout:9/848: creat d0/d4/d4b/ded/d116/f11a x:0 0 0 2023-10-21T17:23:16.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/907: dwrite dc/d15/d2a/d31/df3/f108 [0,4194304] 0 2023-10-21T17:23:16.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/908: chown dc/d1e/dc7/dcc/d10f/fb3 110043 1 2023-10-21T17:23:16.561 INFO:tasks.workunit.client.0.smithi012.stdout:9/849: dwrite d0/d5/f59 [0,4194304] 0 2023-10-21T17:23:16.662 INFO:tasks.workunit.client.0.smithi012.stdout:0/989: mknod d7/d55/d23/dce/ddc/d114/d82/d8d/dea/c16e 0 2023-10-21T17:23:16.663 INFO:tasks.workunit.client.0.smithi012.stdout:0/990: readlink d7/d55/d23/d27/d31/le5 0 2023-10-21T17:23:16.817 INFO:tasks.workunit.client.0.smithi012.stdout:5/897: rename d2/d4f/d7e/d87/dce/le5 to d2/d4f/d7e/d87/d57/dc7/l11b 0 2023-10-21T17:23:17.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/965: rename d5/d32/d1b/d2c/d4b/f90 to d5/d26/d64/d8f/f13c 0 2023-10-21T17:23:17.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/898: creat d2/d2c/f11c x:0 0 0 2023-10-21T17:23:17.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/899: chown d2/d4f/d7e/d87/d57/d66/cfc 306247440 1 2023-10-21T17:23:18.005 INFO:tasks.workunit.client.0.smithi012.stdout:5/900: dread d2/d4f/d7e/d87/d57/d66/f7f [0,4194304] 0 2023-10-21T17:23:18.005 INFO:tasks.workunit.client.0.smithi012.stdout:5/901: write d2/d2c/d73/f117 [227100,51502] 0 2023-10-21T17:23:18.006 INFO:tasks.workunit.client.0.smithi012.stdout:5/902: fsync d2/d2c/db6/fd5 0 2023-10-21T17:23:18.078 INFO:tasks.workunit.client.0.smithi012.stdout:5/903: dwrite d2/fe1 [0,4194304] 0 2023-10-21T17:23:18.078 INFO:tasks.workunit.client.0.smithi012.stdout:5/904: truncate d2/d2c/d73/d49/da9/fd7 369146 0 2023-10-21T17:23:18.253 INFO:tasks.workunit.client.0.smithi012.stdout:4/909: mknod dc/d15/c132 0 2023-10-21T17:23:18.254 INFO:tasks.workunit.client.0.smithi012.stdout:2/972: unlink d1/f1c 0 2023-10-21T17:23:18.479 INFO:tasks.workunit.client.0.smithi012.stdout:9/850: fdatasync d0/df/d44/f51 0 2023-10-21T17:23:18.653 INFO:tasks.workunit.client.0.smithi012.stdout:1/966: creat d5/d61/d95/f13d x:0 0 0 2023-10-21T17:23:18.734 INFO:tasks.workunit.client.0.smithi012.stdout:1/967: dwrite d5/d26/d54/fe8 [0,4194304] 0 2023-10-21T17:23:19.290 INFO:tasks.workunit.client.0.smithi012.stdout:5/905: mknod d2/d4f/d59/d5b/d15/de2/c11d 0 2023-10-21T17:23:19.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/906: stat d2/d4f/lfb 0 2023-10-21T17:23:19.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/907: creat d2/d1d/d4e/f11e x:0 0 0 2023-10-21T17:23:19.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/908: write d2/d4f/d7e/d87/d57/dc7/dd0/de3/f114 [78203,59515] 0 2023-10-21T17:23:19.337 INFO:tasks.workunit.client.0.smithi012.stdout:7/920: dwrite d3/d6/dc/d19/d1e/d9d/dec/fcb [0,4194304] 0 2023-10-21T17:23:19.337 INFO:tasks.workunit.client.0.smithi012.stdout:7/921: chown d3/d6/d73/d8e/d102 1884 1 2023-10-21T17:23:19.372 INFO:tasks.workunit.client.0.smithi012.stdout:7/922: write d3/d6/dc/f63 [982321,121287] 0 2023-10-21T17:23:19.373 INFO:tasks.workunit.client.0.smithi012.stdout:7/923: write d3/d6/dc/f54 [545356,111548] 0 2023-10-21T17:23:19.409 INFO:tasks.workunit.client.0.smithi012.stdout:4/910: creat dc/d15/f133 x:0 0 0 2023-10-21T17:23:19.467 INFO:tasks.workunit.client.0.smithi012.stdout:7/924: dwrite d3/d6/dc/d19/d1e/dc9/feb [0,4194304] 0 2023-10-21T17:23:19.556 INFO:tasks.workunit.client.0.smithi012.stdout:2/973: creat d1/d14/d16/d58/dec/de2/f147 x:0 0 0 2023-10-21T17:23:19.632 INFO:tasks.workunit.client.0.smithi012.stdout:2/974: dwrite d1/f1a [0,4194304] 0 2023-10-21T17:23:19.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/851: mkdir d0/df/d8d/dcb/d25/d39/d3b/d11b 0 2023-10-21T17:23:19.734 INFO:tasks.workunit.client.0.smithi012.stdout:9/852: chown d0/d4/d4b/d6a/d89/laf 4656 1 2023-10-21T17:23:19.824 INFO:tasks.workunit.client.0.smithi012.stdout:9/853: dwrite d0/df/d8d/dcb/d25/d39/fdc [0,4194304] 0 2023-10-21T17:23:20.456 INFO:tasks.workunit.client.0.smithi012.stdout:5/909: rmdir d2/d4f/d59/df1 0 2023-10-21T17:23:20.910 INFO:tasks.workunit.client.0.smithi012.stdout:4/911: mkdir dc/d15/d18/d57/d134 0 2023-10-21T17:23:20.911 INFO:tasks.workunit.client.0.smithi012.stdout:4/912: write dc/d1e/dc7/dcc/d10f/fd4 [1386935,113959] 0 2023-10-21T17:23:20.911 INFO:tasks.workunit.client.0.smithi012.stdout:4/913: chown dc/d1e/da7 23698459 1 2023-10-21T17:23:20.911 INFO:tasks.workunit.client.0.smithi012.stdout:4/914: chown dc/d1e/dc7/dcc/d10f/d55/d6c/d77/ce2 24 1 2023-10-21T17:23:21.214 INFO:tasks.workunit.client.0.smithi012.stdout:3/859: sync 2023-10-21T17:23:21.221 INFO:tasks.workunit.client.0.smithi012.stdout:3/860: read d0/d1c/fbd [562719,68817] 0 2023-10-21T17:23:21.409 INFO:tasks.workunit.client.0.smithi012.stdout:2/975: creat d1/d14/d16/d117/f148 x:0 0 0 2023-10-21T17:23:21.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/976: stat d1/d4/l23 0 2023-10-21T17:23:21.507 INFO:tasks.workunit.client.0.smithi012.stdout:2/977: dwrite d1/f77 [0,4194304] 0 2023-10-21T17:23:21.590 INFO:tasks.workunit.client.0.smithi012.stdout:9/854: creat d0/df/d44/f11c x:0 0 0 2023-10-21T17:23:21.591 INFO:tasks.workunit.client.0.smithi012.stdout:9/855: write d0/df/d8d/dcb/d25/dc9/fda [2643353,98282] 0 2023-10-21T17:23:21.591 INFO:tasks.workunit.client.0.smithi012.stdout:9/856: truncate d0/fb0 727123 0 2023-10-21T17:23:21.591 INFO:tasks.workunit.client.0.smithi012.stdout:9/857: chown d0/cb2 61780554 1 2023-10-21T17:23:21.591 INFO:tasks.workunit.client.0.smithi012.stdout:9/858: chown d0/d5/f7e 172185796 1 2023-10-21T17:23:21.804 INFO:tasks.workunit.client.0.smithi012.stdout:5/910: rmdir d2/d4f/d59/d5b/d15/de2 39 2023-10-21T17:23:22.114 INFO:tasks.workunit.client.0.smithi012.stdout:4/915: truncate dc/d15/d2a/d58/de1/ffb 696759 0 2023-10-21T17:23:22.181 INFO:tasks.workunit.client.0.smithi012.stdout:4/916: dwrite dc/d1e/dc7/dcc/d10f/d55/f9c [0,4194304] 0 2023-10-21T17:23:22.182 INFO:tasks.workunit.client.0.smithi012.stdout:4/917: write dc/d1e/dc7/dcc/d10f/d55/d6c/d77/f8f [4893621,44404] 0 2023-10-21T17:23:22.182 INFO:tasks.workunit.client.0.smithi012.stdout:4/918: fdatasync dc/d15/d2a/d58/df8/f102 0 2023-10-21T17:23:22.192 INFO:tasks.workunit.client.0.smithi012.stdout:3/861: unlink d0/d1c/l20 0 2023-10-21T17:23:22.282 INFO:tasks.workunit.client.0.smithi012.stdout:3/862: dwrite d0/f15 [0,4194304] 0 2023-10-21T17:23:22.282 INFO:tasks.workunit.client.0.smithi012.stdout:3/863: readlink d0/d32/d43/d47/l66 0 2023-10-21T17:23:22.603 INFO:tasks.workunit.client.0.smithi012.stdout:9/859: creat d0/df/d8d/dcb/d25/d2f/de5/f11d x:0 0 0 2023-10-21T17:23:22.604 INFO:tasks.workunit.client.0.smithi012.stdout:9/860: creat d0/d4/d4b/d6a/ddd/f11e x:0 0 0 2023-10-21T17:23:22.850 INFO:tasks.workunit.client.0.smithi012.stdout:5/911: mkdir d2/d4f/d59/d5b/d15/de2/d11f 0 2023-10-21T17:23:22.851 INFO:tasks.workunit.client.0.smithi012.stdout:5/912: truncate d2/d1d/d4e/fc4 688350 0 2023-10-21T17:23:23.605 INFO:tasks.workunit.client.0.smithi012.stdout:3/864: creat d0/d82/d104/f105 x:0 0 0 2023-10-21T17:23:23.606 INFO:tasks.workunit.client.0.smithi012.stdout:2/978: unlink d1/d14/d17/l9d 0 2023-10-21T17:23:23.839 INFO:tasks.workunit.client.0.smithi012.stdout:9/861: symlink d0/d5/d9c/df0/l11f 0 2023-10-21T17:23:23.839 INFO:tasks.workunit.client.0.smithi012.stdout:9/862: creat d0/d15/df4/f120 x:0 0 0 2023-10-21T17:23:24.008 INFO:tasks.workunit.client.0.smithi012.stdout:5/913: truncate d2/d2c/d73/d49/da9/fcb 3554294 0 2023-10-21T17:23:24.011 INFO:tasks.workunit.client.0.smithi012.stdout:5/914: write d2/d4f/d59/d5b/d1e/f26 [620538,60611] 0 2023-10-21T17:23:24.077 INFO:tasks.workunit.client.0.smithi012.stdout:5/915: dwrite d2/d4f/d7e/d87/d57/d66/f116 [0,4194304] 0 2023-10-21T17:23:24.103 INFO:tasks.workunit.client.0.smithi012.stdout:3/865: chown d0/da/d28/c85 1 1 2023-10-21T17:23:24.414 INFO:tasks.workunit.client.0.smithi012.stdout:2/979: link d1/d8/fb2 d1/d14/d17/db9/dd6/d10f/f149 0 2023-10-21T17:23:24.682 INFO:tasks.workunit.client.0.smithi012.stdout:9/863: getdents d0/d4 0 2023-10-21T17:23:24.682 INFO:tasks.workunit.client.0.smithi012.stdout:9/864: fdatasync d0/d4/d4b/d6a/fae 0 2023-10-21T17:23:24.755 INFO:tasks.workunit.client.0.smithi012.stdout:8/834: sync 2023-10-21T17:23:24.755 INFO:tasks.workunit.client.0.smithi012.stdout:8/835: fdatasync d0/d62/d7d/fdf 0 2023-10-21T17:23:24.756 INFO:tasks.workunit.client.0.smithi012.stdout:8/836: write d0/d1a/db0/f10a [41993,29463] 0 2023-10-21T17:23:24.794 INFO:tasks.workunit.client.0.smithi012.stdout:0/991: write d7/d55/f14 [468373,88484] 0 2023-10-21T17:23:24.795 INFO:tasks.workunit.client.0.smithi012.stdout:0/992: fdatasync d7/d55/d23/f2a 0 2023-10-21T17:23:26.168 INFO:tasks.workunit.client.0.smithi012.stdout:8/837: truncate d0/d1a/f24 3907803 0 2023-10-21T17:23:26.259 INFO:tasks.workunit.client.0.smithi012.stdout:0/993: dread - d7/d55/d23/dce/fe7 zero size 2023-10-21T17:23:26.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/865: getdents d0/d4/d4b/d6a/d89/ddf 0 2023-10-21T17:23:26.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/866: fdatasync d0/d4/d4b/fde 0 2023-10-21T17:23:26.779 INFO:tasks.workunit.client.0.smithi012.stdout:8/838: creat d0/d1a/db0/f10d x:0 0 0 2023-10-21T17:23:26.779 INFO:tasks.workunit.client.0.smithi012.stdout:0/994: creat d7/d55/d23/dce/ddc/f16f x:0 0 0 2023-10-21T17:23:26.904 INFO:tasks.workunit.client.0.smithi012.stdout:1/968: dwrite d5/d32/d1b/d35/d49/f7b [4194304,4194304] 0 2023-10-21T17:23:26.939 INFO:tasks.workunit.client.0.smithi012.stdout:1/969: read d5/d32/d1b/d35/d49/d69/f124 [2590554,111197] 0 2023-10-21T17:23:26.939 INFO:tasks.workunit.client.0.smithi012.stdout:1/970: chown d5/d32/dce/df9/c5f 2792687 1 2023-10-21T17:23:26.965 INFO:tasks.workunit.client.0.smithi012.stdout:1/971: dread d5/d32/d1b/d2c/d48/fa1 [0,4194304] 0 2023-10-21T17:23:26.966 INFO:tasks.workunit.client.0.smithi012.stdout:1/972: dread - d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fec zero size 2023-10-21T17:23:26.977 INFO:tasks.workunit.client.0.smithi012.stdout:9/867: mknod d0/d5/c121 0 2023-10-21T17:23:27.560 INFO:tasks.workunit.client.0.smithi012.stdout:9/868: creat d0/df/d8d/dcb/d2a/f122 x:0 0 0 2023-10-21T17:23:27.590 INFO:tasks.workunit.client.0.smithi012.stdout:9/869: dread d0/df/d8d/dcb/d25/dc9/fda [0,4194304] 0 2023-10-21T17:23:27.591 INFO:tasks.workunit.client.0.smithi012.stdout:9/870: read d0/f85 [3355231,77904] 0 2023-10-21T17:23:27.628 INFO:tasks.workunit.client.0.smithi012.stdout:9/871: dread d0/d4/f2e [0,4194304] 0 2023-10-21T17:23:27.652 INFO:tasks.workunit.client.0.smithi012.stdout:9/872: dread d0/df/d8d/dcb/d25/d2f/d8c/f9a [0,4194304] 0 2023-10-21T17:23:27.652 INFO:tasks.workunit.client.0.smithi012.stdout:9/873: fdatasync d0/dcd/ff1 0 2023-10-21T17:23:27.773 INFO:tasks.workunit.client.0.smithi012.stdout:9/874: dwrite d0/f3e [0,4194304] 0 2023-10-21T17:23:27.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/875: chown d0/df/d8d/de1 407210 1 2023-10-21T17:23:27.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/876: readlink d0/df/d8d/dcb/d25/d39/d3b/l75 0 2023-10-21T17:23:27.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/877: chown d0/df/d8d/dcb/d25/d39/d3b/l75 337076 1 2023-10-21T17:23:27.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/878: chown d0/df/d8d/dcb/d25/d39/d3b/d67 338 1 2023-10-21T17:23:28.055 INFO:tasks.workunit.client.0.smithi012.stdout:7/925: rename d3/d6/le to d3/d6/dc/d19/d1e/d34/da8/l12c 0 2023-10-21T17:23:28.056 INFO:tasks.workunit.client.0.smithi012.stdout:7/926: write d3/d6/f81 [1343523,127145] 0 2023-10-21T17:23:30.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/858: rmdir d13/d15 39 2023-10-21T17:23:30.741 INFO:tasks.workunit.client.0.smithi012.stdout:7/927: symlink d3/d6/d73/d8e/d102/l12d 0 2023-10-21T17:23:30.742 INFO:tasks.workunit.client.0.smithi012.stdout:7/928: write d3/d6/dc/d19/d1e/d34/da8/db4/f118 [1044610,87010] 0 2023-10-21T17:23:31.316 INFO:tasks.workunit.client.0.smithi012.stdout:6/859: fdatasync d13/d35/d4c/f9e 0 2023-10-21T17:23:31.614 INFO:tasks.workunit.client.0.smithi012.stdout:3/866: write d0/da/f5f [6693489,32113] 0 2023-10-21T17:23:31.615 INFO:tasks.workunit.client.0.smithi012.stdout:3/867: stat d0/d96/d97 0 2023-10-21T17:23:31.634 INFO:tasks.workunit.client.0.smithi012.stdout:5/916: dwrite d2/d1d/f8e [0,4194304] 0 2023-10-21T17:23:32.077 INFO:tasks.workunit.client.0.smithi012.stdout:6/860: symlink d13/d15/d1d/d5d/d66/d70/d74/d98/l129 0 2023-10-21T17:23:32.231 INFO:tasks.workunit.client.0.smithi012.stdout:2/980: rmdir d1/d14/d17 39 2023-10-21T17:23:32.299 INFO:tasks.workunit.client.0.smithi012.stdout:2/981: dwrite d1/d14/d16/d58/dec/da5/d34/fa4 [0,4194304] 0 2023-10-21T17:23:32.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/868: creat d0/da/d28/df9/f106 x:0 0 0 2023-10-21T17:23:32.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/917: creat d2/d2c/db6/f120 x:0 0 0 2023-10-21T17:23:32.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/918: readlink d2/d4f/d7e/d87/l3a 0 2023-10-21T17:23:32.685 INFO:tasks.workunit.client.0.smithi012.stdout:6/861: mknod d13/d42/d71/c12a 0 2023-10-21T17:23:32.839 INFO:tasks.workunit.client.0.smithi012.stdout:2/982: mknod d1/d4/d11a/c14a 0 2023-10-21T17:23:32.965 INFO:tasks.workunit.client.0.smithi012.stdout:5/919: mkdir d2/d2c/db6/d121 0 2023-10-21T17:23:32.966 INFO:tasks.workunit.client.0.smithi012.stdout:5/920: chown d2/d4f/d59/feb 7230499 1 2023-10-21T17:23:33.205 INFO:tasks.workunit.client.0.smithi012.stdout:8/839: dwrite d0/d62/d83/d72/f96 [0,4194304] 0 2023-10-21T17:23:33.338 INFO:tasks.workunit.client.0.smithi012.stdout:2/983: creat d1/d4/d3f/d107/f14b x:0 0 0 2023-10-21T17:23:33.338 INFO:tasks.workunit.client.0.smithi012.stdout:0/995: write d7/f36 [2347026,112328] 0 2023-10-21T17:23:33.338 INFO:tasks.workunit.client.0.smithi012.stdout:0/996: stat d7/d52/d90/d13d 0 2023-10-21T17:23:33.376 INFO:tasks.workunit.client.0.smithi012.stdout:1/973: write d5/d32/d1b/d35/d49/d69/ff1 [1450844,120052] 0 2023-10-21T17:23:33.495 INFO:tasks.workunit.client.0.smithi012.stdout:8/840: creat d0/d12/d40/f10e x:0 0 0 2023-10-21T17:23:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/841: dread - d0/d1a/db0/f10d zero size 2023-10-21T17:23:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/842: chown d0/d29/dde/fc2 3191066 1 2023-10-21T17:23:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/843: dread - d0/d12/d6c/fb8 zero size 2023-10-21T17:23:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:8/844: chown d0/d12/d80/c100 41 1 2023-10-21T17:23:33.523 INFO:tasks.workunit.client.0.smithi012.stdout:8/845: dread d0/d1a/db0/db7/dd8/dda/fcb [0,4194304] 0 2023-10-21T17:23:33.524 INFO:tasks.workunit.client.0.smithi012.stdout:8/846: creat d0/d29/d79/f10f x:0 0 0 2023-10-21T17:23:33.659 INFO:tasks.workunit.client.0.smithi012.stdout:2/984: mkdir d1/d14/d17/da6/d146/d14c 0 2023-10-21T17:23:33.660 INFO:tasks.workunit.client.0.smithi012.stdout:2/985: chown d1/d4/d3f/d4a 3439 1 2023-10-21T17:23:33.660 INFO:tasks.workunit.client.0.smithi012.stdout:2/986: write d1/d4/d65/fc3 [188498,49097] 0 2023-10-21T17:23:33.660 INFO:tasks.workunit.client.0.smithi012.stdout:2/987: truncate d1/d4/d3f/d41/d59/d12f/f13d 999342 0 2023-10-21T17:23:33.661 INFO:tasks.workunit.client.0.smithi012.stdout:2/988: truncate d1/d14/d17/db9/dd6/d10f/f149 61538 0 2023-10-21T17:23:33.979 INFO:tasks.workunit.client.0.smithi012.stdout:0/997: mkdir d7/d55/d23/dce/ddc/d114/da9/d107/d170 0 2023-10-21T17:23:33.979 INFO:tasks.workunit.client.0.smithi012.stdout:5/921: symlink d2/d4f/d7e/d87/d57/l122 0 2023-10-21T17:23:34.242 INFO:tasks.workunit.client.0.smithi012.stdout:8/847: getdents d0/d12/d6c/ddb 0 2023-10-21T17:23:35.821 INFO:tasks.workunit.client.0.smithi012.stdout:0/998: unlink d7/d55/da2/l151 0 2023-10-21T17:23:36.310 INFO:tasks.workunit.client.0.smithi012.stdout:0/999: mknod d7/d55/d1f/d28/c171 0 2023-10-21T17:23:36.344 INFO:tasks.workunit.client.0.smithi012.stdout:9/879: sync 2023-10-21T17:23:36.383 INFO:tasks.workunit.client.0.smithi012.stdout:9/880: dread d0/d15/f88 [0,4194304] 0 2023-10-21T17:23:36.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/881: fsync d0/d4/d4b/d6a/ddd/f115 0 2023-10-21T17:23:36.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/882: write d0/d15/df4/f120 [168468,12744] 0 2023-10-21T17:23:36.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/922: rmdir d2/d4f/d7e/daf 39 2023-10-21T17:23:37.007 INFO:tasks.workunit.client.0.smithi012.stdout:9/883: truncate d0/d4/d4b/d6a/fae 1108712 0 2023-10-21T17:23:37.007 INFO:tasks.workunit.client.0.smithi012.stdout:9/884: chown d0/d5/c121 2141373560 1 2023-10-21T17:23:37.008 INFO:tasks.workunit.client.0.smithi012.stdout:9/885: write d0/df/d8d/dcb/d25/f119 [544781,75973] 0 2023-10-21T17:23:37.110 INFO:tasks.workunit.client.0.smithi012.stdout:9/886: dwrite d0/df/d8d/dcb/d25/d39/fdc [0,4194304] 0 2023-10-21T17:23:37.130 INFO:tasks.workunit.client.0.smithi012.stdout:5/923: dwrite d2/d4f/d7e/d87/d57/f5f [4194304,4194304] 0 2023-10-21T17:23:37.131 INFO:tasks.workunit.client.0.smithi012.stdout:5/924: truncate d2/d2c/db6/f120 688619 0 2023-10-21T17:23:37.198 INFO:tasks.workunit.client.0.smithi012.stdout:5/925: dwrite d2/d2c/d73/d49/da9/fcc [0,4194304] 0 2023-10-21T17:23:37.419 INFO:tasks.workunit.client.0.smithi012.stdout:6/862: dwrite d13/d15/f61 [0,4194304] 0 2023-10-21T17:23:37.419 INFO:tasks.workunit.client.0.smithi012.stdout:6/863: fdatasync d13/d29/d77/f11f 0 2023-10-21T17:23:38.021 INFO:tasks.workunit.client.0.smithi012.stdout:9/887: symlink d0/d5/d9c/dc7/l123 0 2023-10-21T17:23:38.951 INFO:tasks.workunit.client.0.smithi012.stdout:6/864: mknod d13/d42/d71/c12b 0 2023-10-21T17:23:38.952 INFO:tasks.workunit.client.0.smithi012.stdout:9/888: getdents d0/df/d8d/dcb 0 2023-10-21T17:23:39.070 INFO:tasks.workunit.client.0.smithi012.stdout:6/865: dwrite d13/d42/d89/db8/deb/ff2 [0,4194304] 0 2023-10-21T17:23:39.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:23:39.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:23:39.086 INFO:tasks.workunit.client.0.smithi012.stdout:6/866: write d13/d35/d4c/f65 [1652022,52026] 0 2023-10-21T17:23:39.117 INFO:tasks.workunit.client.0.smithi012.stdout:6/867: dread f7 [0,4194304] 0 2023-10-21T17:23:39.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/868: dwrite d13/d15/d1d/d28/f7c [0,4194304] 0 2023-10-21T17:23:39.185 INFO:tasks.workunit.client.0.smithi012.stdout:6/869: dread d13/d15/d1d/f20 [0,4194304] 0 2023-10-21T17:23:39.262 INFO:tasks.workunit.client.0.smithi012.stdout:6/870: dwrite d13/d35/d4c/f65 [0,4194304] 0 2023-10-21T17:23:39.398 INFO:tasks.workunit.client.0.smithi012.stdout:4/919: rename dc/l20 to dc/d1e/d33/l135 0 2023-10-21T17:23:39.425 INFO:tasks.workunit.client.0.smithi012.stdout:4/920: write dc/d1e/d33/d8a/fb9 [2645928,127370] 0 2023-10-21T17:23:41.454 INFO:tasks.workunit.client.0.smithi012.stdout:6/871: link d13/d35/d4c/l96 d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/l12c 0 2023-10-21T17:23:42.249 INFO:tasks.workunit.client.0.smithi012.stdout:6/872: mkdir d13/d64/d6d/d12d 0 2023-10-21T17:23:42.258 INFO:tasks.workunit.client.0.smithi012.stdout:7/929: rename d3/d6/dc/d19/d1e/d7b to d3/d6/d73/d8e/d12e 0 2023-10-21T17:23:42.290 INFO:tasks.workunit.client.0.smithi012.stdout:9/889: write d0/df/d44/fee [777993,89140] 0 2023-10-21T17:23:42.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/890: read d0/d5/f59 [1582609,66248] 0 2023-10-21T17:23:42.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/891: write d0/fe4 [722158,51435] 0 2023-10-21T17:23:42.325 INFO:tasks.workunit.client.0.smithi012.stdout:9/892: creat d0/d5/df3/f124 x:0 0 0 2023-10-21T17:23:42.325 INFO:tasks.workunit.client.0.smithi012.stdout:9/893: write d0/d4/d4b/ded/d116/f11a [588671,30540] 0 2023-10-21T17:23:42.325 INFO:tasks.workunit.client.0.smithi012.stdout:9/894: dread - d0/d15/df4/ffc zero size 2023-10-21T17:23:42.339 INFO:tasks.workunit.client.0.smithi012.stdout:2/989: sync 2023-10-21T17:23:42.430 INFO:tasks.workunit.client.0.smithi012.stdout:9/895: dwrite d0/d15/f9f [0,4194304] 0 2023-10-21T17:23:42.456 INFO:tasks.workunit.client.0.smithi012.stdout:9/896: dread d0/df/d8d/dcb/d25/d2f/f62 [0,4194304] 0 2023-10-21T17:23:42.484 INFO:tasks.workunit.client.0.smithi012.stdout:6/873: symlink d13/d42/d89/l12e 0 2023-10-21T17:23:42.680 INFO:tasks.workunit.client.0.smithi012.stdout:3/869: rename d0/d82/faf to d0/d1c/d5e/f107 0 2023-10-21T17:23:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:2/990: creat d1/d4/d65/dea/dcc/f14d x:0 0 0 2023-10-21T17:23:43.295 INFO:tasks.workunit.client.0.smithi012.stdout:6/874: symlink d13/d29/d77/l12f 0 2023-10-21T17:23:43.295 INFO:tasks.workunit.client.0.smithi012.stdout:6/875: write d13/d15/d1d/f106 [1360349,65668] 0 2023-10-21T17:23:43.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/897: dread d0/df/d8d/dcb/d2a/f7f [0,4194304] 0 2023-10-21T17:23:43.379 INFO:tasks.workunit.client.0.smithi012.stdout:6/876: dwrite d13/f47 [0,4194304] 0 2023-10-21T17:23:43.617 INFO:tasks.workunit.client.0.smithi012.stdout:1/974: rename d5/d32/d62/dae to d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/d13e 0 2023-10-21T17:23:43.806 INFO:tasks.workunit.client.0.smithi012.stdout:3/870: creat d0/d96/da0/f108 x:0 0 0 2023-10-21T17:23:43.807 INFO:tasks.workunit.client.0.smithi012.stdout:3/871: write d0/da/f5f [5323015,3888] 0 2023-10-21T17:23:43.906 INFO:tasks.workunit.client.0.smithi012.stdout:7/930: symlink d3/dd9/d9c/l12f 0 2023-10-21T17:23:43.982 INFO:tasks.workunit.client.0.smithi012.stdout:4/921: sync 2023-10-21T17:23:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/991: mkdir d1/d14/d17/db9/dd6/d10f/d14e 0 2023-10-21T17:23:44.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/877: mknod d13/d15/d1d/d5d/d66/d70/d74/c130 0 2023-10-21T17:23:44.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/878: write d13/d15/d1d/d5d/d66/d70/d74/dc9/f117 [784777,71334] 0 2023-10-21T17:23:44.936 INFO:tasks.workunit.client.0.smithi012.stdout:8/848: rename d0/d29/f3c to d0/d1a/db0/f110 0 2023-10-21T17:23:44.962 INFO:tasks.workunit.client.0.smithi012.stdout:8/849: write d0/d1a/f33 [1404681,49709] 0 2023-10-21T17:23:45.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/975: unlink d5/d32/d1b/d27/d47/de9/f10b 0 2023-10-21T17:23:45.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/931: creat d3/d6/d73/d8e/d111/f130 x:0 0 0 2023-10-21T17:23:45.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/922: link dc/d15/d18/d57/f61 dc/d1e/da7/f136 0 2023-10-21T17:23:46.014 INFO:tasks.workunit.client.0.smithi012.stdout:2/992: mkdir d1/d4/d11a/d14f 0 2023-10-21T17:23:46.044 INFO:tasks.workunit.client.0.smithi012.stdout:2/993: dread d1/d8/f2d [0,4194304] 0 2023-10-21T17:23:46.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/879: getdents d13/d42/d89/db8/deb 0 2023-10-21T17:23:46.764 INFO:tasks.workunit.client.0.smithi012.stdout:1/976: unlink d5/d32/d1b/d35/d3a/d5c/d7c/db7/dd1/fec 0 2023-10-21T17:23:46.764 INFO:tasks.workunit.client.0.smithi012.stdout:3/872: mknod d0/c109 0 2023-10-21T17:23:46.862 INFO:tasks.workunit.client.0.smithi012.stdout:7/932: mknod d3/d6/d73/d8e/d111/c131 0 2023-10-21T17:23:46.862 INFO:tasks.workunit.client.0.smithi012.stdout:7/933: fsync d3/d29/f7c 0 2023-10-21T17:23:47.765 INFO:tasks.workunit.client.0.smithi012.stdout:9/898: dwrite d0/d15/f23 [0,4194304] 0 2023-10-21T17:23:47.865 INFO:tasks.workunit.client.0.smithi012.stdout:2/994: mkdir d1/d4/d3f/d4a/d124/d150 0 2023-10-21T17:23:47.865 INFO:tasks.workunit.client.0.smithi012.stdout:2/995: stat d1/d4/f2b 0 2023-10-21T17:23:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:5/926: rename d2/d4f/d7e/d87/d57/c8b to d2/d2c/db6/d102/c123 0 2023-10-21T17:23:48.647 INFO:tasks.workunit.client.0.smithi012.stdout:8/850: getdents d0/d46 0 2023-10-21T17:23:48.648 INFO:tasks.workunit.client.0.smithi012.stdout:8/851: fsync d0/d1a/db0/db7/dd8/dda/fee 0 2023-10-21T17:23:49.011 INFO:tasks.workunit.client.0.smithi012.stdout:3/873: symlink d0/d1c/l10a 0 2023-10-21T17:23:49.063 INFO:tasks.workunit.client.0.smithi012.stdout:7/934: mknod d3/d6/d73/d8e/c132 0 2023-10-21T17:23:49.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/935: dwrite d3/da7/fd1 [0,4194304] 0 2023-10-21T17:23:49.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/899: truncate d0/df/d8d/dcb/d25/d39/d3b/f3f 3759826 0 2023-10-21T17:23:49.665 INFO:tasks.workunit.client.0.smithi012.stdout:2/996: link d1/d4/d93/fa7 d1/d4/d3f/d13f/f151 0 2023-10-21T17:23:50.089 INFO:tasks.workunit.client.0.smithi012.stdout:5/927: symlink d2/d2c/db6/d102/l124 0 2023-10-21T17:23:50.401 INFO:tasks.workunit.client.0.smithi012.stdout:9/900: creat d0/df/d8d/dcb/d25/d39/f125 x:0 0 0 2023-10-21T17:23:50.401 INFO:tasks.workunit.client.0.smithi012.stdout:9/901: write d0/d5/df3/f109 [631524,40163] 0 2023-10-21T17:23:50.401 INFO:tasks.workunit.client.0.smithi012.stdout:9/902: dread - d0/df/d8d/dcb/d25/f114 zero size 2023-10-21T17:23:50.434 INFO:tasks.workunit.client.0.smithi012.stdout:9/903: dread d0/f3e [0,4194304] 0 2023-10-21T17:23:50.507 INFO:tasks.workunit.client.0.smithi012.stdout:9/904: dwrite d0/f6b [0,4194304] 0 2023-10-21T17:23:50.507 INFO:tasks.workunit.client.0.smithi012.stdout:9/905: chown d0/dcd/l111 73 1 2023-10-21T17:23:50.701 INFO:tasks.workunit.client.0.smithi012.stdout:5/928: dwrite d2/d4f/d7e/d87/d57/dc7/dd0/f7 [0,4194304] 0 2023-10-21T17:23:50.702 INFO:tasks.workunit.client.0.smithi012.stdout:5/929: creat d2/d4f/d7e/d87/d57/dc7/dd0/de3/f125 x:0 0 0 2023-10-21T17:23:50.702 INFO:tasks.workunit.client.0.smithi012.stdout:5/930: dread - d2/d4f/d7e/d87/d93/dc3/fde zero size 2023-10-21T17:23:50.702 INFO:tasks.workunit.client.0.smithi012.stdout:5/931: chown d2/d2c/d73/d49/da9/d100/f108 26408683 1 2023-10-21T17:23:50.702 INFO:tasks.workunit.client.0.smithi012.stdout:5/932: read - d2/d4f/d59/f10d zero size 2023-10-21T17:23:50.703 INFO:tasks.workunit.client.0.smithi012.stdout:5/933: write d2/d1d/d20/f4d [1240982,5189] 0 2023-10-21T17:23:50.808 INFO:tasks.workunit.client.0.smithi012.stdout:5/934: dwrite d2/d4f/d7e/f8a [0,4194304] 0 2023-10-21T17:23:50.809 INFO:tasks.workunit.client.0.smithi012.stdout:5/935: chown d2/d2c/d8c/dff 14 1 2023-10-21T17:23:51.082 INFO:tasks.workunit.client.0.smithi012.stdout:7/936: rename d3/d6/d73/d8e/d102 to d3/d6/d73/d8e/d12e/dd4/d133 0 2023-10-21T17:23:51.577 INFO:tasks.workunit.client.0.smithi012.stdout:5/936: creat d2/d2c/d73/f126 x:0 0 0 2023-10-21T17:23:51.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/937: mknod d2/db5/df2/c127 0 2023-10-21T17:23:51.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/938: chown d2/d1d/d4e/f5c 69059 1 2023-10-21T17:23:52.361 INFO:tasks.workunit.client.0.smithi012.stdout:4/923: sync 2023-10-21T17:23:52.362 INFO:tasks.workunit.client.0.smithi012.stdout:7/937: mkdir d3/d6/d73/d8e/d12e/dd4/d133/d134 0 2023-10-21T17:23:52.362 INFO:tasks.workunit.client.0.smithi012.stdout:7/938: write d3/d6/dc/d19/f57 [7516972,86086] 0 2023-10-21T17:23:52.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/939: dread d3/d6/dc/f11f [0,4194304] 0 2023-10-21T17:23:52.450 INFO:tasks.workunit.client.0.smithi012.stdout:6/880: dwrite d13/d15/f1a [0,4194304] 0 2023-10-21T17:23:52.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/881: dread d13/f47 [4194304,4194304] 0 2023-10-21T17:23:52.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/882: truncate d13/d15/d1d/d28/d5b/d75/fc0 1839253 0 2023-10-21T17:23:52.556 INFO:tasks.workunit.client.0.smithi012.stdout:6/883: dwrite f1 [4194304,4194304] 0 2023-10-21T17:23:52.590 INFO:tasks.workunit.client.0.smithi012.stdout:4/924: truncate dc/d1e/dc7/f106 3686172 0 2023-10-21T17:23:52.590 INFO:tasks.workunit.client.0.smithi012.stdout:4/925: fdatasync dc/d15/d2a/d58/df8/dfa/f107 0 2023-10-21T17:23:52.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/939: write d2/d4f/d7e/d87/d57/d66/daa/ff6 [710091,91778] 0 2023-10-21T17:23:52.718 INFO:tasks.workunit.client.0.smithi012.stdout:7/940: symlink d3/d6/d6a/l135 0 2023-10-21T17:23:52.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/977: dwrite d5/f14 [0,4194304] 0 2023-10-21T17:23:52.930 INFO:tasks.workunit.client.0.smithi012.stdout:1/978: truncate d5/d32/d1b/d35/d3a/d5c/f85 987494 0 2023-10-21T17:23:52.930 INFO:tasks.workunit.client.0.smithi012.stdout:1/979: dread - d5/d32/f12e zero size 2023-10-21T17:23:53.162 INFO:tasks.workunit.client.0.smithi012.stdout:6/884: unlink d13/d15/f21 0 2023-10-21T17:23:53.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/940: symlink d2/d4f/d7e/d87/d93/dc3/l128 0 2023-10-21T17:23:53.994 INFO:tasks.workunit.client.0.smithi012.stdout:5/941: mkdir d2/d4f/d59/d129 0 2023-10-21T17:23:54.188 INFO:tasks.workunit.client.0.smithi012.stdout:6/885: mknod d13/d42/d89/db8/c131 0 2023-10-21T17:23:54.713 INFO:tasks.workunit.client.0.smithi012.stdout:8/852: dwrite d0/d62/f8d [4194304,4194304] 0 2023-10-21T17:23:54.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/997: dwrite d1/d14/d16/d58/f66 [0,4194304] 0 2023-10-21T17:23:54.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/998: chown d1/d14/d16/d58/dec/l2f 69 1 2023-10-21T17:23:54.779 INFO:tasks.workunit.client.0.smithi012.stdout:2/999: dwrite d1/d14/d17/d8a/fd7 [0,4194304] 0 2023-10-21T17:23:55.592 INFO:tasks.workunit.client.0.smithi012.stdout:6/886: write d13/d15/d1d/d28/d5b/d75/f111 [106200,100724] 0 2023-10-21T17:23:55.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/906: symlink d0/l126 0 2023-10-21T17:23:55.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/907: dread d0/d5/f59 [0,4194304] 0 2023-10-21T17:23:55.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/908: creat d0/df/d8d/dcb/d25/d39/f127 x:0 0 0 2023-10-21T17:23:55.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/909: creat d0/d4/d4b/d6a/ddd/f128 x:0 0 0 2023-10-21T17:23:56.026 INFO:tasks.workunit.client.0.smithi012.stdout:6/887: truncate f7 4827958 0 2023-10-21T17:23:56.394 INFO:tasks.workunit.client.0.smithi012.stdout:9/910: creat d0/df/d8d/de1/f129 x:0 0 0 2023-10-21T17:23:56.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/911: write d0/d4/d4b/fbf [661627,101413] 0 2023-10-21T17:23:56.402 INFO:tasks.workunit.client.0.smithi012.stdout:9/912: write d0/fe4 [272802,37145] 0 2023-10-21T17:23:56.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/913: read d0/f3e [2858532,12598] 0 2023-10-21T17:23:56.648 INFO:tasks.workunit.client.0.smithi012.stdout:6/888: symlink d13/d15/d1d/d5d/d92/l132 0 2023-10-21T17:23:57.046 INFO:tasks.workunit.client.0.smithi012.stdout:4/926: dwrite dc/d1e/dc7/dcc/d10f/d75/fcd [4194304,4194304] 0 2023-10-21T17:23:57.046 INFO:tasks.workunit.client.0.smithi012.stdout:4/927: dread - dc/d15/d2a/d31/df3/f10b zero size 2023-10-21T17:23:57.047 INFO:tasks.workunit.client.0.smithi012.stdout:4/928: stat dc/d1e/dc7/dcc/d10f/d75/de3/fff 0 2023-10-21T17:23:57.063 INFO:tasks.workunit.client.0.smithi012.stdout:4/929: dread dc/d1e/dc7/dcc/d10f/d75/fac [0,4194304] 0 2023-10-21T17:23:57.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/889: unlink d13/d15/d1d/d5d/lfa 0 2023-10-21T17:23:57.548 INFO:tasks.workunit.client.0.smithi012.stdout:9/914: getdents d0/d4/d4b/d6a/d89/de2 0 2023-10-21T17:23:57.549 INFO:tasks.workunit.client.0.smithi012.stdout:9/915: creat d0/d4/d4b/ded/d116/f12a x:0 0 0 2023-10-21T17:23:57.805 INFO:tasks.workunit.client.0.smithi012.stdout:4/930: dread dc/d1e/dc7/dcc/d10f/d55/d6c/d77/f8f [4194304,4194304] 0 2023-10-21T17:23:57.806 INFO:tasks.workunit.client.0.smithi012.stdout:4/931: fsync dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/f120 0 2023-10-21T17:23:58.043 INFO:tasks.workunit.client.0.smithi012.stdout:3/874: rename d0/d96 to d0/d10b 0 2023-10-21T17:23:58.649 INFO:tasks.workunit.client.0.smithi012.stdout:6/890: dread d13/d15/d1d/d28/fa8 [0,4194304] 0 2023-10-21T17:23:58.681 INFO:tasks.workunit.client.0.smithi012.stdout:6/891: dread d13/d35/d4c/ff5 [0,4194304] 0 2023-10-21T17:23:58.681 INFO:tasks.workunit.client.0.smithi012.stdout:6/892: read - d13/d64/fd1 zero size 2023-10-21T17:23:58.757 INFO:tasks.workunit.client.0.smithi012.stdout:3/875: getdents d0/d32/d43/d102 0 2023-10-21T17:23:58.843 INFO:tasks.workunit.client.0.smithi012.stdout:9/916: link d0/df/d44/f51 d0/d5/d9c/f12b 0 2023-10-21T17:23:59.476 INFO:tasks.workunit.client.0.smithi012.stdout:9/917: mkdir d0/d5/d9c/d12c 0 2023-10-21T17:23:59.563 INFO:tasks.workunit.client.0.smithi012.stdout:6/893: link d13/d15/l85 d13/d29/d37/d3b/l133 0 2023-10-21T17:23:59.563 INFO:tasks.workunit.client.0.smithi012.stdout:6/894: chown d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/fc2 27055702 1 2023-10-21T17:23:59.700 INFO:tasks.workunit.client.0.smithi012.stdout:9/918: mkdir d0/df/d8d/dcb/d25/d39/d12d 0 2023-10-21T17:23:59.892 INFO:tasks.workunit.client.0.smithi012.stdout:6/895: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9/f134 x:0 0 0 2023-10-21T17:24:00.846 INFO:tasks.workunit.client.0.smithi012.stdout:9/919: symlink d0/d5/l12e 0 2023-10-21T17:24:00.867 INFO:tasks.workunit.client.0.smithi012.stdout:9/920: read d0/df/d44/f51 [51314,125802] 0 2023-10-21T17:24:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:8/853: dwrite d0/d1a/db0/dca/fd5 [0,4194304] 0 2023-10-21T17:24:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:8/854: stat d0/d29/d79/f97 0 2023-10-21T17:24:01.224 INFO:tasks.workunit.client.0.smithi012.stdout:6/896: dwrite d13/d15/f27 [0,4194304] 0 2023-10-21T17:24:01.385 INFO:tasks.workunit.client.0.smithi012.stdout:7/941: rename d3/d6/c5a to d3/d6/dc/d19/d1e/d9d/c136 0 2023-10-21T17:24:01.409 INFO:tasks.workunit.client.0.smithi012.stdout:7/942: write d3/d29/f7d [1144976,93033] 0 2023-10-21T17:24:01.421 INFO:tasks.workunit.client.0.smithi012.stdout:4/932: write dc/d1e/dc7/dcc/d10f/fb3 [191727,87999] 0 2023-10-21T17:24:01.594 INFO:tasks.workunit.client.0.smithi012.stdout:9/921: mknod d0/df/d8d/dcb/d25/d2f/d8c/c12f 0 2023-10-21T17:24:02.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/855: mkdir d0/d62/d83/d111 0 2023-10-21T17:24:02.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/856: write d0/f8f [566451,33625] 0 2023-10-21T17:24:02.176 INFO:tasks.workunit.client.0.smithi012.stdout:3/876: dwrite d0/da/f54 [0,4194304] 0 2023-10-21T17:24:02.188 INFO:tasks.workunit.client.0.smithi012.stdout:8/857: dwrite d0/d12/d51/f102 [0,4194304] 0 2023-10-21T17:24:02.308 INFO:tasks.workunit.client.0.smithi012.stdout:7/943: truncate d3/d16/f1a 2679046 0 2023-10-21T17:24:02.435 INFO:tasks.workunit.client.0.smithi012.stdout:4/933: mkdir dc/d15/d2a/d137 0 2023-10-21T17:24:02.535 INFO:tasks.workunit.client.0.smithi012.stdout:4/934: dwrite dc/d15/d2a/d58/f92 [0,4194304] 0 2023-10-21T17:24:02.650 INFO:tasks.workunit.client.0.smithi012.stdout:1/980: rename d5/d32/d1b/d35/d3a/d5c/d7c/l131 to d5/d32/d1b/d27/l13f 0 2023-10-21T17:24:03.504 INFO:tasks.workunit.client.0.smithi012.stdout:3/877: rmdir d0/d32/d43/dca/ded 0 2023-10-21T17:24:03.504 INFO:tasks.workunit.client.0.smithi012.stdout:3/878: chown d0/d32/d43/lc0 6680186 1 2023-10-21T17:24:03.595 INFO:tasks.workunit.client.0.smithi012.stdout:5/942: sync 2023-10-21T17:24:03.669 INFO:tasks.workunit.client.0.smithi012.stdout:5/943: dwrite d2/d1d/d20/f48 [4194304,4194304] 0 2023-10-21T17:24:03.669 INFO:tasks.workunit.client.0.smithi012.stdout:5/944: chown d2/d4f/lfb 1669069203 1 2023-10-21T17:24:04.658 INFO:tasks.workunit.client.0.smithi012.stdout:1/981: symlink d5/d32/d1b/d27/l140 0 2023-10-21T17:24:04.684 INFO:tasks.workunit.client.0.smithi012.stdout:1/982: write d5/d26/fbe [4066526,51061] 0 2023-10-21T17:24:04.729 INFO:tasks.workunit.client.0.smithi012.stdout:1/983: dread d5/d32/dce/de0/f10a [0,4194304] 0 2023-10-21T17:24:04.798 INFO:tasks.workunit.client.0.smithi012.stdout:5/945: unlink d2/d4f/d7e/d87/d57/d66/daa/ff8 0 2023-10-21T17:24:05.276 INFO:tasks.workunit.client.0.smithi012.stdout:6/897: rename d13/d15/f67 to d13/d15/d1d/d5d/d66/d70/d74/d98/f135 0 2023-10-21T17:24:05.349 INFO:tasks.workunit.client.0.smithi012.stdout:4/935: dwrite dc/d93/f50 [0,4194304] 0 2023-10-21T17:24:05.349 INFO:tasks.workunit.client.0.smithi012.stdout:4/936: chown dc/d1e/dc7/dcc/d10f/d55/d6c/dbb/f10e 19007 1 2023-10-21T17:24:05.915 INFO:tasks.workunit.client.0.smithi012.stdout:5/946: mknod d2/d2c/d73/d49/da9/c12a 0 2023-10-21T17:24:05.916 INFO:tasks.workunit.client.0.smithi012.stdout:9/922: rename d0/d4/d4b/ca6 to d0/df/d8d/dcb/d25/d39/c130 0 2023-10-21T17:24:05.916 INFO:tasks.workunit.client.0.smithi012.stdout:5/947: chown d2/d1d 610 1 2023-10-21T17:24:05.917 INFO:tasks.workunit.client.0.smithi012.stdout:9/923: readlink d0/d5/df3/lf8 0 2023-10-21T17:24:05.917 INFO:tasks.workunit.client.0.smithi012.stdout:5/948: fdatasync d2/d1d/d4e/fc4 0 2023-10-21T17:24:05.990 INFO:tasks.workunit.client.0.smithi012.stdout:5/949: dwrite d2/db5/f10e [0,4194304] 0 2023-10-21T17:24:06.204 INFO:tasks.workunit.client.0.smithi012.stdout:1/984: mknod d5/d30/da9/db9/c141 0 2023-10-21T17:24:06.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/898: mknod d13/d42/c136 0 2023-10-21T17:24:06.237 INFO:tasks.workunit.client.0.smithi012.stdout:6/899: dread d13/d29/d78/fb3 [0,4194304] 0 2023-10-21T17:24:06.315 INFO:tasks.workunit.client.0.smithi012.stdout:6/900: dwrite d13/f36 [0,4194304] 0 2023-10-21T17:24:06.613 INFO:tasks.workunit.client.0.smithi012.stdout:9/924: truncate d0/df/d8d/f64 3667055 0 2023-10-21T17:24:06.861 INFO:tasks.workunit.client.0.smithi012.stdout:3/879: write d0/da/d28/fe1 [1964829,13854] 0 2023-10-21T17:24:07.358 INFO:tasks.workunit.client.0.smithi012.stdout:1/985: creat d5/d30/da9/f142 x:0 0 0 2023-10-21T17:24:07.775 INFO:tasks.workunit.client.0.smithi012.stdout:8/858: rename d0/d1a/db0/dca/f101 to d0/d62/d83/d72/f112 0 2023-10-21T17:24:08.661 INFO:tasks.workunit.client.0.smithi012.stdout:4/937: write dc/d1e/dc7/dcc/d10f/d55/f9c [1700095,32449] 0 2023-10-21T17:24:08.802 INFO:tasks.workunit.client.0.smithi012.stdout:9/925: creat d0/f131 x:0 0 0 2023-10-21T17:24:08.803 INFO:tasks.workunit.client.0.smithi012.stdout:9/926: write d0/d5/f102 [4969495,87491] 0 2023-10-21T17:24:09.158 INFO:tasks.workunit.client.0.smithi012.stdout:5/950: rmdir d2/d4f/d59/d5b/d15 39 2023-10-21T17:24:09.159 INFO:tasks.workunit.client.0.smithi012.stdout:5/951: write d2/d1d/d4e/f11e [180428,73568] 0 2023-10-21T17:24:09.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:24:09.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:24:09.330 INFO:tasks.workunit.client.0.smithi012.stdout:1/986: symlink d5/d30/d51/l143 0 2023-10-21T17:24:09.368 INFO:tasks.workunit.client.0.smithi012.stdout:1/987: dwrite d5/d32/dce/df9/de7/f130 [0,4194304] 0 2023-10-21T17:24:09.372 INFO:tasks.workunit.client.0.smithi012.stdout:1/988: read d5/d30/f67 [1029437,47559] 0 2023-10-21T17:24:09.583 INFO:tasks.workunit.client.0.smithi012.stdout:7/944: rename d3/d6/dc/d19/d11d/d124 to d3/d6/dc/d19/d1e/d34/d137 0 2023-10-21T17:24:09.584 INFO:tasks.workunit.client.0.smithi012.stdout:8/859: creat d0/d1a/db0/db7/dd8/dda/f113 x:0 0 0 2023-10-21T17:24:09.584 INFO:tasks.workunit.client.0.smithi012.stdout:7/945: chown d3/d6/d73/d8e/d12e/f99 867119515 1 2023-10-21T17:24:09.584 INFO:tasks.workunit.client.0.smithi012.stdout:8/860: write d0/d29/d79/dfc/d103/f108 [239563,42075] 0 2023-10-21T17:24:09.682 INFO:tasks.workunit.client.0.smithi012.stdout:4/938: getdents dc/d1e/d33 0 2023-10-21T17:24:09.682 INFO:tasks.workunit.client.0.smithi012.stdout:4/939: fdatasync dc/d15/d18/fe9 0 2023-10-21T17:24:09.874 INFO:tasks.workunit.client.0.smithi012.stdout:9/927: mknod d0/d15/d103/c132 0 2023-10-21T17:24:09.875 INFO:tasks.workunit.client.0.smithi012.stdout:9/928: stat d0/df/d8d/dcb/d25/d39/d3b/l106 0 2023-10-21T17:24:10.126 INFO:tasks.workunit.client.0.smithi012.stdout:3/880: truncate d0/d32/f78 3435658 0 2023-10-21T17:24:10.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/881: dread d0/d10b/d97/fb7 [0,4194304] 0 2023-10-21T17:24:11.032 INFO:tasks.workunit.client.0.smithi012.stdout:6/901: sync 2023-10-21T17:24:11.123 INFO:tasks.workunit.client.0.smithi012.stdout:1/989: getdents d5/d32/d1b/d35/d49/d69 0 2023-10-21T17:24:11.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/990: dwrite d5/d32/d1b/d35/faa [0,4194304] 0 2023-10-21T17:24:11.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/991: write d5/d26/da3/fb6 [2468081,30656] 0 2023-10-21T17:24:11.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/992: readlink d5/d30/lff 0 2023-10-21T17:24:11.440 INFO:tasks.workunit.client.0.smithi012.stdout:7/946: mknod d3/d6/dc/d19/c138 0 2023-10-21T17:24:11.683 INFO:tasks.workunit.client.0.smithi012.stdout:8/861: unlink d0/d12/d6c/db1/fd2 0 2023-10-21T17:24:11.738 INFO:tasks.workunit.client.0.smithi012.stdout:4/940: symlink dc/d15/d2a/d137/l138 0 2023-10-21T17:24:11.761 INFO:tasks.workunit.client.0.smithi012.stdout:4/941: dread dc/d1e/dc7/dcc/d10f/d55/f90 [0,4194304] 0 2023-10-21T17:24:12.346 INFO:tasks.workunit.client.0.smithi012.stdout:5/952: write d2/d4f/d59/feb [203915,62870] 0 2023-10-21T17:24:12.384 INFO:tasks.workunit.client.0.smithi012.stdout:5/953: dread d2/d4f/d59/d5b/f41 [0,4194304] 0 2023-10-21T17:24:12.385 INFO:tasks.workunit.client.0.smithi012.stdout:5/954: creat d2/d1d/d4e/f12b x:0 0 0 2023-10-21T17:24:12.534 INFO:tasks.workunit.client.0.smithi012.stdout:8/862: creat d0/d62/d83/f114 x:0 0 0 2023-10-21T17:24:13.786 INFO:tasks.workunit.client.0.smithi012.stdout:8/863: truncate d0/d12/d51/f57 386907 0 2023-10-21T17:24:13.786 INFO:tasks.workunit.client.0.smithi012.stdout:8/864: fdatasync d0/f32 0 2023-10-21T17:24:13.939 INFO:tasks.workunit.client.0.smithi012.stdout:4/942: dwrite dc/d1e/dc7/dcc/d10f/d75/fcd [0,4194304] 0 2023-10-21T17:24:14.223 INFO:tasks.workunit.client.0.smithi012.stdout:8/865: link d0/d62/d83/c53 d0/d62/c115 0 2023-10-21T17:24:14.253 INFO:tasks.workunit.client.0.smithi012.stdout:8/866: dread d0/d29/d79/f97 [0,4194304] 0 2023-10-21T17:24:14.281 INFO:tasks.workunit.client.0.smithi012.stdout:8/867: write d0/d62/d83/d4e/fe4 [4176054,113624] 0 2023-10-21T17:24:14.282 INFO:tasks.workunit.client.0.smithi012.stdout:8/868: truncate d0/d1a/d54/f5f 4785866 0 2023-10-21T17:24:14.375 INFO:tasks.workunit.client.0.smithi012.stdout:8/869: dwrite d0/d62/d83/d4e/dc5/fe5 [0,4194304] 0 2023-10-21T17:24:14.646 INFO:tasks.workunit.client.0.smithi012.stdout:4/943: mknod dc/d15/d2a/d31/df3/c139 0 2023-10-21T17:24:14.647 INFO:tasks.workunit.client.0.smithi012.stdout:4/944: stat dc/d15/d18/cca 0 2023-10-21T17:24:14.847 INFO:tasks.workunit.client.0.smithi012.stdout:5/955: symlink d2/l12c 0 2023-10-21T17:24:15.289 INFO:tasks.workunit.client.0.smithi012.stdout:9/929: rename d0/d15/df4/f120 to d0/f133 0 2023-10-21T17:24:15.372 INFO:tasks.workunit.client.0.smithi012.stdout:5/956: rmdir d2/d4f 39 2023-10-21T17:24:15.373 INFO:tasks.workunit.client.0.smithi012.stdout:5/957: readlink d2/d1d/d4e/lbe 0 2023-10-21T17:24:15.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/870: link d0/d12/d6c/ddb/cf8 d0/d62/d83/d72/c116 0 2023-10-21T17:24:15.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/945: mknod dc/c13a 0 2023-10-21T17:24:15.817 INFO:tasks.workunit.client.0.smithi012.stdout:8/871: chown d0/d12/d80/l69 25989 1 2023-10-21T17:24:16.253 INFO:tasks.workunit.client.0.smithi012.stdout:8/872: unlink d0/d1a/l56 0 2023-10-21T17:24:16.253 INFO:tasks.workunit.client.0.smithi012.stdout:8/873: truncate d0/d62/f68 2218366 0 2023-10-21T17:24:16.316 INFO:tasks.workunit.client.0.smithi012.stdout:4/946: creat dc/d93/f13b x:0 0 0 2023-10-21T17:24:16.317 INFO:tasks.workunit.client.0.smithi012.stdout:4/947: write dc/d93/d99/ff2 [673832,111044] 0 2023-10-21T17:24:16.496 INFO:tasks.workunit.client.0.smithi012.stdout:9/930: getdents d0/df/d8d/dcb/d25/d100 0 2023-10-21T17:24:16.639 INFO:tasks.workunit.client.0.smithi012.stdout:3/882: rename d0/da/d28/c27 to d0/da/d28/df9/c10c 0 2023-10-21T17:24:17.613 INFO:tasks.workunit.client.0.smithi012.stdout:9/931: mknod d0/c134 0 2023-10-21T17:24:17.809 INFO:tasks.workunit.client.0.smithi012.stdout:6/902: rename d13/d29/d37/d3b/ld5 to d13/d64/d6d/l137 0 2023-10-21T17:24:17.810 INFO:tasks.workunit.client.0.smithi012.stdout:6/903: fdatasync d13/d29/d37/f44 0 2023-10-21T17:24:17.977 INFO:tasks.workunit.client.0.smithi012.stdout:3/883: write d0/da/f1f [1496130,78527] 0 2023-10-21T17:24:18.265 INFO:tasks.workunit.client.0.smithi012.stdout:9/932: symlink d0/df/d8d/dcb/d25/d39/l135 0 2023-10-21T17:24:18.266 INFO:tasks.workunit.client.0.smithi012.stdout:9/933: chown d0/df/d8d/dcb/d25/d2f/f62 720531 1 2023-10-21T17:24:18.275 INFO:tasks.workunit.client.0.smithi012.stdout:5/958: write d2/d2c/fa7 [1012197,77963] 0 2023-10-21T17:24:18.302 INFO:tasks.workunit.client.0.smithi012.stdout:9/934: dread d0/df/d8d/dcb/f48 [4194304,4194304] 0 2023-10-21T17:24:18.302 INFO:tasks.workunit.client.0.smithi012.stdout:9/935: dread - d0/df/d8d/dcb/d25/d39/f127 zero size 2023-10-21T17:24:18.310 INFO:tasks.workunit.client.0.smithi012.stdout:5/959: dread d2/d2c/fa7 [0,4194304] 0 2023-10-21T17:24:18.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/993: rename d5/d26/d64/d120/f129 to d5/d32/d1b/f144 0 2023-10-21T17:24:18.458 INFO:tasks.workunit.client.0.smithi012.stdout:7/947: rename d3/d29/d7f to d3/d29/d7f/d139 22 2023-10-21T17:24:18.794 INFO:tasks.workunit.client.0.smithi012.stdout:3/884: fsync d0/da/d28/fa6 0 2023-10-21T17:24:18.916 INFO:tasks.workunit.client.0.smithi012.stdout:3/885: dwrite d0/d82/d104/f105 [0,4194304] 0 2023-10-21T17:24:19.169 INFO:tasks.workunit.client.0.smithi012.stdout:5/960: creat d2/d2c/db6/d102/f12d x:0 0 0 2023-10-21T17:24:19.169 INFO:tasks.workunit.client.0.smithi012.stdout:7/948: readlink d3/d64/l11c 0 2023-10-21T17:24:19.170 INFO:tasks.workunit.client.0.smithi012.stdout:7/949: stat d3/d6/f6f 0 2023-10-21T17:24:19.314 INFO:tasks.workunit.client.0.smithi012.stdout:1/994: mkdir d5/d32/dce/de0/d145 0 2023-10-21T17:24:19.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/948: sync 2023-10-21T17:24:19.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/949: chown dc/d1e/dc7/dcc/d10f/d55/d6c/dbb/fcb 325237 1 2023-10-21T17:24:19.639 INFO:tasks.workunit.client.0.smithi012.stdout:4/950: write dc/d1e/dc7/dcc/d10f/d55/d6c/d83/fbd [1899645,90100] 0 2023-10-21T17:24:19.658 INFO:tasks.workunit.client.0.smithi012.stdout:9/936: write d0/d5/d9c/ffe [55157,19106] 0 2023-10-21T17:24:19.806 INFO:tasks.workunit.client.0.smithi012.stdout:5/961: creat d2/d1d/f12e x:0 0 0 2023-10-21T17:24:19.910 INFO:tasks.workunit.client.0.smithi012.stdout:7/950: getdents d3/d6/dc/d19/d1e/d9d/dec 0 2023-10-21T17:24:19.954 INFO:tasks.workunit.client.0.smithi012.stdout:7/951: dread d3/d6/d73/d8e/d12e/f99 [0,4194304] 0 2023-10-21T17:24:20.050 INFO:tasks.workunit.client.0.smithi012.stdout:7/952: dwrite d3/d29/f7c [0,4194304] 0 2023-10-21T17:24:20.072 INFO:tasks.workunit.client.0.smithi012.stdout:1/995: rmdir d5/d32/d1b/d35/d49/d69/df0 39 2023-10-21T17:24:20.075 INFO:tasks.workunit.client.0.smithi012.stdout:1/996: write d5/d32/dce/df9/fc7 [19604,100391] 0 2023-10-21T17:24:20.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/874: rename d0/d1a/db0 to d0/d29/d79/d117 0 2023-10-21T17:24:20.279 INFO:tasks.workunit.client.0.smithi012.stdout:8/875: fsync d0/fe 0 2023-10-21T17:24:20.307 INFO:tasks.workunit.client.0.smithi012.stdout:3/886: truncate d0/da/f34 2252696 0 2023-10-21T17:24:20.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/951: creat dc/d1e/d33/d7a/f13c x:0 0 0 2023-10-21T17:24:20.514 INFO:tasks.workunit.client.0.smithi012.stdout:9/937: link d0/df/d8d/dcb/d25/d39/d3b/cb3 d0/df/d8d/dcb/d25/d39/d3b/d67/c136 0 2023-10-21T17:24:20.539 INFO:tasks.workunit.client.0.smithi012.stdout:9/938: write d0/f6b [1964593,95271] 0 2023-10-21T17:24:20.708 INFO:tasks.workunit.client.0.smithi012.stdout:1/997: creat d5/d26/d64/d8f/f146 x:0 0 0 2023-10-21T17:24:20.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/998: write d5/f8d [2666666,105975] 0 2023-10-21T17:24:20.736 INFO:tasks.workunit.client.0.smithi012.stdout:1/999: getdents d5/d26/da3/d133 0 2023-10-21T17:24:20.747 INFO:tasks.workunit.client.0.smithi012.stdout:5/962: dread d2/d1d/f56 [0,4194304] 0 2023-10-21T17:24:20.832 INFO:tasks.workunit.client.0.smithi012.stdout:5/963: dwrite d2/d4f/d59/feb [0,4194304] 0 2023-10-21T17:24:20.833 INFO:tasks.workunit.client.0.smithi012.stdout:5/964: readlink d2/d4f/lfb 0 2023-10-21T17:24:20.836 INFO:tasks.workunit.client.0.smithi012.stdout:6/904: rename d13/d42/d89/l12e to d13/d15/d1d/d5d/d92/l138 0 2023-10-21T17:24:20.836 INFO:tasks.workunit.client.0.smithi012.stdout:6/905: chown d13/d15/d1d/d5d/d66/d70/d74/d98/l129 41948 1 2023-10-21T17:24:21.680 INFO:tasks.workunit.client.0.smithi012.stdout:4/952: symlink dc/d93/l13d 0 2023-10-21T17:24:21.763 INFO:tasks.workunit.client.0.smithi012.stdout:9/939: creat d0/df/d8d/dcb/f137 x:0 0 0 2023-10-21T17:24:21.942 INFO:tasks.workunit.client.0.smithi012.stdout:7/953: truncate d3/d6/dc/d19/d1e/f5c 4906771 0 2023-10-21T17:24:21.943 INFO:tasks.workunit.client.0.smithi012.stdout:7/954: write d3/d6/dc/d19/f113 [1490729,63693] 0 2023-10-21T17:24:21.943 INFO:tasks.workunit.client.0.smithi012.stdout:7/955: readlink d3/d6/d73/l10a 0 2023-10-21T17:24:22.546 INFO:tasks.workunit.client.0.smithi012.stdout:5/965: creat d2/d1d/d20/f12f x:0 0 0 2023-10-21T17:24:22.575 INFO:tasks.workunit.client.0.smithi012.stdout:5/966: read d2/d1d/d4e/fdf [834434,48194] 0 2023-10-21T17:24:22.955 INFO:tasks.workunit.client.0.smithi012.stdout:3/887: rename d0/d10b to d0/da/d28/d100/d10d 0 2023-10-21T17:24:22.986 INFO:tasks.workunit.client.0.smithi012.stdout:3/888: dread d0/da/d28/d100/d10d/d97/f9a [0,4194304] 0 2023-10-21T17:24:22.986 INFO:tasks.workunit.client.0.smithi012.stdout:3/889: write d0/da/d28/d100/d10d/d97/d9b/ffa [324721,63408] 0 2023-10-21T17:24:22.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/906: creat d13/d42/f139 x:0 0 0 2023-10-21T17:24:22.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/907: truncate d13/d15/d1d/d28/d5b/d75/f111 858565 0 2023-10-21T17:24:22.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/908: fsync d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9/f134 0 2023-10-21T17:24:23.187 INFO:tasks.workunit.client.0.smithi012.stdout:9/940: creat d0/d5/f138 x:0 0 0 2023-10-21T17:24:23.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/967: creat d2/d4f/d7e/d87/d93/f130 x:0 0 0 2023-10-21T17:24:23.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/968: chown d2/d2c/d8c/la1 3374377 1 2023-10-21T17:24:23.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/969: truncate d2/d2c/db6/fd5 1899214 0 2023-10-21T17:24:23.695 INFO:tasks.workunit.client.0.smithi012.stdout:5/970: write d2/d4f/d59/d5b/d15/ff7 [864380,76656] 0 2023-10-21T17:24:24.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/890: rmdir d0/d32/d43/d47/dd4 0 2023-10-21T17:24:24.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/891: stat d0/da/d28/f40 0 2023-10-21T17:24:24.114 INFO:tasks.workunit.client.0.smithi012.stdout:8/876: sync 2023-10-21T17:24:24.114 INFO:tasks.workunit.client.0.smithi012.stdout:8/877: chown d0/d62/d83/fed 139 1 2023-10-21T17:24:24.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/953: getdents dc/d15/d2a/d58 0 2023-10-21T17:24:24.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/954: write dc/d1e/dc7/dcc/d10f/fb3 [984710,17011] 0 2023-10-21T17:24:24.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/955: fdatasync dc/d15/d18/fe9 0 2023-10-21T17:24:24.141 INFO:tasks.workunit.client.0.smithi012.stdout:4/956: chown dc/d93/f46 3295366 1 2023-10-21T17:24:24.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/909: mkdir d13/d29/d77/d13a 0 2023-10-21T17:24:24.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/941: rename d0/df/d8d/dcb/d25/l34 to d0/d4/l139 0 2023-10-21T17:24:24.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/942: fdatasync d0/df/d8d/dcb/d25/d39/f86 0 2023-10-21T17:24:24.439 INFO:tasks.workunit.client.0.smithi012.stdout:5/971: creat d2/d2c/d73/f131 x:0 0 0 2023-10-21T17:24:24.440 INFO:tasks.workunit.client.0.smithi012.stdout:5/972: read d2/d1d/d4e/fdf [1550066,112868] 0 2023-10-21T17:24:24.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/892: symlink d0/da/d28/d100/l10e 0 2023-10-21T17:24:24.905 INFO:tasks.workunit.client.0.smithi012.stdout:6/910: truncate d13/d35/d4c/f9e 3601408 0 2023-10-21T17:24:25.002 INFO:tasks.workunit.client.0.smithi012.stdout:8/878: rename d0/d29/d79/d117/dec to d0/d29/d79/dfc/d118 0 2023-10-21T17:24:25.358 INFO:tasks.workunit.client.0.smithi012.stdout:9/943: rmdir d0/df/d8d/dcb/d25/d39/d3b/d11b 0 2023-10-21T17:24:25.358 INFO:tasks.workunit.client.0.smithi012.stdout:9/944: write d0/df/d8d/dcb/d25/d2f/f62 [1428557,16621] 0 2023-10-21T17:24:25.359 INFO:tasks.workunit.client.0.smithi012.stdout:9/945: creat d0/d4/d4b/d6a/ddd/f13a x:0 0 0 2023-10-21T17:24:25.668 INFO:tasks.workunit.client.0.smithi012.stdout:3/893: creat d0/d32/d43/d102/f10f x:0 0 0 2023-10-21T17:24:25.961 INFO:tasks.workunit.client.0.smithi012.stdout:8/879: symlink d0/d12/l119 0 2023-10-21T17:24:26.318 INFO:tasks.workunit.client.0.smithi012.stdout:6/911: rename d13/d29/d78/df7 to d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/d13b 0 2023-10-21T17:24:26.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/912: getdents d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/d10d 0 2023-10-21T17:24:26.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/946: truncate d0/fe4 210588 0 2023-10-21T17:24:26.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/947: stat d0/d5/f69 0 2023-10-21T17:24:26.669 INFO:tasks.workunit.client.0.smithi012.stdout:9/948: dread d0/df/d8d/dcb/d25/d39/f86 [4194304,4194304] 0 2023-10-21T17:24:26.739 INFO:tasks.workunit.client.0.smithi012.stdout:8/880: mkdir d0/d12/d40/d91/d11a 0 2023-10-21T17:24:26.739 INFO:tasks.workunit.client.0.smithi012.stdout:8/881: creat d0/d12/d6c/db1/f11b x:0 0 0 2023-10-21T17:24:26.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/882: dread d0/d1a/d54/f8b [0,4194304] 0 2023-10-21T17:24:26.764 INFO:tasks.workunit.client.0.smithi012.stdout:8/883: write d0/d1a/fbe [948098,98599] 0 2023-10-21T17:24:26.764 INFO:tasks.workunit.client.0.smithi012.stdout:8/884: chown d0/d12/f2b 0 1 2023-10-21T17:24:27.560 INFO:tasks.workunit.client.0.smithi012.stdout:7/956: sync 2023-10-21T17:24:27.560 INFO:tasks.workunit.client.0.smithi012.stdout:7/957: fdatasync d3/d6/fae 0 2023-10-21T17:24:27.561 INFO:tasks.workunit.client.0.smithi012.stdout:7/958: readlink d3/dd9/d9c/l12f 0 2023-10-21T17:24:27.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/949: mknod d0/d4/d4b/ded/c13b 0 2023-10-21T17:24:28.019 INFO:tasks.workunit.client.0.smithi012.stdout:8/885: unlink d0/d62/d83/d72/f96 0 2023-10-21T17:24:28.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/894: rename d0/da/l10 to d0/d32/l110 0 2023-10-21T17:24:28.601 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:57:54.584 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.695 INFO:tasks.workunit.client.0.smithi012.stdout:8/886: rmdir d0/d62/d83/d4e/dc5 39 2023-10-21T17:24:28.716 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:57:54.698 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.759 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:57:54.843 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.760 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:57:54.844 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.762 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:57:54.846 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.763 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:57:54.847 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.826 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:57:54.910 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.827 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:57:54.912 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.867 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:57:54.849 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:28.878 INFO:tasks.workunit.client.0.smithi012.stdout:3/895: symlink d0/d32/dd0/l111 0 2023-10-21T17:24:28.925 INFO:tasks.workunit.client.0.smithi012.stdout:4/957: write dc/d1e/dc7/dcc/d10f/d55/d6c/d77/f8f [364051,91229] 0 2023-10-21T17:24:28.925 INFO:tasks.workunit.client.0.smithi012.stdout:4/958: write dc/d15/f133 [802695,39871] 0 2023-10-21T17:24:29.624 INFO:tasks.workunit.client.0.smithi012.stdout:8/887: mknod d0/d12/d6c/ddb/c11c 0 2023-10-21T17:24:29.624 INFO:tasks.workunit.client.0.smithi012.stdout:8/888: read - d0/d62/d7d/fdf zero size 2023-10-21T17:24:29.815 INFO:tasks.workunit.client.0.smithi012.stdout:3/896: mkdir d0/d82/d104/d112 0 2023-10-21T17:24:29.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/959: getdents dc/d1e/dc7/dcc/d10f/d55/d6c/d77 0 2023-10-21T17:24:29.932 INFO:tasks.workunit.client.0.smithi012.stdout:4/960: write dc/d15/d2a/f78 [1561372,30504] 0 2023-10-21T17:24:30.091 INFO:tasks.workunit.client.0.smithi012.stdout:5/973: write d2/d4f/d59/d5b/f77 [1794075,57885] 0 2023-10-21T17:24:30.205 INFO:tasks.workunit.client.0.smithi012.stdout:8/889: rename d0/d62/d83/d4e/dc5/fe5 to d0/d1a/d54/f11d 0 2023-10-21T17:24:30.216 INFO:tasks.workunit.client.0.smithi012.stdout:8/890: read d0/d29/d79/d117/db7/dd8/dda/fc4 [933419,56484] 0 2023-10-21T17:24:30.604 INFO:tasks.workunit.client.0.smithi012.stdout:4/961: symlink dc/d15/d2a/dce/d128/l13e 0 2023-10-21T17:24:30.753 INFO:tasks.workunit.client.0.smithi012.stdout:5/974: mknod d2/d2c/c132 0 2023-10-21T17:24:31.004 INFO:tasks.workunit.client.0.smithi012.stdout:8/891: creat d0/d29/d79/d117/db7/dd8/f11e x:0 0 0 2023-10-21T17:24:31.278 INFO:tasks.workunit.client.0.smithi012.stdout:4/962: rename dc/d1e/d65/l8e to dc/d93/d99/d104/l13f 0 2023-10-21T17:24:31.369 INFO:tasks.workunit.client.0.smithi012.stdout:8/892: mknod d0/d29/d79/d117/c11f 0 2023-10-21T17:24:31.762 INFO:tasks.workunit.client.0.smithi012.stdout:4/963: creat dc/d15/d18/d57/d134/f140 x:0 0 0 2023-10-21T17:24:32.266 INFO:tasks.workunit.client.0.smithi012.stdout:4/964: symlink dc/d1e/dc7/dcc/d10f/d55/d6c/d83/l141 0 2023-10-21T17:24:32.385 INFO:tasks.workunit.client.0.smithi012.stdout:9/950: dwrite d0/d5/f7e [0,4194304] 0 2023-10-21T17:24:32.385 INFO:tasks.workunit.client.0.smithi012.stdout:9/951: stat d0/d5/d9c/dc7/l123 0 2023-10-21T17:24:32.393 INFO:tasks.workunit.client.0.smithi012.stdout:7/959: dwrite d3/d6/dc/d19/d1e/f5c [0,4194304] 0 2023-10-21T17:24:32.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/952: dwrite d0/d15/f23 [0,4194304] 0 2023-10-21T17:24:32.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/965: mkdir dc/d1e/d33/d8a/d142 0 2023-10-21T17:24:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:9/953: creat d0/df/f13c x:0 0 0 2023-10-21T17:24:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:9/954: fdatasync d0/df/d8d/dcb/d25/d39/f113 0 2023-10-21T17:24:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:9/955: readlink d0/df/d8d/dcb/d25/d39/d3b/d67/lec 0 2023-10-21T17:24:33.256 INFO:tasks.workunit.client.0.smithi012.stdout:4/966: mknod dc/d1e/d33/d8a/ddb/dfc/c143 0 2023-10-21T17:24:33.257 INFO:tasks.workunit.client.0.smithi012.stdout:4/967: readlink dc/d1e/d65/la4 0 2023-10-21T17:24:33.257 INFO:tasks.workunit.client.0.smithi012.stdout:4/968: readlink dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/lda 0 2023-10-21T17:24:33.615 INFO:tasks.workunit.client.0.smithi012.stdout:9/956: unlink d0/df/d8d/dcb/d25/dc9/fda 0 2023-10-21T17:24:34.028 INFO:tasks.workunit.client.0.smithi012.stdout:4/969: dread dc/d93/f5a [0,4194304] 0 2023-10-21T17:24:34.051 INFO:tasks.workunit.client.0.smithi012.stdout:3/897: dwrite d0/d9d/fc6 [0,4194304] 0 2023-10-21T17:24:34.092 INFO:tasks.workunit.client.0.smithi012.stdout:3/898: dwrite d0/d1c/f1e [0,4194304] 0 2023-10-21T17:24:34.388 INFO:tasks.workunit.client.0.smithi012.stdout:9/957: mknod d0/df/d8d/dcb/d2a/c13d 0 2023-10-21T17:24:34.388 INFO:tasks.workunit.client.0.smithi012.stdout:9/958: creat d0/df/d8d/dcb/d25/d2f/de5/f13e x:0 0 0 2023-10-21T17:24:34.421 INFO:tasks.workunit.client.0.smithi012.stdout:9/959: write d0/d4/d4b/fde [3158319,85482] 0 2023-10-21T17:24:34.421 INFO:tasks.workunit.client.0.smithi012.stdout:9/960: truncate d0/df/d8d/dcb/d25/d39/f125 68643 0 2023-10-21T17:24:34.875 INFO:tasks.workunit.client.0.smithi012.stdout:4/970: unlink dc/d1e/d33/c88 0 2023-10-21T17:24:35.506 INFO:tasks.workunit.client.0.smithi012.stdout:6/913: mknod d13/d29/c13c 0 2023-10-21T17:24:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:7/960: dwrite d3/f83 [0,4194304] 0 2023-10-21T17:24:36.417 INFO:tasks.workunit.client.0.smithi012.stdout:9/961: mkdir d0/d4/d4b/d13f 0 2023-10-21T17:24:36.462 INFO:tasks.workunit.client.0.smithi012.stdout:9/962: dread d0/df/d8d/dcb/d25/d39/d3b/fce [0,4194304] 0 2023-10-21T17:24:36.561 INFO:tasks.workunit.client.0.smithi012.stdout:9/963: dwrite d0/d5/d9c/f12b [4194304,4194304] 0 2023-10-21T17:24:36.580 INFO:tasks.workunit.client.0.smithi012.stdout:9/964: read d0/d15/f88 [665797,62550] 0 2023-10-21T17:24:36.607 INFO:tasks.workunit.client.0.smithi012.stdout:6/914: unlink d13/d42/d89/db8/d9f/ldb 0 2023-10-21T17:24:36.730 INFO:tasks.workunit.client.0.smithi012.stdout:7/961: symlink d3/d6/d73/d8e/d111/l13a 0 2023-10-21T17:24:37.198 INFO:tasks.workunit.client.0.smithi012.stdout:9/965: creat d0/d4/d4b/d6a/d89/f140 x:0 0 0 2023-10-21T17:24:37.472 INFO:tasks.workunit.client.0.smithi012.stdout:6/915: getdents d13/d15/d1d/d28/d5b/dee 0 2023-10-21T17:24:37.473 INFO:tasks.workunit.client.0.smithi012.stdout:5/975: rename d2/l12c to d2/d2c/db6/l133 0 2023-10-21T17:24:37.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/916: dwrite d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/fc2 [4194304,4194304] 0 2023-10-21T17:24:37.654 INFO:tasks.workunit.client.0.smithi012.stdout:7/962: read d3/d6/dc/f36 [142137,66623] 0 2023-10-21T17:24:37.654 INFO:tasks.workunit.client.0.smithi012.stdout:7/963: write d3/d6/dc/d19/d1e/d34/da8/f115 [914377,28511] 0 2023-10-21T17:24:37.690 INFO:tasks.workunit.client.0.smithi012.stdout:7/964: write d3/d6/dc/f11f [4126545,111320] 0 2023-10-21T17:24:37.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/965: chown d3/d6/dc/d19/d1e/d34/l58 64 1 2023-10-21T17:24:37.917 INFO:tasks.workunit.client.0.smithi012.stdout:9/966: truncate d0/df/d8d/dcb/d2a/f7f 945613 0 2023-10-21T17:24:38.170 INFO:tasks.workunit.client.0.smithi012.stdout:5/976: mknod d2/d2c/d73/d49/da9/d100/c134 0 2023-10-21T17:24:38.275 INFO:tasks.workunit.client.0.smithi012.stdout:8/893: rename d0/lc0 to d0/d29/d79/dfc/d103/l120 0 2023-10-21T17:24:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/917: creat d13/d15/d1d/d28/f13d x:0 0 0 2023-10-21T17:24:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/918: readlink d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/le5 0 2023-10-21T17:24:38.435 INFO:tasks.workunit.client.0.smithi012.stdout:6/919: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f13e x:0 0 0 2023-10-21T17:24:38.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/966: mknod d3/d6/dc/d19/d1e/d34/da8/db4/c13b 0 2023-10-21T17:24:38.878 INFO:tasks.workunit.client.0.smithi012.stdout:9/967: link d0/d5/d9d/fb5 d0/f141 0 2023-10-21T17:24:38.929 INFO:tasks.workunit.client.0.smithi012.stdout:7/967: dread d3/d6/dc/d19/d1e/dc9/feb [0,4194304] 0 2023-10-21T17:24:39.197 INFO:tasks.workunit.client.0.smithi012.stdout:5/977: link d2/d4f/d7e/d87/d57/d66/f116 d2/d4f/d59/d5b/f135 0 2023-10-21T17:24:39.198 INFO:tasks.workunit.client.0.smithi012.stdout:5/978: chown d2/d4f/d59/d5b/d1e 24960189 1 2023-10-21T17:24:39.198 INFO:tasks.workunit.client.0.smithi012.stdout:5/979: fsync d2/d4f/d59/d5b/f41 0 2023-10-21T17:24:39.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/894: mkdir d0/d62/d83/d111/d121 0 2023-10-21T17:24:39.227 INFO:tasks.workunit.client.0.smithi012.stdout:5/980: write d2/d1d/f8e [3268129,99523] 0 2023-10-21T17:24:39.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:24:39.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:24:40.042 INFO:tasks.workunit.client.0.smithi012.stdout:9/968: link d0/ld7 d0/d4/d4b/ded/d116/l142 0 2023-10-21T17:24:40.110 INFO:tasks.workunit.client.0.smithi012.stdout:7/968: truncate d3/d16/f56 5217473 0 2023-10-21T17:24:40.111 INFO:tasks.workunit.client.0.smithi012.stdout:7/969: dread - d3/d6/dc/d19/d1e/d9d/dda/f117 zero size 2023-10-21T17:24:40.111 INFO:tasks.workunit.client.0.smithi012.stdout:7/970: truncate d3/d6/dc/d19/d1e/d9d/dda/f100 617043 0 2023-10-21T17:24:40.123 INFO:tasks.workunit.client.0.smithi012.stdout:7/971: dread d3/d6/dc/d19/d1e/d9d/dec/fa9 [0,4194304] 0 2023-10-21T17:24:40.332 INFO:tasks.workunit.client.0.smithi012.stdout:8/895: mknod d0/d62/d83/d4e/def/c122 0 2023-10-21T17:24:40.700 INFO:tasks.workunit.client.0.smithi012.stdout:5/981: unlink d2/d4f/d7e/d87/d93/dc3/l128 0 2023-10-21T17:24:40.900 INFO:tasks.workunit.client.0.smithi012.stdout:7/972: unlink d3/dd9/d9c/c104 0 2023-10-21T17:24:40.900 INFO:tasks.workunit.client.0.smithi012.stdout:7/973: chown d3/d6/fae 339431098 1 2023-10-21T17:24:41.233 INFO:tasks.workunit.client.0.smithi012.stdout:8/896: mkdir d0/d12/d6c/dd4/d123 0 2023-10-21T17:24:41.233 INFO:tasks.workunit.client.0.smithi012.stdout:3/899: write d0/da/d28/ff7 [212137,31345] 0 2023-10-21T17:24:41.284 INFO:tasks.workunit.client.0.smithi012.stdout:5/982: truncate d2/d2c/d8c/dff/f10b 3535439 0 2023-10-21T17:24:41.299 INFO:tasks.workunit.client.0.smithi012.stdout:3/900: dwrite d0/d1c/fe9 [0,4194304] 0 2023-10-21T17:24:41.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/983: dread d2/d4f/d7e/d87/d57/dc7/dd0/f7 [0,4194304] 0 2023-10-21T17:24:41.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/984: fdatasync d2/d4f/d7e/d87/dce/f103 0 2023-10-21T17:24:41.551 INFO:tasks.workunit.client.0.smithi012.stdout:7/974: dread d3/da7/de0/fe9 [0,4194304] 0 2023-10-21T17:24:41.712 INFO:tasks.workunit.client.0.smithi012.stdout:8/897: mknod d0/d12/d40/d91/d11a/c124 0 2023-10-21T17:24:42.148 INFO:tasks.workunit.client.0.smithi012.stdout:3/901: rename d0/d1c/c93 to d0/d9d/c113 0 2023-10-21T17:24:42.148 INFO:tasks.workunit.client.0.smithi012.stdout:3/902: chown d0/da/d28/d100/d10d/ff3 21017516 1 2023-10-21T17:24:42.148 INFO:tasks.workunit.client.0.smithi012.stdout:3/903: stat d0/d32/d43/d47/d50/l69 0 2023-10-21T17:24:42.149 INFO:tasks.workunit.client.0.smithi012.stdout:3/904: chown d0/da/ff8 80 1 2023-10-21T17:24:42.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/985: link d2/d1d/ld4 d2/d4f/d7e/d87/d57/dc7/l136 0 2023-10-21T17:24:42.527 INFO:tasks.workunit.client.0.smithi012.stdout:4/971: sync 2023-10-21T17:24:42.527 INFO:tasks.workunit.client.0.smithi012.stdout:7/975: unlink d3/d6/dc/d19/d43/f61 0 2023-10-21T17:24:42.527 INFO:tasks.workunit.client.0.smithi012.stdout:8/898: mknod d0/d1a/c125 0 2023-10-21T17:24:42.527 INFO:tasks.workunit.client.0.smithi012.stdout:8/899: fsync d0/d12/d6c/fb8 0 2023-10-21T17:24:43.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/976: read d3/d6/dc/f54 [59650,64663] 0 2023-10-21T17:24:43.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/977: fsync d3/d6/dc/f54 0 2023-10-21T17:24:43.194 INFO:tasks.workunit.client.0.smithi012.stdout:7/978: dwrite d3/d6/dc/d19/d1e/d9d/dec/fb6 [0,4194304] 0 2023-10-21T17:24:43.215 INFO:tasks.workunit.client.0.smithi012.stdout:7/979: dread d3/da7/daf/dcd/fe4 [0,4194304] 0 2023-10-21T17:24:43.243 INFO:tasks.workunit.client.0.smithi012.stdout:7/980: dread d3/d6/dc/d19/f57 [4194304,4194304] 0 2023-10-21T17:24:43.243 INFO:tasks.workunit.client.0.smithi012.stdout:7/981: truncate d3/d6/dc/d19/d1e/d9d/dda/ff4 680203 0 2023-10-21T17:24:43.257 INFO:tasks.workunit.client.0.smithi012.stdout:4/972: truncate dc/d6b/fb5 4036915 0 2023-10-21T17:24:43.257 INFO:tasks.workunit.client.0.smithi012.stdout:4/973: fsync dc/d6b/fe7 0 2023-10-21T17:24:43.869 INFO:tasks.workunit.client.0.smithi012.stdout:7/982: link d3/d6/d73/d8e/c132 d3/d6/dc/c13c 0 2023-10-21T17:24:44.106 INFO:tasks.workunit.client.0.smithi012.stdout:8/900: rename d0/d62/d83/d4e/cfb to d0/d46/c126 0 2023-10-21T17:24:44.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/983: creat d3/d29/f13d x:0 0 0 2023-10-21T17:24:44.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/901: unlink d0/d62/d83/d4e/def/c122 0 2023-10-21T17:24:44.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/902: fsync d0/f90 0 2023-10-21T17:24:44.696 INFO:tasks.workunit.client.0.smithi012.stdout:4/974: rename dc/d1e/d33/d7a/l119 to dc/d1e/d33/d8a/ddb/dfc/l144 0 2023-10-21T17:24:45.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/903: getdents d0/d62/d83/d111 0 2023-10-21T17:24:45.302 INFO:tasks.workunit.client.0.smithi012.stdout:4/975: symlink dc/d93/l145 0 2023-10-21T17:24:45.378 INFO:tasks.workunit.client.0.smithi012.stdout:6/920: sync 2023-10-21T17:24:45.739 INFO:tasks.workunit.client.0.smithi012.stdout:4/976: creat dc/d15/d2a/d58/f146 x:0 0 0 2023-10-21T17:24:45.961 INFO:tasks.workunit.client.0.smithi012.stdout:7/984: rename d3/d6/d73/d8e/d12e/dd4/d133/d109/f112 to d3/d6/dc/d19/d43/f13e 0 2023-10-21T17:24:46.157 INFO:tasks.workunit.client.0.smithi012.stdout:6/921: rmdir d13/d29/d37/dfc 0 2023-10-21T17:24:46.192 INFO:tasks.workunit.client.0.smithi012.stdout:9/969: sync 2023-10-21T17:24:46.322 INFO:tasks.workunit.client.0.smithi012.stdout:8/904: link d0/fb d0/d62/d83/d72/f127 0 2023-10-21T17:24:46.322 INFO:tasks.workunit.client.0.smithi012.stdout:8/905: readlink d0/d62/d83/l89 0 2023-10-21T17:24:46.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/906: fsync d0/d62/d83/f114 0 2023-10-21T17:24:46.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/907: stat d0/d29/c52 0 2023-10-21T17:24:46.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/908: readlink d0/d12/d80/l69 0 2023-10-21T17:24:47.062 INFO:tasks.workunit.client.0.smithi012.stdout:6/922: symlink d13/d15/d1d/d5d/d66/d70/d74/l13f 0 2023-10-21T17:24:47.303 INFO:tasks.workunit.client.0.smithi012.stdout:4/977: rename dc/d93/d99/lc2 to dc/d1e/d2b/l147 0 2023-10-21T17:24:47.529 INFO:tasks.workunit.client.0.smithi012.stdout:9/970: link d0/df/d44/c7a d0/df/d8d/dcb/d25/dc9/c143 0 2023-10-21T17:24:47.530 INFO:tasks.workunit.client.0.smithi012.stdout:9/971: fdatasync d0/d4/d4b/fbf 0 2023-10-21T17:24:48.365 INFO:tasks.workunit.client.0.smithi012.stdout:3/905: write d0/da/f34 [1816502,43802] 0 2023-10-21T17:24:48.573 INFO:tasks.workunit.client.0.smithi012.stdout:3/906: creat d0/da/d28/d100/d10d/d97/f114 x:0 0 0 2023-10-21T17:24:48.574 INFO:tasks.workunit.client.0.smithi012.stdout:5/986: sync 2023-10-21T17:24:48.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/987: write d2/d2c/fa7 [618529,31557] 0 2023-10-21T17:24:48.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/988: fdatasync d2/d4f/d7e/d87/f39 0 2023-10-21T17:24:48.905 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:58:14.888 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.918 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:58:15.003 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.920 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:58:15.005 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.924 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:58:14.907 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.925 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:58:15.009 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.927 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:58:15.011 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.941 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:58:15.026 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.950 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:58:15.035 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:48.987 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:58:14.969 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:24:50.436 INFO:tasks.workunit.client.0.smithi012.stdout:7/985: sync 2023-10-21T17:24:50.477 INFO:tasks.workunit.client.0.smithi012.stdout:8/909: rename d0/f36 to d0/d62/d83/d111/d121/f128 0 2023-10-21T17:24:50.526 INFO:tasks.workunit.client.0.smithi012.stdout:7/986: dwrite d3/d29/f7c [0,4194304] 0 2023-10-21T17:24:50.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/907: dwrite d0/d32/f6e [0,4194304] 0 2023-10-21T17:24:50.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/908: chown d0/d32/d43/f59 0 1 2023-10-21T17:24:50.735 INFO:tasks.workunit.client.0.smithi012.stdout:3/909: dwrite d0/d32/d43/d47/d50/dcc/ffd [0,4194304] 0 2023-10-21T17:24:50.735 INFO:tasks.workunit.client.0.smithi012.stdout:3/910: truncate d0/d82/fab 509511 0 2023-10-21T17:24:50.742 INFO:tasks.workunit.client.0.smithi012.stdout:8/910: creat d0/d62/d83/d111/d121/f129 x:0 0 0 2023-10-21T17:24:50.808 INFO:tasks.workunit.client.0.smithi012.stdout:8/911: dwrite d0/d62/f76 [0,4194304] 0 2023-10-21T17:24:50.951 INFO:tasks.workunit.client.0.smithi012.stdout:7/987: dwrite d3/d6/dc/d19/f57 [0,4194304] 0 2023-10-21T17:24:51.365 INFO:tasks.workunit.client.0.smithi012.stdout:3/911: mknod d0/da/d28/d100/d10d/d97/c115 0 2023-10-21T17:24:51.365 INFO:tasks.workunit.client.0.smithi012.stdout:3/912: fsync d0/d32/d43/f79 0 2023-10-21T17:24:51.569 INFO:tasks.workunit.client.0.smithi012.stdout:6/923: rename d13/d15/d1d/d5d/df8/c107 to d13/d15/d1d/d28/d5b/d75/c140 0 2023-10-21T17:24:51.569 INFO:tasks.workunit.client.0.smithi012.stdout:6/924: write d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f13e [697294,3772] 0 2023-10-21T17:24:51.570 INFO:tasks.workunit.client.0.smithi012.stdout:6/925: fsync d13/d29/d37/f10f 0 2023-10-21T17:24:51.570 INFO:tasks.workunit.client.0.smithi012.stdout:6/926: fdatasync d13/d29/d78/fb3 0 2023-10-21T17:24:52.274 INFO:tasks.workunit.client.0.smithi012.stdout:8/912: creat d0/d29/d79/d117/dca/f12a x:0 0 0 2023-10-21T17:24:52.275 INFO:tasks.workunit.client.0.smithi012.stdout:7/988: creat d3/d6/d6a/def/f13f x:0 0 0 2023-10-21T17:24:52.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/913: dread d0/d12/f94 [0,4194304] 0 2023-10-21T17:24:52.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/914: write d0/d12/d6c/db1/fba [8831003,16870] 0 2023-10-21T17:24:52.292 INFO:tasks.workunit.client.0.smithi012.stdout:8/915: dread - d0/d29/d79/d117/f10d zero size 2023-10-21T17:24:52.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/916: dread d0/d29/d79/d117/dca/fd5 [0,4194304] 0 2023-10-21T17:24:52.352 INFO:tasks.workunit.client.0.smithi012.stdout:8/917: dread d0/d62/d83/d4e/fe4 [0,4194304] 0 2023-10-21T17:24:52.458 INFO:tasks.workunit.client.0.smithi012.stdout:9/972: rename d0/d5/c17 to d0/d5/d9c/d12c/c144 0 2023-10-21T17:24:52.458 INFO:tasks.workunit.client.0.smithi012.stdout:9/973: readlink d0/d4/d4b/ded/lf9 0 2023-10-21T17:24:52.458 INFO:tasks.workunit.client.0.smithi012.stdout:9/974: dread - d0/df/d8d/dcb/d25/d39/f127 zero size 2023-10-21T17:24:52.458 INFO:tasks.workunit.client.0.smithi012.stdout:4/978: sync 2023-10-21T17:24:52.524 INFO:tasks.workunit.client.0.smithi012.stdout:9/975: dwrite d0/d15/f88 [0,4194304] 0 2023-10-21T17:24:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:7/989: dread d3/d6/dc/d19/f72 [0,4194304] 0 2023-10-21T17:24:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:7/990: write d3/d16/f32 [1225914,34270] 0 2023-10-21T17:24:52.815 INFO:tasks.workunit.client.0.smithi012.stdout:8/918: creat d0/d62/d83/d72/f12b x:0 0 0 2023-10-21T17:24:52.881 INFO:tasks.workunit.client.0.smithi012.stdout:8/919: dwrite d0/d62/d83/d72/f12b [0,4194304] 0 2023-10-21T17:24:52.963 INFO:tasks.workunit.client.0.smithi012.stdout:8/920: dwrite d0/d29/d79/d117/dea/fe2 [0,4194304] 0 2023-10-21T17:24:53.169 INFO:tasks.workunit.client.0.smithi012.stdout:5/989: rename d2/d4f/d7e/d87/l52 to d2/d4f/d7e/d87/d93/l137 0 2023-10-21T17:24:53.170 INFO:tasks.workunit.client.0.smithi012.stdout:5/990: dread - d2/d4f/d7e/d87/d93/f130 zero size 2023-10-21T17:24:53.170 INFO:tasks.workunit.client.0.smithi012.stdout:5/991: dread - d2/d2c/db6/d102/f12d zero size 2023-10-21T17:24:53.243 INFO:tasks.workunit.client.0.smithi012.stdout:5/992: dwrite d2/d4f/d7e/d87/d57/dc7/dd0/de3/fe4 [0,4194304] 0 2023-10-21T17:24:53.622 INFO:tasks.workunit.client.0.smithi012.stdout:3/913: symlink d0/l116 0 2023-10-21T17:24:53.623 INFO:tasks.workunit.client.0.smithi012.stdout:4/979: link dc/d15/d18/fc6 dc/d15/d2a/dce/d128/f148 0 2023-10-21T17:24:54.037 INFO:tasks.workunit.client.0.smithi012.stdout:6/927: symlink d13/d42/d89/db8/l141 0 2023-10-21T17:24:54.718 INFO:tasks.workunit.client.0.smithi012.stdout:9/976: rename d0/df/d8d/dcb/d25/d39/f127 to d0/d4/d4b/d6a/d89/de2/d101/f145 0 2023-10-21T17:24:55.033 INFO:tasks.workunit.client.0.smithi012.stdout:5/993: creat d2/d4f/f138 x:0 0 0 2023-10-21T17:24:56.360 INFO:tasks.workunit.client.0.smithi012.stdout:4/980: symlink dc/d93/d99/l149 0 2023-10-21T17:24:56.360 INFO:tasks.workunit.client.0.smithi012.stdout:4/981: fdatasync dc/d93/f46 0 2023-10-21T17:24:56.365 INFO:tasks.workunit.client.0.smithi012.stdout:6/928: symlink d13/d15/d1d/d5d/d66/d70/l142 0 2023-10-21T17:24:56.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/982: dread dc/d1e/d65/f66 [0,4194304] 0 2023-10-21T17:24:56.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/983: fsync dc/d15/d2a/d31/ffd 0 2023-10-21T17:24:56.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/984: stat dc/d15/d18/cca 0 2023-10-21T17:24:56.393 INFO:tasks.workunit.client.0.smithi012.stdout:6/929: write d13/d15/d1d/f20 [3744331,17118] 0 2023-10-21T17:24:56.394 INFO:tasks.workunit.client.0.smithi012.stdout:6/930: fsync d13/d42/d89/db8/f8e 0 2023-10-21T17:24:56.496 INFO:tasks.workunit.client.0.smithi012.stdout:7/991: creat d3/d6/dc/d19/d1e/d34/da8/db4/dc3/f140 x:0 0 0 2023-10-21T17:24:56.870 INFO:tasks.workunit.client.0.smithi012.stdout:8/921: rename d0/d29/d79/d117/db7/dd8/f11e to d0/d12/d6c/ddb/f12c 0 2023-10-21T17:24:56.870 INFO:tasks.workunit.client.0.smithi012.stdout:8/922: readlink d0/d62/d83/d4e/ldd 0 2023-10-21T17:24:56.935 INFO:tasks.workunit.client.0.smithi012.stdout:9/977: mknod d0/d15/d103/c146 0 2023-10-21T17:24:56.962 INFO:tasks.workunit.client.0.smithi012.stdout:8/923: dwrite d0/d1a/fbe [0,4194304] 0 2023-10-21T17:24:56.962 INFO:tasks.workunit.client.0.smithi012.stdout:8/924: dread - d0/d12/d40/f10e zero size 2023-10-21T17:24:56.963 INFO:tasks.workunit.client.0.smithi012.stdout:8/925: write d0/d12/d80/f10b [271894,110302] 0 2023-10-21T17:24:57.400 INFO:tasks.workunit.client.0.smithi012.stdout:3/914: mkdir d0/da/d28/d117 0 2023-10-21T17:24:57.474 INFO:tasks.workunit.client.0.smithi012.stdout:3/915: dwrite d0/d32/d43/d47/f48 [0,4194304] 0 2023-10-21T17:24:57.839 INFO:tasks.workunit.client.0.smithi012.stdout:7/992: symlink d3/d64/l141 0 2023-10-21T17:24:58.290 INFO:tasks.workunit.client.0.smithi012.stdout:4/985: rename dc/d1e/d2b/f5c to dc/d1e/dc7/dcc/d10f/d55/d6c/d77/f14a 0 2023-10-21T17:24:58.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/986: chown dc/d1e/d33/d8a/lea 153831 1 2023-10-21T17:24:58.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/987: chown dc/d15/d2a/dce/d128/f148 74 1 2023-10-21T17:24:58.314 INFO:tasks.workunit.client.0.smithi012.stdout:9/978: mkdir d0/d5/d9c/d12c/d147 0 2023-10-21T17:24:58.334 INFO:tasks.workunit.client.0.smithi012.stdout:9/979: dread d0/df/d8d/dcb/d25/d2f/d8c/f9a [0,4194304] 0 2023-10-21T17:24:58.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/926: mknod d0/d62/d7d/dcf/d10c/c12d 0 2023-10-21T17:24:59.075 INFO:tasks.workunit.client.0.smithi012.stdout:3/916: getdents d0/d32/d43/d47/d50/dcc 0 2023-10-21T17:24:59.076 INFO:tasks.workunit.client.0.smithi012.stdout:6/931: truncate d13/d15/f61 4447935 0 2023-10-21T17:24:59.076 INFO:tasks.workunit.client.0.smithi012.stdout:3/917: fsync d0/d32/fa8 0 2023-10-21T17:24:59.076 INFO:tasks.workunit.client.0.smithi012.stdout:6/932: fdatasync d13/d15/d1d/d5d/d66/f79 0 2023-10-21T17:24:59.095 INFO:tasks.workunit.client.0.smithi012.stdout:6/933: dread d13/d15/d1d/d5d/d66/d70/d74/dc9/f117 [0,4194304] 0 2023-10-21T17:24:59.336 INFO:tasks.workunit.client.0.smithi012.stdout:4/988: read dc/d15/f47 [285358,41509] 0 2023-10-21T17:24:59.404 INFO:tasks.workunit.client.0.smithi012.stdout:9/980: symlink d0/d5/df3/l148 0 2023-10-21T17:24:59.548 INFO:tasks.workunit.client.0.smithi012.stdout:8/927: mknod d0/d62/d7d/dcf/d10c/c12e 0 2023-10-21T17:24:59.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/928: dread d0/d29/d79/d117/db7/dd8/dda/fc4 [0,4194304] 0 2023-10-21T17:25:00.707 INFO:tasks.workunit.client.0.smithi012.stdout:3/918: unlink d0/d9d/fce 0 2023-10-21T17:25:00.835 INFO:tasks.workunit.client.0.smithi012.stdout:6/934: mknod d13/d29/d77/d13a/c143 0 2023-10-21T17:25:00.836 INFO:tasks.workunit.client.0.smithi012.stdout:6/935: chown d13/d15/l85 11 1 2023-10-21T17:25:00.853 INFO:tasks.workunit.client.0.smithi012.stdout:6/936: dread d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f13e [0,4194304] 0 2023-10-21T17:25:01.127 INFO:tasks.workunit.client.0.smithi012.stdout:4/989: rename dc/d1e/d33/d8a/lea to dc/d15/d2a/d58/l14b 0 2023-10-21T17:25:01.127 INFO:tasks.workunit.client.0.smithi012.stdout:4/990: chown dc/d28/d10c 724184681 1 2023-10-21T17:25:01.299 INFO:tasks.workunit.client.0.smithi012.stdout:9/981: unlink d0/d4/d4b/d6a/d89/ld1 0 2023-10-21T17:25:01.299 INFO:tasks.workunit.client.0.smithi012.stdout:9/982: write d0/d4/d4b/ded/d116/f12a [636265,61217] 0 2023-10-21T17:25:01.353 INFO:tasks.workunit.client.0.smithi012.stdout:3/919: mkdir d0/da/d28/df9/d118 0 2023-10-21T17:25:01.389 INFO:tasks.workunit.client.0.smithi012.stdout:3/920: write d0/d32/d43/d47/d50/dcc/ffd [4173621,129488] 0 2023-10-21T17:25:02.014 INFO:tasks.workunit.client.0.smithi012.stdout:4/991: symlink dc/d1e/dc7/dcc/d10f/d55/d6c/d9e/l14c 0 2023-10-21T17:25:02.179 INFO:tasks.workunit.client.0.smithi012.stdout:5/994: dwrite d2/d4f/d7e/d87/d57/f9b [0,4194304] 0 2023-10-21T17:25:02.214 INFO:tasks.workunit.client.0.smithi012.stdout:7/993: dwrite d3/d6/dc/d19/d1e/d34/da8/db4/dce/fe2 [0,4194304] 0 2023-10-21T17:25:02.449 INFO:tasks.workunit.client.0.smithi012.stdout:9/983: getdents d0/d5/d9c/d12c 0 2023-10-21T17:25:02.450 INFO:tasks.workunit.client.0.smithi012.stdout:9/984: write d0/df/d8d/de1/f129 [350436,23376] 0 2023-10-21T17:25:03.181 INFO:tasks.workunit.client.0.smithi012.stdout:4/992: creat dc/d1e/d33/d8a/ddb/f14d x:0 0 0 2023-10-21T17:25:03.182 INFO:tasks.workunit.client.0.smithi012.stdout:4/993: write dc/d1e/dc7/dcc/d10f/d75/f105 [970910,20401] 0 2023-10-21T17:25:03.182 INFO:tasks.workunit.client.0.smithi012.stdout:4/994: creat dc/d6b/f14e x:0 0 0 2023-10-21T17:25:04.482 INFO:tasks.workunit.client.0.smithi012.stdout:9/985: unlink d0/df/d8d/dcb/d25/d39/d8e/ff5 0 2023-10-21T17:25:04.505 INFO:tasks.workunit.client.0.smithi012.stdout:3/921: mknod d0/da/c119 0 2023-10-21T17:25:05.189 INFO:tasks.workunit.client.0.smithi012.stdout:9/986: creat d0/df/d8d/dcb/d25/d2f/d8c/f149 x:0 0 0 2023-10-21T17:25:05.211 INFO:tasks.workunit.client.0.smithi012.stdout:9/987: write d0/d4/f2e [492623,92400] 0 2023-10-21T17:25:05.422 INFO:tasks.workunit.client.0.smithi012.stdout:6/937: truncate d13/d15/f2b 894822 0 2023-10-21T17:25:05.908 INFO:tasks.workunit.client.0.smithi012.stdout:4/995: truncate dc/d1e/dc7/f106 3464510 0 2023-10-21T17:25:05.908 INFO:tasks.workunit.client.0.smithi012.stdout:4/996: fdatasync dc/d15/d2a/d31/f49 0 2023-10-21T17:25:06.680 INFO:tasks.workunit.client.0.smithi012.stdout:8/929: rename d0/d1a/d54/l63 to d0/l12f 0 2023-10-21T17:25:06.774 INFO:tasks.workunit.client.0.smithi012.stdout:8/930: dwrite d0/d29/d79/d117/db7/ffa [0,4194304] 0 2023-10-21T17:25:06.774 INFO:tasks.workunit.client.0.smithi012.stdout:8/931: chown d0/d29/d79/d117/dea 50 1 2023-10-21T17:25:06.810 INFO:tasks.workunit.client.0.smithi012.stdout:4/997: mknod dc/d1e/c14f 0 2023-10-21T17:25:06.811 INFO:tasks.workunit.client.0.smithi012.stdout:4/998: fdatasync dc/d1e/dc7/dcc/d10f/d75/fd0 0 2023-10-21T17:25:06.978 INFO:tasks.workunit.client.0.smithi012.stdout:9/988: link d0/df/d8d/dcb/d25/fe9 d0/df/d44/f14a 0 2023-10-21T17:25:07.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/938: mknod d13/d15/d1d/d28/d5b/d75/c144 0 2023-10-21T17:25:07.225 INFO:tasks.workunit.client.0.smithi012.stdout:6/939: dread d13/d15/d1d/d5d/d66/f79 [0,4194304] 0 2023-10-21T17:25:07.653 INFO:tasks.workunit.client.0.smithi012.stdout:4/999: creat dc/d28/f150 x:0 0 0 2023-10-21T17:25:07.654 INFO:tasks.workunit.client.0.smithi012.stdout:8/932: truncate d0/d29/d79/f97 3925432 0 2023-10-21T17:25:07.879 INFO:tasks.workunit.client.0.smithi012.stdout:6/940: readlink d13/d15/d1d/d28/d5b/d75/la5 0 2023-10-21T17:25:08.457 INFO:tasks.workunit.client.0.smithi012.stdout:8/933: rename d0/d1a/d54/c8a to d0/d29/d79/dfc/c130 0 2023-10-21T17:25:09.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/934: creat d0/d29/d79/dfc/f131 x:0 0 0 2023-10-21T17:25:09.010 INFO:tasks.workunit.client.0.smithi012.stdout:8/935: fsync d0/d29/d79/d117/fe0 0 2023-10-21T17:25:09.010 INFO:tasks.workunit.client.0.smithi012.stdout:8/936: chown d0/d1a/f1d 8824413 1 2023-10-21T17:25:09.032 INFO:tasks.workunit.client.0.smithi012.stdout:7/994: write d3/d6/dc/d19/d1e/d34/da8/db4/dce/ffd [3571462,80697] 0 2023-10-21T17:25:09.049 INFO:tasks.workunit.client.0.smithi012.stdout:6/941: dread d13/d15/d1d/d28/f8f [4194304,4194304] 0 2023-10-21T17:25:09.049 INFO:tasks.workunit.client.0.smithi012.stdout:6/942: write d13/d29/d78/f121 [264017,59802] 0 2023-10-21T17:25:09.114 INFO:tasks.workunit.client.0.smithi012.stdout:6/943: dwrite d13/d35/d4c/f65 [0,4194304] 0 2023-10-21T17:25:09.114 INFO:tasks.workunit.client.0.smithi012.stdout:6/944: chown d13/d35/l6b 40892722 1 2023-10-21T17:25:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/995: sync 2023-10-21T17:25:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:5/996: dread - d2/d2c/db6/d102/f12d zero size 2023-10-21T17:25:09.320 INFO:tasks.workunit.client.0.smithi012.stdout:3/922: dwrite d0/d32/f90 [0,4194304] 0 2023-10-21T17:25:09.330 INFO:tasks.workunit.client.0.smithi012.stdout:5/997: dwrite d2/d1d/d20/f4d [0,4194304] 0 2023-10-21T17:25:09.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:25:09.561 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:25:09.734 INFO:tasks.workunit.client.0.smithi012.stdout:8/937: rename d0/d1a/l1c to d0/d12/d6c/dd4/d123/l132 0 2023-10-21T17:25:10.058 INFO:tasks.workunit.client.0.smithi012.stdout:6/945: truncate d13/d42/d89/db8/d9f/fea 1365617 0 2023-10-21T17:25:10.134 INFO:tasks.workunit.client.0.smithi012.stdout:3/923: mkdir d0/d32/d43/d102/d11a 0 2023-10-21T17:25:10.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/989: write d0/df/d8d/dcb/d2a/f87 [3716368,98298] 0 2023-10-21T17:25:10.664 INFO:tasks.workunit.client.0.smithi012.stdout:8/938: symlink d0/d62/d7d/dcf/l133 0 2023-10-21T17:25:10.985 INFO:tasks.workunit.client.0.smithi012.stdout:6/946: symlink d13/d29/d77/d13a/l145 0 2023-10-21T17:25:10.986 INFO:tasks.workunit.client.0.smithi012.stdout:6/947: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9/f146 x:0 0 0 2023-10-21T17:25:11.051 INFO:tasks.workunit.client.0.smithi012.stdout:3/924: getdents d0/da/d28/d100/d10d/d97/d9b/df1 0 2023-10-21T17:25:11.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/998: rename d2/d4f/d7e/d87/d57/dc7/l11b to d2/d1d/l139 0 2023-10-21T17:25:11.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/999: chown d2/d4f/d7e/d87 1046297693 1 2023-10-21T17:25:11.621 INFO:tasks.workunit.client.0.smithi012.stdout:8/939: mkdir d0/d62/d83/d111/d134 0 2023-10-21T17:25:11.621 INFO:tasks.workunit.client.0.smithi012.stdout:8/940: dread - d0/d12/d40/d91/fae zero size 2023-10-21T17:25:11.968 INFO:tasks.workunit.client.0.smithi012.stdout:6/948: unlink d13/f14 0 2023-10-21T17:25:11.969 INFO:tasks.workunit.client.0.smithi012.stdout:6/949: chown d13/d42/c136 4910 1 2023-10-21T17:25:11.969 INFO:tasks.workunit.client.0.smithi012.stdout:6/950: fsync d13/d42/d89/db8/f2f 0 2023-10-21T17:25:12.038 INFO:tasks.workunit.client.0.smithi012.stdout:6/951: dwrite d13/d42/f84 [0,4194304] 0 2023-10-21T17:25:12.171 INFO:tasks.workunit.client.0.smithi012.stdout:9/990: rmdir d0/df/d8d/dcb/d2a 39 2023-10-21T17:25:12.332 INFO:tasks.workunit.client.0.smithi012.stdout:3/925: rename d0/d1c/f60 to d0/da/d28/df9/d118/f11b 0 2023-10-21T17:25:12.335 INFO:tasks.workunit.client.0.smithi012.stdout:3/926: read d0/da/d28/f9e [75560,34982] 0 2023-10-21T17:25:12.927 INFO:tasks.workunit.client.0.smithi012.stdout:9/991: mknod d0/d5/d9c/df0/c14b 0 2023-10-21T17:25:12.944 INFO:tasks.workunit.client.0.smithi012.stdout:8/941: truncate d0/d62/d83/d111/d121/f128 3352987 0 2023-10-21T17:25:13.352 INFO:tasks.workunit.client.0.smithi012.stdout:7/995: dwrite d3/d6/dc/d19/d1e/d9d/dec/fa9 [0,4194304] 0 2023-10-21T17:25:13.352 INFO:tasks.workunit.client.0.smithi012.stdout:7/996: truncate d3/d6/dc/fa6 776640 0 2023-10-21T17:25:13.665 INFO:tasks.workunit.client.0.smithi012.stdout:8/942: link d0/d12/f105 d0/d62/d83/f135 0 2023-10-21T17:25:13.665 INFO:tasks.workunit.client.0.smithi012.stdout:8/943: fsync d0/d12/d6c/fb8 0 2023-10-21T17:25:13.692 INFO:tasks.workunit.client.0.smithi012.stdout:8/944: dread d0/d12/d6c/db1/fbd [0,4194304] 0 2023-10-21T17:25:13.692 INFO:tasks.workunit.client.0.smithi012.stdout:8/945: write d0/d1a/d54/fa6 [345984,43976] 0 2023-10-21T17:25:14.356 INFO:tasks.workunit.client.0.smithi012.stdout:8/946: mknod d0/d29/d79/d117/db7/dd8/c136 0 2023-10-21T17:25:14.656 INFO:tasks.workunit.client.0.smithi012.stdout:8/947: rename d0/d62/d83/d4e/d109 to d0/d29/d137 0 2023-10-21T17:25:15.545 INFO:tasks.workunit.client.0.smithi012.stdout:8/948: getdents d0/d62 0 2023-10-21T17:25:15.546 INFO:tasks.workunit.client.0.smithi012.stdout:8/949: read - d0/d12/d6c/db1/fc7 zero size 2023-10-21T17:25:15.567 INFO:tasks.workunit.client.0.smithi012.stdout:9/992: link d0/df/d8d/dcb/d25/d39/d8e/cc6 d0/df/d8d/dcb/d25/c14c 0 2023-10-21T17:25:15.567 INFO:tasks.workunit.client.0.smithi012.stdout:9/993: readlink d0/d5/df3/l10f 0 2023-10-21T17:25:15.604 INFO:tasks.workunit.client.0.smithi012.stdout:9/994: dread d0/d5/f7e [0,4194304] 0 2023-10-21T17:25:15.868 INFO:tasks.workunit.client.0.smithi012.stdout:6/952: write d13/d15/f1a [3244950,75401] 0 2023-10-21T17:25:16.133 INFO:tasks.workunit.client.0.smithi012.stdout:9/995: mkdir d0/d5/d9c/d14d 0 2023-10-21T17:25:16.134 INFO:tasks.workunit.client.0.smithi012.stdout:9/996: creat d0/df/d8d/dcb/d25/d39/d8e/f14e x:0 0 0 2023-10-21T17:25:16.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/953: getdents d13/d15/d1d/d28/d5b/d75 0 2023-10-21T17:25:16.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/954: stat d13/d42/f5c 0 2023-10-21T17:25:16.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/950: symlink d0/d62/d83/d4e/dc5/l138 0 2023-10-21T17:25:17.441 INFO:tasks.workunit.client.0.smithi012.stdout:6/955: mkdir d13/d42/d89/db8/deb/d147 0 2023-10-21T17:25:17.442 INFO:tasks.workunit.client.0.smithi012.stdout:6/956: write d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f13e [735844,11092] 0 2023-10-21T17:25:17.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/997: mknod d0/da7/c14f 0 2023-10-21T17:25:17.601 INFO:tasks.workunit.client.0.smithi012.stdout:7/997: unlink d3/f83 0 2023-10-21T17:25:17.601 INFO:tasks.workunit.client.0.smithi012.stdout:7/998: read - d3/d6/ffe zero size 2023-10-21T17:25:18.329 INFO:tasks.workunit.client.0.smithi012.stdout:3/927: link d0/da/d28/fe1 d0/f11c 0 2023-10-21T17:25:18.552 INFO:tasks.workunit.client.0.smithi012.stdout:6/957: creat d13/d42/d89/db8/deb/f148 x:0 0 0 2023-10-21T17:25:18.552 INFO:tasks.workunit.client.0.smithi012.stdout:9/998: symlink d0/df/d8d/dcb/d25/d100/l150 0 2023-10-21T17:25:19.637 INFO:tasks.workunit.client.0.smithi012.stdout:3/928: dwrite d0/f5 [0,4194304] 0 2023-10-21T17:25:19.668 INFO:tasks.workunit.client.0.smithi012.stdout:6/958: unlink d13/d15/d1d/d5d/d92/l123 0 2023-10-21T17:25:19.767 INFO:tasks.workunit.client.0.smithi012.stdout:6/959: dwrite d13/d42/f8c [0,4194304] 0 2023-10-21T17:25:20.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/929: truncate d0/d32/d43/ff0 1727001 0 2023-10-21T17:25:20.382 INFO:tasks.workunit.client.0.smithi012.stdout:9/999: dread d0/f1b [0,4194304] 0 2023-10-21T17:25:20.392 INFO:tasks.workunit.client.0.smithi012.stdout:8/951: dwrite d0/d62/d83/d72/f127 [4194304,4194304] 0 2023-10-21T17:25:20.467 INFO:tasks.workunit.client.0.smithi012.stdout:8/952: dwrite d0/d12/d80/f10b [0,4194304] 0 2023-10-21T17:25:20.468 INFO:tasks.workunit.client.0.smithi012.stdout:8/953: write d0/d29/d79/f81 [5179434,130608] 0 2023-10-21T17:25:20.484 INFO:tasks.workunit.client.0.smithi012.stdout:7/999: sync 2023-10-21T17:25:20.695 INFO:tasks.workunit.client.0.smithi012.stdout:3/930: readlink d0/da/d28/d100/d10d/da0/lb5 0 2023-10-21T17:25:20.695 INFO:tasks.workunit.client.0.smithi012.stdout:3/931: write d0/da/d28/ff7 [890703,7141] 0 2023-10-21T17:25:20.696 INFO:tasks.workunit.client.0.smithi012.stdout:3/932: fsync d0/d32/d43/f45 0 2023-10-21T17:25:20.782 INFO:tasks.workunit.client.0.smithi012.stdout:3/933: dwrite d0/da/d28/df9/f106 [0,4194304] 0 2023-10-21T17:25:20.902 INFO:tasks.workunit.client.0.smithi012.stdout:6/960: rename d13/d15/f2b to d13/d15/d1d/d5d/f149 0 2023-10-21T17:25:20.972 INFO:tasks.workunit.client.0.smithi012.stdout:6/961: dwrite d13/d15/d1d/d5d/d66/d7a/f120 [0,4194304] 0 2023-10-21T17:25:20.972 INFO:tasks.workunit.client.0.smithi012.stdout:6/962: truncate d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9/f134 224595 0 2023-10-21T17:25:21.273 INFO:tasks.workunit.client.0.smithi012.stdout:8/954: creat d0/d12/d6c/dd4/f139 x:0 0 0 2023-10-21T17:25:21.274 INFO:tasks.workunit.client.0.smithi012.stdout:8/955: fsync d0/d29/d79/d117/db7/dd8/dda/f8c 0 2023-10-21T17:25:21.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/963: unlink d13/d15/d1d/d28/d5b/d75/fc0 0 2023-10-21T17:25:21.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/964: write d13/d15/d1d/d5d/d66/f79 [338998,21467] 0 2023-10-21T17:25:21.566 INFO:tasks.workunit.client.0.smithi012.stdout:3/934: write d0/f15 [1802560,125343] 0 2023-10-21T17:25:21.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/965: fsync d13/d29/d37/f10f 0 2023-10-21T17:25:21.566 INFO:tasks.workunit.client.0.smithi012.stdout:3/935: fsync d0/da/d28/df9/f106 0 2023-10-21T17:25:21.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/966: stat d13/d15/d1d/d5d/d66/d7a/f120 0 2023-10-21T17:25:21.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/967: fdatasync d13/d42/fc3 0 2023-10-21T17:25:21.567 INFO:tasks.workunit.client.0.smithi012.stdout:3/936: write d0/d9d/fdd [260600,58724] 0 2023-10-21T17:25:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:6/968: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f14a x:0 0 0 2023-10-21T17:25:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:3/937: chown d0/d32/d43/l7f 13 1 2023-10-21T17:25:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:6/969: chown d13/d29/d37/d3b 6094 1 2023-10-21T17:25:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:8/956: creat d0/f13a x:0 0 0 2023-10-21T17:25:21.568 INFO:tasks.workunit.client.0.smithi012.stdout:8/957: truncate d0/d12/d6c/db1/fbd 3591546 0 2023-10-21T17:25:21.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/958: creat d0/d1a/d54/f13b x:0 0 0 2023-10-21T17:25:21.620 INFO:tasks.workunit.client.0.smithi012.stdout:3/938: dwrite d0/da/d28/d100/d10d/ff3 [0,4194304] 0 2023-10-21T17:25:21.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/939: dread d0/d1c/d5e/fb1 [0,4194304] 0 2023-10-21T17:25:22.306 INFO:tasks.workunit.client.0.smithi012.stdout:8/959: rename d0/d29/d137 to d0/d29/d79/dfc/d103/d13c 0 2023-10-21T17:25:22.711 INFO:tasks.workunit.client.0.smithi012.stdout:3/940: mknod d0/d32/d43/d47/d50/dcc/c11d 0 2023-10-21T17:25:22.712 INFO:tasks.workunit.client.0.smithi012.stdout:3/941: read - d0/d32/f103 zero size 2023-10-21T17:25:23.082 INFO:tasks.workunit.client.0.smithi012.stdout:6/970: getdents d13/d15/d1d/d28 0 2023-10-21T17:25:23.358 INFO:tasks.workunit.client.0.smithi012.stdout:3/942: creat d0/d82/f11e x:0 0 0 2023-10-21T17:25:23.708 INFO:tasks.workunit.client.0.smithi012.stdout:6/971: rename d13/d29/d37/d3b/f5e to d13/d42/d89/db8/deb/f14b 0 2023-10-21T17:25:24.077 INFO:tasks.workunit.client.0.smithi012.stdout:3/943: mkdir d0/d32/d43/d47/d50/d11f 0 2023-10-21T17:25:24.740 INFO:tasks.workunit.client.0.smithi012.stdout:3/944: mknod d0/da/d28/d100/d10d/d97/d9b/c120 0 2023-10-21T17:25:24.740 INFO:tasks.workunit.client.0.smithi012.stdout:8/960: write d0/d1a/d54/f5f [5719710,17250] 0 2023-10-21T17:25:24.919 INFO:tasks.workunit.client.0.smithi012.stdout:6/972: symlink d13/d15/d1d/d28/l14c 0 2023-10-21T17:25:25.267 INFO:tasks.workunit.client.0.smithi012.stdout:3/945: link d0/d32/d43/c95 d0/d1c/d5e/c121 0 2023-10-21T17:25:25.268 INFO:tasks.workunit.client.0.smithi012.stdout:8/961: creat d0/d62/d83/d111/d134/f13d x:0 0 0 2023-10-21T17:25:25.302 INFO:tasks.workunit.client.0.smithi012.stdout:3/946: dread d0/d1c/f71 [0,4194304] 0 2023-10-21T17:25:25.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/947: write d0/f14 [3441798,101483] 0 2023-10-21T17:25:25.394 INFO:tasks.workunit.client.0.smithi012.stdout:3/948: dwrite d0/da/f5f [4194304,4194304] 0 2023-10-21T17:25:25.791 INFO:tasks.workunit.client.0.smithi012.stdout:3/949: write d0/d32/d43/d47/d50/d52/f76 [3568115,12845] 0 2023-10-21T17:25:25.858 INFO:tasks.workunit.client.0.smithi012.stdout:3/950: mknod d0/d32/d43/d47/d50/dcc/c122 0 2023-10-21T17:25:25.902 INFO:tasks.workunit.client.0.smithi012.stdout:6/973: dwrite d13/d64/d6d/f11e [0,4194304] 0 2023-10-21T17:25:25.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/951: creat d0/da/d28/df9/f123 x:0 0 0 2023-10-21T17:25:25.951 INFO:tasks.workunit.client.0.smithi012.stdout:8/962: dwrite d0/d29/d79/d117/dea/fe2 [0,4194304] 0 2023-10-21T17:25:25.970 INFO:tasks.workunit.client.0.smithi012.stdout:6/974: dwrite d13/d42/f10b [0,4194304] 0 2023-10-21T17:25:26.215 INFO:tasks.workunit.client.0.smithi012.stdout:3/952: creat d0/da/d28/d100/f124 x:0 0 0 2023-10-21T17:25:26.216 INFO:tasks.workunit.client.0.smithi012.stdout:8/963: unlink d0/d12/l119 0 2023-10-21T17:25:26.216 INFO:tasks.workunit.client.0.smithi012.stdout:3/953: creat d0/d32/d43/d102/f125 x:0 0 0 2023-10-21T17:25:26.229 INFO:tasks.workunit.client.0.smithi012.stdout:6/975: creat d13/d64/d6d/f14d x:0 0 0 2023-10-21T17:25:26.292 INFO:tasks.workunit.client.0.smithi012.stdout:3/954: dwrite d0/d9d/fdd [0,4194304] 0 2023-10-21T17:25:26.431 INFO:tasks.workunit.client.0.smithi012.stdout:8/964: mkdir d0/d12/d40/d91/d11a/d13e 0 2023-10-21T17:25:26.432 INFO:tasks.workunit.client.0.smithi012.stdout:8/965: creat d0/d12/d40/f13f x:0 0 0 2023-10-21T17:25:26.760 INFO:tasks.workunit.client.0.smithi012.stdout:6/976: rename d13/d29/d37/d3b to d13/d15/d1d/d5d/d66/d70/d74/d14e 0 2023-10-21T17:25:26.925 INFO:tasks.workunit.client.0.smithi012.stdout:3/955: creat d0/d32/d43/d102/d11a/f126 x:0 0 0 2023-10-21T17:25:26.925 INFO:tasks.workunit.client.0.smithi012.stdout:3/956: chown d0/da/f5f 629303193 1 2023-10-21T17:25:27.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/966: creat d0/d29/d79/dfc/d103/d13c/f140 x:0 0 0 2023-10-21T17:25:27.239 INFO:tasks.workunit.client.0.smithi012.stdout:6/977: symlink d13/d29/l14f 0 2023-10-21T17:25:27.474 INFO:tasks.workunit.client.0.smithi012.stdout:3/957: unlink d0/d1c/l10a 0 2023-10-21T17:25:27.475 INFO:tasks.workunit.client.0.smithi012.stdout:3/958: chown d0/c73 172005 1 2023-10-21T17:25:27.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/967: mkdir d0/d29/d79/d117/db7/d141 0 2023-10-21T17:25:27.475 INFO:tasks.workunit.client.0.smithi012.stdout:3/959: readlink d0/da/d28/d100/d10d/da0/lb5 0 2023-10-21T17:25:27.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/968: truncate d0/d1a/d54/f5f 6168537 0 2023-10-21T17:25:27.514 INFO:tasks.workunit.client.0.smithi012.stdout:3/960: dread d0/da/d28/df9/f106 [0,4194304] 0 2023-10-21T17:25:27.581 INFO:tasks.workunit.client.0.smithi012.stdout:8/969: dwrite d0/d62/d7d/dcf/fd6 [0,4194304] 0 2023-10-21T17:25:27.634 INFO:tasks.workunit.client.0.smithi012.stdout:8/970: dread d0/d29/d79/f81 [0,4194304] 0 2023-10-21T17:25:27.651 INFO:tasks.workunit.client.0.smithi012.stdout:8/971: dread d0/f32 [4194304,4194304] 0 2023-10-21T17:25:27.681 INFO:tasks.workunit.client.0.smithi012.stdout:8/972: write d0/d29/d79/d117/f106 [598633,118186] 0 2023-10-21T17:25:27.704 INFO:tasks.workunit.client.0.smithi012.stdout:8/973: dread d0/d46/f9a [0,4194304] 0 2023-10-21T17:25:27.887 INFO:tasks.workunit.client.0.smithi012.stdout:3/961: rename d0/f2b to d0/d32/d43/d102/d11a/f127 0 2023-10-21T17:25:27.896 INFO:tasks.workunit.client.0.smithi012.stdout:6/978: dread d13/d29/d78/f94 [0,4194304] 0 2023-10-21T17:25:28.665 INFO:tasks.workunit.client.0.smithi012.stdout:3/962: symlink d0/d32/d43/d47/d50/dcc/l128 0 2023-10-21T17:25:28.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/979: dread d13/d29/d78/f121 [0,4194304] 0 2023-10-21T17:25:29.100 INFO:tasks.workunit.client.0.smithi012.stdout:8/974: mknod d0/d62/d83/d4e/dc5/c142 0 2023-10-21T17:25:29.177 INFO:tasks.workunit.client.0.smithi012.stdout:3/963: write d0/da/f3d [1454454,13928] 0 2023-10-21T17:25:29.294 INFO:tasks.workunit.client.0.smithi012.stdout:6/980: read d13/d35/d4c/f93 [638850,9691] 0 2023-10-21T17:25:29.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/981: dread d13/d15/d1d/d5d/d66/d70/d74/dc9/f117 [0,4194304] 0 2023-10-21T17:25:29.312 INFO:tasks.workunit.client.0.smithi012.stdout:6/982: truncate d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/df9/f146 971002 0 2023-10-21T17:25:29.410 INFO:tasks.workunit.client.0.smithi012.stdout:8/975: creat d0/d46/f143 x:0 0 0 2023-10-21T17:25:29.461 INFO:tasks.workunit.client.0.smithi012.stdout:3/964: truncate d0/d1c/fbd 452930 0 2023-10-21T17:25:29.909 INFO:tasks.workunit.client.0.smithi012.stdout:6/983: mknod d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/de7/dfd/d13b/c150 0 2023-10-21T17:25:29.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/976: symlink d0/d62/d83/d111/l144 0 2023-10-21T17:25:29.910 INFO:tasks.workunit.client.0.smithi012.stdout:8/977: chown d0/d62/d83/cce 3487 1 2023-10-21T17:25:29.949 INFO:tasks.workunit.client.0.smithi012.stdout:6/984: dread d13/f69 [0,4194304] 0 2023-10-21T17:25:29.979 INFO:tasks.workunit.client.0.smithi012.stdout:3/965: mknod d0/da/d28/df9/d118/c129 0 2023-10-21T17:25:29.979 INFO:tasks.workunit.client.0.smithi012.stdout:3/966: readlink d0/l31 0 2023-10-21T17:25:30.198 INFO:tasks.workunit.client.0.smithi012.stdout:8/978: creat d0/d12/f145 x:0 0 0 2023-10-21T17:25:30.198 INFO:tasks.workunit.client.0.smithi012.stdout:6/985: chown d13/d15/d1d/d5d/l6e 204189 1 2023-10-21T17:25:30.305 INFO:tasks.workunit.client.0.smithi012.stdout:3/967: dread d0/da/f34 [0,4194304] 0 2023-10-21T17:25:30.479 INFO:tasks.workunit.client.0.smithi012.stdout:6/986: mkdir d13/d15/d1d/d5d/d66/d70/d74/d151 0 2023-10-21T17:25:30.480 INFO:tasks.workunit.client.0.smithi012.stdout:6/987: creat d13/d42/d89/db8/d9f/f152 x:0 0 0 2023-10-21T17:25:30.737 INFO:tasks.workunit.client.0.smithi012.stdout:3/968: creat d0/da/d28/f12a x:0 0 0 2023-10-21T17:25:30.769 INFO:tasks.workunit.client.0.smithi012.stdout:3/969: dread d0/d1c/f5a [0,4194304] 0 2023-10-21T17:25:31.174 INFO:tasks.workunit.client.0.smithi012.stdout:8/979: dwrite d0/d62/f68 [0,4194304] 0 2023-10-21T17:25:31.245 INFO:tasks.workunit.client.0.smithi012.stdout:8/980: dwrite d0/d12/d40/d91/fd7 [0,4194304] 0 2023-10-21T17:25:31.417 INFO:tasks.workunit.client.0.smithi012.stdout:6/988: symlink d13/d35/d4c/l153 0 2023-10-21T17:25:31.427 INFO:tasks.workunit.client.0.smithi012.stdout:3/970: link d0/d32/d43/d102/fda d0/f12b 0 2023-10-21T17:25:31.584 INFO:tasks.workunit.client.0.smithi012.stdout:3/971: dread d0/da/d28/d100/d10d/d97/d9b/ffa [0,4194304] 0 2023-10-21T17:25:31.670 INFO:tasks.workunit.client.0.smithi012.stdout:3/972: dwrite d0/d1c/f5a [0,4194304] 0 2023-10-21T17:25:32.012 INFO:tasks.workunit.client.0.smithi012.stdout:6/989: rename d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/cbd to d13/d15/d1d/d5d/c154 0 2023-10-21T17:25:32.068 INFO:tasks.workunit.client.0.smithi012.stdout:3/973: symlink d0/d82/d104/l12c 0 2023-10-21T17:25:32.068 INFO:tasks.workunit.client.0.smithi012.stdout:3/974: chown d0/c3e 12425 1 2023-10-21T17:25:32.092 INFO:tasks.workunit.client.0.smithi012.stdout:8/981: write d0/d12/d6c/db1/fbd [288560,32992] 0 2023-10-21T17:25:32.093 INFO:tasks.workunit.client.0.smithi012.stdout:6/990: dwrite d13/d42/d89/db8/deb/f14b [0,4194304] 0 2023-10-21T17:25:32.210 INFO:tasks.workunit.client.0.smithi012.stdout:3/975: symlink d0/da/d28/d100/d10d/d97/d9b/l12d 0 2023-10-21T17:25:32.501 INFO:tasks.workunit.client.0.smithi012.stdout:8/982: symlink d0/d62/d7d/l146 0 2023-10-21T17:25:32.502 INFO:tasks.workunit.client.0.smithi012.stdout:8/983: chown d0/d29/d79/d117/dea/fe2 11227 1 2023-10-21T17:25:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:3/976: creat d0/da/d28/d100/d10d/d97/d9b/f12e x:0 0 0 2023-10-21T17:25:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:6/991: truncate d13/d15/d1d/f20 4112926 0 2023-10-21T17:25:32.754 INFO:tasks.workunit.client.0.smithi012.stdout:8/984: mkdir d0/d62/d7d/d147 0 2023-10-21T17:25:32.755 INFO:tasks.workunit.client.0.smithi012.stdout:8/985: fsync d0/d29/d79/f81 0 2023-10-21T17:25:32.812 INFO:tasks.workunit.client.0.smithi012.stdout:3/977: creat d0/d32/d43/d47/d50/d11f/f12f x:0 0 0 2023-10-21T17:25:32.812 INFO:tasks.workunit.client.0.smithi012.stdout:3/978: truncate d0/da/d28/d100/d10d/d97/d9b/f12e 777850 0 2023-10-21T17:25:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/979: fsync d0/f15 0 2023-10-21T17:25:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/980: chown d0/d82/d104/l12c 58611 1 2023-10-21T17:25:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/981: dread - d0/d32/d43/d47/d50/d11f/f12f zero size 2023-10-21T17:25:32.846 INFO:tasks.workunit.client.0.smithi012.stdout:6/992: dread f8 [0,4194304] 0 2023-10-21T17:25:32.880 INFO:tasks.workunit.client.0.smithi012.stdout:8/986: rename d0/f13a to d0/d29/d79/d117/db7/dd8/f148 0 2023-10-21T17:25:33.266 INFO:tasks.workunit.client.0.smithi012.stdout:6/993: creat d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/f155 x:0 0 0 2023-10-21T17:25:33.266 INFO:tasks.workunit.client.0.smithi012.stdout:6/994: stat d13/f36 0 2023-10-21T17:25:34.039 INFO:tasks.workunit.client.0.smithi012.stdout:3/982: mknod d0/c130 0 2023-10-21T17:25:35.234 INFO:tasks.workunit.client.0.smithi012.stdout:8/987: link d0/ca d0/d62/d83/d72/c149 0 2023-10-21T17:25:35.256 INFO:tasks.workunit.client.0.smithi012.stdout:8/988: dread d0/d29/f59 [4194304,4194304] 0 2023-10-21T17:25:36.038 INFO:tasks.workunit.client.0.smithi012.stdout:8/989: sync 2023-10-21T17:25:36.039 INFO:tasks.workunit.client.0.smithi012.stdout:6/995: sync 2023-10-21T17:25:36.127 INFO:tasks.workunit.client.0.smithi012.stdout:3/983: write d0/da/d28/df9/d118/f11b [978348,25512] 0 2023-10-21T17:25:36.128 INFO:tasks.workunit.client.0.smithi012.stdout:3/984: readlink d0/l30 0 2023-10-21T17:25:36.354 INFO:tasks.workunit.client.0.smithi012.stdout:3/985: rmdir d0/da/d28/d117 0 2023-10-21T17:25:36.605 INFO:tasks.workunit.client.0.smithi012.stdout:3/986: rmdir d0/d82 39 2023-10-21T17:25:36.606 INFO:tasks.workunit.client.0.smithi012.stdout:6/996: sync 2023-10-21T17:25:36.700 INFO:tasks.workunit.client.0.smithi012.stdout:8/990: dwrite d0/d62/d7d/dcf/fd6 [0,4194304] 0 2023-10-21T17:25:36.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/997: unlink d13/f16 0 2023-10-21T17:25:36.714 INFO:tasks.workunit.client.0.smithi012.stdout:3/987: dwrite d0/d9d/fc6 [4194304,4194304] 0 2023-10-21T17:25:36.775 INFO:tasks.workunit.client.0.smithi012.stdout:8/991: dwrite d0/d12/d40/d91/fd7 [0,4194304] 0 2023-10-21T17:25:36.775 INFO:tasks.workunit.client.0.smithi012.stdout:8/992: write d0/d12/f2b [141936,25417] 0 2023-10-21T17:25:36.776 INFO:tasks.workunit.client.0.smithi012.stdout:8/993: readlink d0/d12/d80/l69 0 2023-10-21T17:25:36.776 INFO:tasks.workunit.client.0.smithi012.stdout:8/994: chown d0/d29/l38 0 1 2023-10-21T17:25:36.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/998: rename d13/d15/d1d/d5d/d66/d70/l142 to d13/d29/d37/l156 0 2023-10-21T17:25:36.899 INFO:tasks.workunit.client.0.smithi012.stdout:6/999: read - d13/d15/d1d/d5d/d66/d70/d74/dc9/dec/dac/f14a zero size 2023-10-21T17:25:37.137 INFO:tasks.workunit.client.0.smithi012.stdout:8/995: link d0/d62/d7d/lf1 d0/d29/d79/dfc/d118/l14a 0 2023-10-21T17:25:37.373 INFO:tasks.workunit.client.0.smithi012.stdout:3/988: dwrite d0/da/d28/d100/d10d/d97/d9b/ffa [0,4194304] 0 2023-10-21T17:25:37.394 INFO:tasks.workunit.client.0.smithi012.stdout:3/989: write d0/da/d28/df9/f106 [636569,121646] 0 2023-10-21T17:25:37.394 INFO:tasks.workunit.client.0.smithi012.stdout:3/990: chown d0/d32/d43/d47/c8c 106559 1 2023-10-21T17:25:37.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/996: dwrite d0/d12/d51/f57 [0,4194304] 0 2023-10-21T17:25:37.763 INFO:tasks.workunit.client.0.smithi012.stdout:8/997: fsync d0/d12/f145 0 2023-10-21T17:25:37.764 INFO:tasks.workunit.client.0.smithi012.stdout:8/998: stat d0/d29/d79/d117/dca 0 2023-10-21T17:25:37.764 INFO:tasks.workunit.client.0.smithi012.stdout:8/999: read - d0/d12/d6c/db1/f11b zero size 2023-10-21T17:25:37.766 INFO:tasks.workunit.client.0.smithi012.stdout:3/991: write d0/d32/d43/d47/d50/d52/fc2 [1063122,118386] 0 2023-10-21T17:25:38.009 INFO:tasks.workunit.client.0.smithi012.stdout:3/992: creat d0/da/d28/f131 x:0 0 0 2023-10-21T17:25:38.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/993: dread d0/da/d28/f3c [0,4194304] 0 2023-10-21T17:25:39.031 INFO:tasks.workunit.client.0.smithi012.stdout:3/994: symlink d0/da/d28/d100/d10d/l132 0 2023-10-21T17:25:39.032 INFO:tasks.workunit.client.0.smithi012.stdout:3/995: write d0/d32/d43/d47/d50/d11f/f12f [914340,9284] 0 2023-10-21T17:25:39.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/996: dread d0/da/f26 [0,4194304] 0 2023-10-21T17:25:39.502 INFO:tasks.workunit.client.0.smithi012.stdout:3/997: unlink d0/d32/d43/c70 0 2023-10-21T17:25:39.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:25:39.693 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:25:39.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/998: creat d0/d32/d43/d47/d50/d52/f133 x:0 0 0 2023-10-21T17:25:39.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/999: creat d0/d1c/f134 x:0 0 0 2023-10-21T17:25:39.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf -- ./tmp.1NpNbR4s6h 2023-10-21T17:25:49.217 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:59:15.199 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.340 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:59:15.323 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.385 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:59:15.470 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.390 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:59:15.474 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.396 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:59:15.481 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.398 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:59:15.483 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.409 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:00:59:15.391 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.425 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:00:59:15.510 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:25:49.434 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:00:59:15.519 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:26:09.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:26:09.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:26:39.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:26:39.977 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:27:10.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:27:10.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:27:40.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:27:40.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:28:10.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:28:10.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:28:15.657 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:01:41.639 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.658 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:01:41.743 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.660 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:01:41.745 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.666 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:01:41.649 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.667 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:01:41.751 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.669 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:01:41.754 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.722 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:01:41.806 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.729 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:01:41.813 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:15.806 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:01:41.789 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:28:40.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:28:40.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:29:10.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:29:10.796 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:29:40.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:29:40.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:30:11.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:30:11.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:30:41.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:30:41.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:31:11.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:31:11.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:31:33.416 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:04:59.398 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.418 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:04:59.502 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.421 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:04:59.506 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.422 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:04:59.506 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.426 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:04:59.511 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.435 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:04:59.418 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.536 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:04:59.621 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.538 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:04:59.622 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:33.750 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:04:59.733 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:31:41.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:31:41.492 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:32:11.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:32:11.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:32:17.838 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:05:43.821 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.842 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:05:43.825 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.880 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:05:43.965 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.886 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:05:43.971 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.888 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:05:43.973 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.893 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:05:43.978 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.928 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:05:44.012 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.935 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:05:44.019 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:17.940 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:05:43.923 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:32:41.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:32:41.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:33:11.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:33:11.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:33:42.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:33:42.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:34:12.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:34:12.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:34:13.774 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:07:39.756 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.793 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:07:39.776 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.839 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:07:39.924 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.841 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:07:39.925 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.841 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:07:39.925 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.842 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:07:39.926 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.881 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:07:39.965 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:13.886 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:07:39.970 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:14.058 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:07:40.040 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:42.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:34:42.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:34:49.713 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:08:15.695 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.728 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:08:15.710 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.729 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:08:15.813 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.732 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:08:15.816 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.732 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:08:15.817 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.734 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:08:15.818 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.760 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:08:15.845 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.762 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:08:15.846 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:34:49.806 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:08:15.788 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:35:12.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:35:12.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:35:42.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:35:42.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:36:12.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:36:12.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:36:42.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:36:42.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:37:13.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:37:13.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:37:43.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:37:43.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:38:13.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:38:13.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:38:17.982 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:11:43.965 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:17.993 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:11:44.077 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:17.995 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:11:44.080 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:17.997 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:11:44.081 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:17.999 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:11:44.083 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:18.002 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:11:43.985 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:18.074 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:11:44.158 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:18.075 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:11:44.160 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:18.159 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:11:44.142 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:38:43.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:38:43.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:39:13.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:39:13.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:39:43.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:39:43.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:40:14.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:40:14.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:40:31.585 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:13:57.568 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.694 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:13:57.676 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.745 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:13:57.830 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.746 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:13:57.831 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.747 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:13:57.831 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.750 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:13:57.834 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.798 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:13:57.882 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.805 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:13:57.889 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:31.823 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:13:57.806 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:40:44.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:40:44.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:41:14.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:41:14.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:41:43.532 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:15:09.514 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.532 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:15:09.616 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.533 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:15:09.616 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.534 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:15:09.619 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.535 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:15:09.619 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.544 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:15:09.527 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.573 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:15:09.657 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.573 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:15:09.657 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:43.656 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:15:09.639 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:41:44.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:41:44.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:42:14.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:42:14.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:42:37.601 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:16:03.583 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.615 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:16:03.598 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.662 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:16:03.746 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.663 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:16:03.748 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.669 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:16:03.754 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.671 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:16:03.755 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.692 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:16:03.777 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.698 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:16:03.782 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:37.851 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:16:03.834 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:42:42.750 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-21T17:42:42.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-21T17:42:44.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:42:44.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:43:15.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:43:15.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:43:45.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:43:45.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:44:15.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:44:15.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:44:45.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:44:45.524 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:45:10.085 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:18:36.067 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.099 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:18:36.081 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.105 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:18:36.189 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.108 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:18:36.193 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.164 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:18:36.248 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.217 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:18:36.301 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.219 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:18:36.303 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.227 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:18:36.209 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:10.276 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:18:36.360 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:45:15.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:45:15.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:45:45.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:45:45.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:46:15.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:46:15.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:46:46.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:46:46.315 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:47:16.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:47:16.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:47:46.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:47:46.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:48:16.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:48:16.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:48:38.082 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:04.064 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.092 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:04.177 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.096 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:04.180 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.099 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:04.081 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.099 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:04.184 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.101 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:04.186 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.169 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:04.254 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.177 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:04.261 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:38.258 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:04.241 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:46.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:48:46.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:48:50.710 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:16.693 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.726 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:16.708 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.768 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:16.852 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.770 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:16.855 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.774 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:16.859 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.776 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:16.861 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.780 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:22:16.763 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.798 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:22:16.883 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:48:50.802 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:22:16.887 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:49:17.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:49:17.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:49:47.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:49:47.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:50:17.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:50:17.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:50:47.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:50:47.449 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:51:01.694 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:24:27.677 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.702 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:24:27.684 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.749 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:24:27.833 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.750 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:24:27.835 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.752 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:24:27.837 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.757 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:24:27.841 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.796 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:24:27.880 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.800 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:24:27.885 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:01.946 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:24:27.928 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:51:17.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:51:17.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:51:47.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:51:47.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:52:03.478 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:25:29.461 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.495 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:25:29.579 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.496 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:25:29.581 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.497 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:25:29.581 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.497 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:25:29.480 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.500 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:25:29.584 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.545 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:25:29.629 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.547 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:25:29.632 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:03.597 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:25:29.580 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:52:17.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:52:17.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:52:48.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:52:48.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:53:18.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:53:18.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:53:48.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:53:48.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:54:18.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:54:18.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:54:48.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:54:48.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:55:18.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:55:18.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:55:31.417 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:28:57.399 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.427 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:28:57.511 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.429 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:28:57.513 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.430 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:28:57.413 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.431 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:28:57.515 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.434 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:28:57.518 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.520 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:28:57.604 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.526 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:28:57.610 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:31.585 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:28:57.568 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:55:48.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:55:48.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:56:19.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:56:19.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:56:49.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:56:49.221 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:57:09.664 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:30:35.646 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.675 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:30:35.657 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.712 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:30:35.796 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.716 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:30:35.800 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.728 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:30:35.812 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.729 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:30:35.814 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.761 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:30:35.846 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.777 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:30:35.862 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:09.782 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:30:35.764 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:57:19.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:57:19.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:57:49.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:57:49.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:58:19.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:58:19.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:58:49.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:58:49.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:58:59.256 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:25.238 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.264 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:25.348 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.265 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:25.247 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.267 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:25.351 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.269 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:25.353 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.271 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:25.355 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.316 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:25.401 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.319 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:25.404 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:58:59.378 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:25.361 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:19.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:59:19.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:59:25.717 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:51.699 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.728 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:51.711 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.782 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:51.866 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.783 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:51.867 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.790 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:51.874 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.791 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:32:51.773 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.799 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:51.883 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.809 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:32:51.894 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:25.829 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:32:51.914 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T17:59:50.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T17:59:50.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:00:20.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:00:20.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:00:50.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:00:50.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:01:20.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:01:20.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:01:50.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:01:50.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:02:20.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:02:20.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:02:26.095 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:35:52.077 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.108 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:35:52.192 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.111 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:35:52.195 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.111 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:35:52.093 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.112 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:35:52.197 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.114 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:35:52.199 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.181 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:35:52.265 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.185 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:35:52.270 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:26.244 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:35:52.226 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:02:51.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:02:51.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:03:21.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:03:21.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:03:51.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:03:51.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:04:21.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:04:21.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:04:51.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:04:51.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:05:21.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:05:22.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:05:28.621 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:38:54.604 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.633 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:38:54.615 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.666 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:38:54.751 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.670 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:38:54.755 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.672 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:38:54.756 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.675 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:38:54.760 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.741 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:38:54.825 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.749 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:38:54.833 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:28.891 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:38:54.873 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:52.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:05:52.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:05:53.172 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:39:19.155 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.182 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:39:19.266 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.185 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:39:19.166 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.186 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:39:19.269 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.187 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:39:19.272 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.190 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:39:19.274 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.208 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:39:19.293 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.214 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:39:19.298 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:05:53.238 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:39:19.220 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:06:22.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:06:22.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:06:52.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:06:52.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:07:22.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:07:22.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:07:49.921 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:41:15.903 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:49.937 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:41:15.919 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:49.983 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:41:16.067 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:49.985 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:41:16.069 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:49.986 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:41:16.071 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:49.989 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:41:16.074 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:50.027 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:41:16.110 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:50.027 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:41:16.111 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:50.063 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:41:16.045 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:07:52.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:07:52.737 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:08:22.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:08:22.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:08:53.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:08:53.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:09:19.459 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:42:45.543 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.462 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:42:45.445 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.463 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:42:45.547 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.463 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:42:45.547 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.465 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:42:45.550 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.494 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:42:45.474 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.505 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:42:45.589 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.507 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:42:45.591 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:19.710 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:42:45.692 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:09:23.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:09:23.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:09:53.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:09:53.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:10:23.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:10:23.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:10:53.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:10:53.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:11:23.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:11:23.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:11:53.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:11:53.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:12:24.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:12:24.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:12:47.302 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:46:13.284 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.303 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:46:13.386 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.304 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:46:13.388 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.307 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:46:13.391 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.309 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:46:13.394 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.314 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:46:13.297 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.377 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:46:13.461 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.396 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:46:13.481 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:47.467 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:46:13.449 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:12:54.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:12:54.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:13:24.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:13:24.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:13:52.923 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:47:18.905 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:52.927 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:47:18.910 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:52.957 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:47:19.041 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:52.964 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:47:19.048 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:52.976 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:47:19.060 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:52.977 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:47:19.061 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:53.002 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:47:19.086 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:53.015 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:47:19.099 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:53.019 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:47:19.002 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:13:54.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:13:54.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:14:24.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:14:24.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:14:54.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:14:54.833 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:15:24.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:15:24.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:15:55.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:15:55.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:16:14.063 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:40.045 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.081 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:40.064 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.128 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.212 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.129 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.213 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.131 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.215 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.133 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.217 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.195 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.279 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.195 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.279 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.224 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:40.206 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.789 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.873 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.791 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.876 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.806 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.891 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.809 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:49:40.893 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.810 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.895 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:14.832 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:49:40.917 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:15.412 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:41.394 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:15.419 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:41.401 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:15.463 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:49:41.445 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:16:25.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:16:25.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:16:55.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:16:55.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:17:25.564 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:17:25.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:17:55.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:17:55.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:18:25.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:18:25.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:18:56.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:18:56.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:19:26.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:19:26.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:19:42.023 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:53:08.005 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.030 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:53:08.114 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.032 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:53:08.116 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.033 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:53:08.117 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.034 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:53:08.119 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.037 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:53:08.019 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.107 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:53:08.191 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.108 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:53:08.193 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:42.202 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:53:08.184 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:19:56.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:19:56.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:20:26.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:20:26.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:20:56.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:20:56.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:21:26.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:21:26.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:21:56.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:21:56.860 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:22:16.994 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:55:42.976 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.004 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:55:42.986 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.049 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:55:43.133 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.050 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:55:43.134 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.051 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:55:43.135 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.055 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:55:43.139 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.098 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:55:43.080 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.105 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:55:43.189 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:17.112 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:55:43.196 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:22:26.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:22:26.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:22:57.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:22:57.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:23:09.920 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:56:36.004 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.921 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:56:35.903 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.922 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:56:36.006 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.928 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:56:36.012 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.930 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:56:36.014 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.934 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:56:35.916 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.954 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:56:36.039 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:09.963 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:56:36.047 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:10.022 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:56:36.004 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:23:27.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:23:27.272 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:23:57.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:23:57.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:24:27.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:24:27.566 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:24:38.279 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:58:04.261 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.286 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:58:04.269 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.320 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:58:04.404 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.325 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:58:04.410 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.329 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:58:04.413 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.333 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:58:04.417 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.361 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:01:58:04.445 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.369 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:01:58:04.453 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:38.517 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:01:58:04.499 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:24:57.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:24:57.731 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:25:27.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:25:27.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:25:57.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:25:57.985 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:26:28.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:26:28.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:26:37.694 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:00:03.676 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.696 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:00:03.780 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.698 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:00:03.782 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.704 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:00:03.788 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.705 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:00:03.687 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.707 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:00:03.792 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.773 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:00:03.857 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.780 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:00:03.865 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:37.830 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:00:03.812 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:26:58.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:26:58.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:27:28.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:27:28.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:27:58.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:27:58.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:28:08.700 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-10-21T18:28:08.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-21T18:28:09.802 DEBUG:teuthology.parallel:result is None 2023-10-21T18:28:09.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-21T18:28:10.486 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-21T18:28:10.487 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-21T18:28:10.844 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-21T18:28:10.855 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T18:28:10.856 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-21T18:28:10.919 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-21T18:28:10.934 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-21T18:28:10.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T18:28:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.223+0000 7f566bba9640 1 Processor -- start 2023-10-21T18:28:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.223+0000 7f566bba9640 1 -- start start 2023-10-21T18:28:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f56640c55f0 0x7f5664157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56640c59d0 0x7f5664151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56640c23f0 con 0x7f56640c59d0 2023-10-21T18:28:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5664156fa0 con 0x7f56640c55f0 2023-10-21T18:28:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.225+0000 7f566bba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566415aaf0 con 0x7f5664157cc0 2023-10-21T18:28:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.226+0000 7f5669144640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.226+0000 7f5669945640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f56640c55f0 0x7f5664157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.226+0000 7f5669144640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:52930/0 (socket says 172.21.15.12:52930) 2023-10-21T18:28:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.226+0000 7f5669144640 1 -- 172.21.15.12:0/608219441 learned_addr learned my addr 172.21.15.12:0/608219441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.226+0000 7f566a146640 1 --2- 172.21.15.12:0/608219441 >> v2:172.21.15.12:3300/0 conn(0x7f56640c59d0 0x7f5664151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.230+0000 7f5669144640 1 -- 172.21.15.12:0/608219441 >> v2:172.21.15.99:3300/0 conn(0x7f56640c55f0 msgr2=0x7f5664157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.230+0000 7f5669144640 1 --2- 172.21.15.12:0/608219441 >> v2:172.21.15.99:3300/0 conn(0x7f56640c55f0 0x7f5664157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.230+0000 7f5669144640 1 -- 172.21.15.12:0/608219441 >> v2:172.21.15.12:3300/0 conn(0x7f56640c59d0 msgr2=0x7f5664151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.230+0000 7f5669144640 1 --2- 172.21.15.12:0/608219441 >> v2:172.21.15.12:3300/0 conn(0x7f56640c59d0 0x7f5664151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.230+0000 7f5669144640 1 -- 172.21.15.12:0/608219441 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566415add0 con 0x7f5664157cc0 2023-10-21T18:28:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.233+0000 7f5669144640 1 --2- 172.21.15.12:0/608219441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56640c50a0 tx=0x7f565402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=172df72d38c61515 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:11.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.238+0000 7f5668943640 1 -- 172.21.15.12:0/608219441 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654030860 con 0x7f5664157cc0 2023-10-21T18:28:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.238+0000 7f5668943640 1 -- 172.21.15.12:0/608219441 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56540309c0 con 0x7f5664157cc0 2023-10-21T18:28:11.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.238+0000 7f5668943640 1 -- 172.21.15.12:0/608219441 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654030d50 con 0x7f5664157cc0 2023-10-21T18:28:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 -- 172.21.15.12:0/608219441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 msgr2=0x7f5664150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 --2- 172.21.15.12:0/608219441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56640c50a0 tx=0x7f565402b9a0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 -- 172.21.15.12:0/608219441 shutdown_connections 2023-10-21T18:28:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 --2- 172.21.15.12:0/608219441 >> v2:172.21.15.12:3300/0 conn(0x7f56640c59d0 0x7f5664151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 --2- 172.21.15.12:0/608219441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5664157cc0 0x7f5664150de0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 --2- 172.21.15.12:0/608219441 >> v2:172.21.15.99:3300/0 conn(0x7f56640c55f0 0x7f5664157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 -- 172.21.15.12:0/608219441 >> 172.21.15.12:0/608219441 conn(0x7f5664069de0 msgr2=0x7f566406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 -- 172.21.15.12:0/608219441 shutdown_connections 2023-10-21T18:28:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.239+0000 7f566bba9640 1 -- 172.21.15.12:0/608219441 wait complete. 2023-10-21T18:28:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.241+0000 7f566bba9640 1 Processor -- start 2023-10-21T18:28:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.242+0000 7f566bba9640 1 -- start start 2023-10-21T18:28:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56640c59d0 0x7f566414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5664157cc0 0x7f566414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566414bad0 con 0x7f5664157cc0 2023-10-21T18:28:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5664071dc0 con 0x7f56640c55f0 2023-10-21T18:28:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.243+0000 7f566bba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5664071b20 con 0x7f56640c59d0 2023-10-21T18:28:11.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.244+0000 7f5669945640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.244+0000 7f566a146640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5664157cc0 0x7f566414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.244+0000 7f5669945640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:36076/0 (socket says 172.21.15.12:36076) 2023-10-21T18:28:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.244+0000 7f5669945640 1 -- 172.21.15.12:0/366956337 learned_addr learned my addr 172.21.15.12:0/366956337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.245+0000 7f5669144640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56640c59d0 0x7f566414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.249+0000 7f5669945640 1 -- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56640c59d0 msgr2=0x7f566414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.249+0000 7f5669945640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56640c59d0 0x7f566414bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.249+0000 7f5669945640 1 -- 172.21.15.12:0/366956337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5664157cc0 msgr2=0x7f566414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.249+0000 7f5669945640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5664157cc0 0x7f566414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.249+0000 7f5669945640 1 -- 172.21.15.12:0/366956337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540094d0 con 0x7f56640c55f0 2023-10-21T18:28:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.254+0000 7f5669945640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f566000e870 tx=0x7f566000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.261+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566000ee60 con 0x7f56640c55f0 2023-10-21T18:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.261+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000c940 con 0x7f56640c55f0 2023-10-21T18:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.261+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566000ccf0 con 0x7f56640c55f0 2023-10-21T18:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.261+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5664149640 con 0x7f56640c55f0 2023-10-21T18:28:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.261+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5664149c00 con 0x7f56640c55f0 2023-10-21T18:28:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.262+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56640619f0 con 0x7f56640c55f0 2023-10-21T18:28:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.286+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5660013470 con 0x7f56640c55f0 2023-10-21T18:28:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.288+0000 7f565a7fc640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 0x7f564806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.288+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5660089d30 con 0x7f56640c55f0 2023-10-21T18:28:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.288+0000 7f5669144640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 0x7f564806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:11.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.289+0000 7f5669144640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 0x7f564806d380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5654036000 tx=0x7f5654008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:11.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.536+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5660054f30 con 0x7f56640c55f0 2023-10-21T18:28:11.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.764+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5664156d80 con 0x7f56640c55f0 2023-10-21T18:28:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.888+0000 7f565a7fc640 1 -- 172.21.15.12:0/366956337 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16520 (secure 0 0 0) 0x7f5660017090 con 0x7f56640c55f0 2023-10-21T18:28:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:57.353629+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T18:28:11.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 msgr2=0x7f564806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 0x7f564806d380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5654036000 tx=0x7f5654008030 comp rx=0 tx=0).stop 2023-10-21T18:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 msgr2=0x7f5664159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f566000e870 tx=0x7f566000ed30 comp rx=0 tx=0).stop 2023-10-21T18:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 shutdown_connections 2023-10-21T18:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.891+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f564806aec0 0x7f564806d380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5664157cc0 0x7f566414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56640c59d0 0x7f566414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 --2- 172.21.15.12:0/366956337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56640c55f0 0x7f5664159bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 >> 172.21.15.12:0/366956337 conn(0x7f5664069de0 msgr2=0x7f56640c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 shutdown_connections 2023-10-21T18:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:11.892+0000 7f566bba9640 1 -- 172.21.15.12:0/366956337 wait complete. 2023-10-21T18:28:11.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-21T16:27:08.552678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-21T16:27:27.920466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-21T16:27:29.996993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-21T18:28:11.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-21T18:28:12.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.167+0000 7f8472d0f640 1 Processor -- start 2023-10-21T18:28:12.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.168+0000 7f8472d0f640 1 -- start start 2023-10-21T18:28:12.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.169+0000 7f8472d0f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f846c151060 0x7f846c157570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.169+0000 7f8472d0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 0x7f846c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.169+0000 7f8472d0f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c1570e0 con 0x7f846c0cd000 2023-10-21T18:28:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.169+0000 7f8472d0f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c15a3f0 con 0x7f846c151060 2023-10-21T18:28:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.169+0000 7f8472d0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c2310 con 0x7f846c157ab0 2023-10-21T18:28:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.171+0000 7f846bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 0x7f846c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.171+0000 7f84712ac640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f846c0cd000 0x7f846c0c70b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55472/0 (socket says 172.21.15.12:55472) 2023-10-21T18:28:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.171+0000 7f84712ac640 1 -- 172.21.15.12:0/3769913916 learned_addr learned my addr 172.21.15.12:0/3769913916 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.171+0000 7f8470aab640 1 --2- 172.21.15.12:0/3769913916 >> v2:172.21.15.12:3300/0 conn(0x7f846c151060 0x7f846c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.173+0000 7f846bfff640 1 -- 172.21.15.12:0/3769913916 >> v2:172.21.15.12:3300/0 conn(0x7f846c151060 msgr2=0x7f846c157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.173+0000 7f846bfff640 1 --2- 172.21.15.12:0/3769913916 >> v2:172.21.15.12:3300/0 conn(0x7f846c151060 0x7f846c157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.173+0000 7f846bfff640 1 -- 172.21.15.12:0/3769913916 >> v1:172.21.15.12:6789/0 conn(0x7f846c0cd000 legacy=0x7f846c0c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.173+0000 7f846bfff640 1 -- 172.21.15.12:0/3769913916 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c156e00 con 0x7f846c157ab0 2023-10-21T18:28:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.175+0000 7f846bfff640 1 --2- 172.21.15.12:0/3769913916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 0x7f846c0ccac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f27d2f36275f67f server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.179+0000 7f846b7fe640 1 -- 172.21.15.12:0/3769913916 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030800 con 0x7f846c157ab0 2023-10-21T18:28:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.179+0000 7f846b7fe640 1 -- 172.21.15.12:0/3769913916 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454030960 con 0x7f846c157ab0 2023-10-21T18:28:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.179+0000 7f846b7fe640 1 -- 172.21.15.12:0/3769913916 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030cf0 con 0x7f846c157ab0 2023-10-21T18:28:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 -- 172.21.15.12:0/3769913916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 msgr2=0x7f846c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 --2- 172.21.15.12:0/3769913916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 0x7f846c0ccac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402b940 comp rx=0 tx=0).stop 2023-10-21T18:28:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 -- 172.21.15.12:0/3769913916 shutdown_connections 2023-10-21T18:28:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 --2- 172.21.15.12:0/3769913916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c157ab0 0x7f846c0ccac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 --2- 172.21.15.12:0/3769913916 >> v2:172.21.15.12:3300/0 conn(0x7f846c151060 0x7f846c157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 -- 172.21.15.12:0/3769913916 >> 172.21.15.12:0/3769913916 conn(0x7f846c065c90 msgr2=0x7f846c0660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 -- 172.21.15.12:0/3769913916 shutdown_connections 2023-10-21T18:28:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.180+0000 7f8472d0f640 1 -- 172.21.15.12:0/3769913916 wait complete. 2023-10-21T18:28:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.182+0000 7f8472d0f640 1 Processor -- start 2023-10-21T18:28:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.182+0000 7f8472d0f640 1 -- start start 2023-10-21T18:28:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 0x7f846c145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f846c157ab0 0x7f846c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1469c0 con 0x7f846c157ab0 2023-10-21T18:28:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0b05b0 con 0x7f846c151060 2023-10-21T18:28:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.183+0000 7f8472d0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c8e20 con 0x7f846c0cd000 2023-10-21T18:28:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.184+0000 7f8470aab640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.184+0000 7f846bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 0x7f846c145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.184+0000 7f8470aab640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:52954/0 (socket says 172.21.15.12:52954) 2023-10-21T18:28:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.184+0000 7f8470aab640 1 -- 172.21.15.12:0/2318113177 learned_addr learned my addr 172.21.15.12:0/2318113177 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.184+0000 7f84712ac640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f846c157ab0 0x7f846c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f846bfff640 1 -- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 msgr2=0x7f846c14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f846bfff640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f846bfff640 1 -- 172.21.15.12:0/2318113177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f846c157ab0 msgr2=0x7f846c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f846bfff640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f846c157ab0 0x7f846c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f846bfff640 1 -- 172.21.15.12:0/2318113177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009400 con 0x7f846c151060 2023-10-21T18:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.188+0000 7f8470aab640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.190+0000 7f846bfff640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 0x7f846c145f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8454033000 tx=0x7f84540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.194+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845403e070 con 0x7f846c151060 2023-10-21T18:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.194+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454039b20 con 0x7f846c151060 2023-10-21T18:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.194+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454042430 con 0x7f846c151060 2023-10-21T18:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.194+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0c8b40 con 0x7f846c151060 2023-10-21T18:28:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.194+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c1598b0 con 0x7f846c151060 2023-10-21T18:28:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.195+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c0619f0 con 0x7f846c151060 2023-10-21T18:28:12.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.215+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f845404a3f0 con 0x7f846c151060 2023-10-21T18:28:12.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.216+0000 7f84697fa640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 0x7f844c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.217+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f845407a0a0 con 0x7f846c151060 2023-10-21T18:28:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.217+0000 7f8470aab640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 0x7f844c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.217+0000 7f8470aab640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 0x7f844c06d3b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f845c003fc0 tx=0x7f845c009970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.457+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84540763e0 con 0x7f846c151060 2023-10-21T18:28:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.667+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f846c0c6b60 con 0x7f846c151060 2023-10-21T18:28:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.673+0000 7f84697fa640 1 -- 172.21.15.12:0/2318113177 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84540340a0 con 0x7f846c151060 2023-10-21T18:28:12.675 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-21T18:28:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.675+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 msgr2=0x7f844c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.675+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 0x7f844c06d3b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f845c003fc0 tx=0x7f845c009970 comp rx=0 tx=0).stop 2023-10-21T18:28:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.675+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 msgr2=0x7f846c145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.675+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 0x7f846c145f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8454033000 tx=0x7f84540046c0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 shutdown_connections 2023-10-21T18:28:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f844c06aef0 0x7f844c06d3b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f846c157ab0 0x7f846c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f846c151060 0x7f846c145f40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 --2- 172.21.15.12:0/2318113177 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f846c0cd000 0x7f846c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 >> 172.21.15.12:0/2318113177 conn(0x7f846c065c90 msgr2=0x7f846c154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 shutdown_connections 2023-10-21T18:28:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.676+0000 7f8472d0f640 1 -- 172.21.15.12:0/2318113177 wait complete. 2023-10-21T18:28:12.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-21T18:28:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.927+0000 7f51fc997640 1 Processor -- start 2023-10-21T18:28:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.928+0000 7f51fc997640 1 -- start start 2023-10-21T18:28:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.929+0000 7f51fc997640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 0x7f51f80c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.929+0000 7f51fc997640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f8156c00 con 0x7f51f80c3430 2023-10-21T18:28:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.929+0000 7f51fc997640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f80c2cc0 con 0x7f51f815c9d0 2023-10-21T18:28:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.929+0000 7f51fc997640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81594d0 con 0x7f51f8156820 2023-10-21T18:28:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.930+0000 7f51f659c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 0x7f51f80c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.930+0000 7f51f6d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f51f815c9d0 0x7f51f815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:58140/0 (socket says 172.21.15.12:58140) 2023-10-21T18:28:12.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.930+0000 7f51f6d9d640 1 -- 172.21.15.12:0/1426923310 learned_addr learned my addr 172.21.15.12:0/1426923310 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.932+0000 7f51f659c640 1 -- 172.21.15.12:0/1426923310 >> v1:172.21.15.99:6789/0 conn(0x7f51f815c9d0 legacy=0x7f51f815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.932+0000 7f51f659c640 1 -- 172.21.15.12:0/1426923310 >> v1:172.21.15.12:6789/0 conn(0x7f51f80c3430 legacy=0x7f51f80c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.932+0000 7f51f659c640 1 -- 172.21.15.12:0/1426923310 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f81597b0 con 0x7f51f8156820 2023-10-21T18:28:12.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.934+0000 7f51f659c640 1 --2- 172.21.15.12:0/1426923310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 0x7f51f80c23d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009dc0 tx=0x7f51e802bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84a6f2efc6c8e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.938+0000 7f51f559a640 1 -- 172.21.15.12:0/1426923310 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e802ccc0 con 0x7f51f8156820 2023-10-21T18:28:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.938+0000 7f51f559a640 1 -- 172.21.15.12:0/1426923310 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e802ce20 con 0x7f51f8156820 2023-10-21T18:28:12.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.938+0000 7f51f559a640 1 -- 172.21.15.12:0/1426923310 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8034660 con 0x7f51f8156820 2023-10-21T18:28:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 -- 172.21.15.12:0/1426923310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 msgr2=0x7f51f80c23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 --2- 172.21.15.12:0/1426923310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 0x7f51f80c23d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009dc0 tx=0x7f51e802bf10 comp rx=0 tx=0).stop 2023-10-21T18:28:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 -- 172.21.15.12:0/1426923310 shutdown_connections 2023-10-21T18:28:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 --2- 172.21.15.12:0/1426923310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f8156820 0x7f51f80c23d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 -- 172.21.15.12:0/1426923310 >> 172.21.15.12:0/1426923310 conn(0x7f51f806fbb0 msgr2=0x7f51f806ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:12.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 -- 172.21.15.12:0/1426923310 shutdown_connections 2023-10-21T18:28:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.939+0000 7f51fc997640 1 -- 172.21.15.12:0/1426923310 wait complete. 2023-10-21T18:28:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.941+0000 7f51fc997640 1 Processor -- start 2023-10-21T18:28:12.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.941+0000 7f51fc997640 1 -- start start 2023-10-21T18:28:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 0x7f51f815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 0x7f51f81e3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f815c9d0 0x7f51f814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81ef430 con 0x7f51f815c9d0 2023-10-21T18:28:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81ee8a0 con 0x7f51f8156820 2023-10-21T18:28:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.942+0000 7f51fc997640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81ef850 con 0x7f51f80c3430 2023-10-21T18:28:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.943+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 0x7f51f81e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.943+0000 7f51f6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f815c9d0 0x7f51f814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.943+0000 7f51f659c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 0x7f51f815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.943+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 0x7f51f81e3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44210/0 (socket says 172.21.15.12:44210) 2023-10-21T18:28:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.943+0000 7f51f5d9b640 1 -- 172.21.15.12:0/2337524644 learned_addr learned my addr 172.21.15.12:0/2337524644 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.947+0000 7f51f659c640 1 -- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 msgr2=0x7f51f81e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.947+0000 7f51f659c640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 0x7f51f81e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.947+0000 7f51f659c640 1 -- 172.21.15.12:0/2337524644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f815c9d0 msgr2=0x7f51f814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.947+0000 7f51f659c640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f815c9d0 0x7f51f814f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.947+0000 7f51f659c640 1 -- 172.21.15.12:0/2337524644 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009a70 con 0x7f51f80c3430 2023-10-21T18:28:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.949+0000 7f51f659c640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 0x7f51f815bc40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51e8033000 tx=0x7f51e8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.952+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e803e610 con 0x7f51f80c3430 2023-10-21T18:28:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.952+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e803e770 con 0x7f51f80c3430 2023-10-21T18:28:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.952+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f8154820 con 0x7f51f80c3430 2023-10-21T18:28:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.952+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e803eb00 con 0x7f51f80c3430 2023-10-21T18:28:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.952+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81eea90 con 0x7f51f80c3430 2023-10-21T18:28:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.954+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f81ef570 con 0x7f51f80c3430 2023-10-21T18:28:12.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.972+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51e803b050 con 0x7f51f80c3430 2023-10-21T18:28:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.973+0000 7f51eeffd640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.974+0000 7f51f5d9b640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:12.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.974+0000 7f51f5d9b640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 0x7f51d806d380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51f815c4f0 tx=0x7f51e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:12.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:12.975+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f51e807af70 con 0x7f51f80c3430 2023-10-21T18:28:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.213+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e80772b0 con 0x7f51f80c3430 2023-10-21T18:28:13.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.415+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51f81ef570 con 0x7f51f80c3430 2023-10-21T18:28:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.421+0000 7f51eeffd640 1 -- 172.21.15.12:0/2337524644 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51e8039020 con 0x7f51f80c3430 2023-10-21T18:28:13.423 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-21T18:28:13.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.423+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 msgr2=0x7f51d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.423+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 0x7f51d806d380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51f815c4f0 tx=0x7f51e0009040 comp rx=0 tx=0).stop 2023-10-21T18:28:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.423+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 msgr2=0x7f51f815bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.423+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 0x7f51f815bc40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51e8033000 tx=0x7f51e8004ab0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 shutdown_connections 2023-10-21T18:28:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51f815c9d0 0x7f51f814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f8156820 0x7f51f81e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 --2- 172.21.15.12:0/2337524644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51f80c3430 0x7f51f815bc40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 >> 172.21.15.12:0/2337524644 conn(0x7f51f806fbb0 msgr2=0x7f51f80c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 shutdown_connections 2023-10-21T18:28:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.424+0000 7f51fc997640 1 -- 172.21.15.12:0/2337524644 wait complete. 2023-10-21T18:28:13.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-21T18:28:13.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.675+0000 7f3ed6a15640 1 Processor -- start 2023-10-21T18:28:13.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.675+0000 7f3ed6a15640 1 -- start start 2023-10-21T18:28:13.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.676+0000 7f3ed6a15640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ed006aa70 0x7f3ed006af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:13.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.677+0000 7f3ed6a15640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed015d450 con 0x7f3ed00ca4f0 2023-10-21T18:28:13.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.677+0000 7f3ed6a15640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00ca930 con 0x7f3ed0153750 2023-10-21T18:28:13.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.677+0000 7f3ed6a15640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00b43c0 con 0x7f3ed006aa70 2023-10-21T18:28:13.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.677+0000 7f3ed4fb2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ed006aa70 0x7f3ed006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:13.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.678+0000 7f3ed4fb2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ed006aa70 0x7f3ed006af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44214/0 (socket says 172.21.15.12:44214) 2023-10-21T18:28:13.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.678+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/2455003020 learned_addr learned my addr 172.21.15.12:0/2455003020 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:13.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.680+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/2455003020 >> v1:172.21.15.99:6789/0 conn(0x7f3ed0153750 legacy=0x7f3ed00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.681+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/2455003020 >> v1:172.21.15.12:6789/0 conn(0x7f3ed00ca4f0 legacy=0x7f3ed00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.681+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/2455003020 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed006b440 con 0x7f3ed006aa70 2023-10-21T18:28:13.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.684+0000 7f3ed4fb2640 1 --2- 172.21.15.12:0/2455003020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed006aa70 0x7f3ed006af00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009870 tx=0x7f3ec802bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c0dca828ac72a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:13.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.688+0000 7f3eceffd640 1 -- 172.21.15.12:0/2455003020 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec802d880 con 0x7f3ed006aa70 2023-10-21T18:28:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.688+0000 7f3eceffd640 1 -- 172.21.15.12:0/2455003020 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec802d9e0 con 0x7f3ed006aa70 2023-10-21T18:28:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.688+0000 7f3eceffd640 1 -- 172.21.15.12:0/2455003020 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec802dd70 con 0x7f3ed006aa70 2023-10-21T18:28:13.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.688+0000 7f3ed6a15640 1 -- 172.21.15.12:0/2455003020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed006aa70 msgr2=0x7f3ed006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.688+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/2455003020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed006aa70 0x7f3ed006af00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009870 tx=0x7f3ec802bac0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.689+0000 7f3ed6a15640 1 -- 172.21.15.12:0/2455003020 shutdown_connections 2023-10-21T18:28:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.689+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/2455003020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed006aa70 0x7f3ed006af00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.689+0000 7f3ed6a15640 1 -- 172.21.15.12:0/2455003020 >> 172.21.15.12:0/2455003020 conn(0x7f3ed0065ab0 msgr2=0x7f3ed0065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.689+0000 7f3ed6a15640 1 -- 172.21.15.12:0/2455003020 shutdown_connections 2023-10-21T18:28:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.689+0000 7f3ed6a15640 1 -- 172.21.15.12:0/2455003020 wait complete. 2023-10-21T18:28:13.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.691+0000 7f3ed6a15640 1 Processor -- start 2023-10-21T18:28:13.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.691+0000 7f3ed6a15640 1 -- start start 2023-10-21T18:28:13.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed006aa70 0x7f3ed0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:13.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 0x7f3ed0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:13.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 0x7f3ed00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:13.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0156b50 con 0x7f3ed006aa70 2023-10-21T18:28:13.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed015a0d0 con 0x7f3ed0153750 2023-10-21T18:28:13.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.692+0000 7f3ed6a15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0156870 con 0x7f3ed00ca4f0 2023-10-21T18:28:13.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.693+0000 7f3ecf7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 0x7f3ed0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:13.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.693+0000 7f3ecffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed006aa70 0x7f3ed0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:13.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.693+0000 7f3ed4fb2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 0x7f3ed00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:13.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.693+0000 7f3ecf7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 0x7f3ed0159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41160/0 (socket says 172.21.15.12:41160) 2023-10-21T18:28:13.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.693+0000 7f3ecf7fe640 1 -- 172.21.15.12:0/1396001029 learned_addr learned my addr 172.21.15.12:0/1396001029 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.696+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 msgr2=0x7f3ed0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.696+0000 7f3ed4fb2640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 0x7f3ed0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.696+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/1396001029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed006aa70 msgr2=0x7f3ed0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.696+0000 7f3ed4fb2640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed006aa70 0x7f3ed0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:13.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.696+0000 7f3ed4fb2640 1 -- 172.21.15.12:0/1396001029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80094d0 con 0x7f3ed0153750 2023-10-21T18:28:13.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.699+0000 7f3ed4fb2640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 0x7f3ed00b2480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8033000 tx=0x7f3ec8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.702+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec803c040 con 0x7f3ed0153750 2023-10-21T18:28:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.702+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8037c60 con 0x7f3ed0153750 2023-10-21T18:28:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.703+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec802de50 con 0x7f3ed0153750 2023-10-21T18:28:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.703+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed01e50f0 con 0x7f3ed0153750 2023-10-21T18:28:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.703+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed014db40 con 0x7f3ed0153750 2023-10-21T18:28:13.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.704+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed01e4f50 con 0x7f3ed0153750 2023-10-21T18:28:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.962+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ec8041390 con 0x7f3ed0153750 2023-10-21T18:28:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.964+0000 7f3eccff9640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 0x7f3eb006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.965+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3ec8032070 con 0x7f3ed0153750 2023-10-21T18:28:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.965+0000 7f3ecffff640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 0x7f3eb006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.966+0000 7f3ecffff640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 0x7f3eb006d380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00012e0 tx=0x7f3ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:13.975+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ec80767b0 con 0x7f3ed0153750 2023-10-21T18:28:14.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.191+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ed01e4f50 con 0x7f3ed0153750 2023-10-21T18:28:14.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.399+0000 7f3eccff9640 1 -- 172.21.15.12:0/1396001029 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ec8047070 con 0x7f3ed0153750 2023-10-21T18:28:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-21T18:28:14.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 msgr2=0x7f3eb006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 0x7f3eb006d380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00012e0 tx=0x7f3ec0009040 comp rx=0 tx=0).stop 2023-10-21T18:28:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 msgr2=0x7f3ed00b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 0x7f3ed00b2480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8033000 tx=0x7f3ec8004730 comp rx=0 tx=0).stop 2023-10-21T18:28:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 shutdown_connections 2023-10-21T18:28:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f3eb006aec0 0x7f3eb006d380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ed0153750 0x7f3ed00b2480 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ed00ca4f0 0x7f3ed0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 --2- 172.21.15.12:0/1396001029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed006aa70 0x7f3ed0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.403+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 >> 172.21.15.12:0/1396001029 conn(0x7f3ed0065ab0 msgr2=0x7f3ed00cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:14.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.404+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 shutdown_connections 2023-10-21T18:28:14.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.404+0000 7f3ed6a15640 1 -- 172.21.15.12:0/1396001029 wait complete. 2023-10-21T18:28:14.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-21T18:28:14.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.705+0000 7f23f88bb640 1 Processor -- start 2023-10-21T18:28:14.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.705+0000 7f23f88bb640 1 -- start start 2023-10-21T18:28:14.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f88bb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23f40c7e90 0x7f23f406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f88bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23f4159470 0x7f23f4159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f88bb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f4153850 con 0x7f23f406b7d0 2023-10-21T18:28:14.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f88bb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f406c0f0 con 0x7f23f40c7e90 2023-10-21T18:28:14.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f88bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f40c7160 con 0x7f23f4159470 2023-10-21T18:28:14.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.707+0000 7f23f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23f4159470 0x7f23f4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.708+0000 7f23f3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23f4159470 0x7f23f4159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44230/0 (socket says 172.21.15.12:44230) 2023-10-21T18:28:14.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.708+0000 7f23f3fff640 1 -- 172.21.15.12:0/4116241060 learned_addr learned my addr 172.21.15.12:0/4116241060 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:14.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.708+0000 7f23f2ffd640 1 --2- 172.21.15.12:0/4116241060 >> v2:172.21.15.12:3300/0 conn(0x7f23f40c7e90 0x7f23f406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.710+0000 7f23f3fff640 1 -- 172.21.15.12:0/4116241060 >> v2:172.21.15.12:3300/0 conn(0x7f23f40c7e90 msgr2=0x7f23f406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:14.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.710+0000 7f23f3fff640 1 --2- 172.21.15.12:0/4116241060 >> v2:172.21.15.12:3300/0 conn(0x7f23f40c7e90 0x7f23f406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.710+0000 7f23f3fff640 1 -- 172.21.15.12:0/4116241060 >> v1:172.21.15.12:6789/0 conn(0x7f23f406b7d0 legacy=0x7f23f415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.710+0000 7f23f3fff640 1 -- 172.21.15.12:0/4116241060 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f406b070 con 0x7f23f4159470 2023-10-21T18:28:14.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.713+0000 7f23f3fff640 1 --2- 172.21.15.12:0/4116241060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f4159470 0x7f23f4159880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23f4066ae0 tx=0x7f23ec02bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b971ee2aeb79a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f27fc640 1 -- 172.21.15.12:0/4116241060 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec02cb10 con 0x7f23f4159470 2023-10-21T18:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f27fc640 1 -- 172.21.15.12:0/4116241060 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec02cc70 con 0x7f23f4159470 2023-10-21T18:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f27fc640 1 -- 172.21.15.12:0/4116241060 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0343f0 con 0x7f23f4159470 2023-10-21T18:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 -- 172.21.15.12:0/4116241060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f4159470 msgr2=0x7f23f4159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 --2- 172.21.15.12:0/4116241060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f4159470 0x7f23f4159880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23f4066ae0 tx=0x7f23ec02bf70 comp rx=0 tx=0).stop 2023-10-21T18:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 -- 172.21.15.12:0/4116241060 shutdown_connections 2023-10-21T18:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 --2- 172.21.15.12:0/4116241060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f4159470 0x7f23f4159880 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 --2- 172.21.15.12:0/4116241060 >> v2:172.21.15.12:3300/0 conn(0x7f23f40c7e90 0x7f23f406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.717+0000 7f23f88bb640 1 -- 172.21.15.12:0/4116241060 >> 172.21.15.12:0/4116241060 conn(0x7f23f4065ab0 msgr2=0x7f23f4065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.718+0000 7f23f88bb640 1 -- 172.21.15.12:0/4116241060 shutdown_connections 2023-10-21T18:28:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.718+0000 7f23f88bb640 1 -- 172.21.15.12:0/4116241060 wait complete. 2023-10-21T18:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.719+0000 7f23f88bb640 1 Processor -- start 2023-10-21T18:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.719+0000 7f23f88bb640 1 -- start start 2023-10-21T18:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f406b7d0 0x7f23f40adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 0x7f23f41f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 0x7f23f41f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f41e2be0 con 0x7f23f406b7d0 2023-10-21T18:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f4154280 con 0x7f23f40c7e90 2023-10-21T18:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.720+0000 7f23f88bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f41e2260 con 0x7f23f4159470 2023-10-21T18:28:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.721+0000 7f23f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f406b7d0 0x7f23f40adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.721+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 0x7f23f41f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.721+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 0x7f23f41f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.722+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 0x7f23f41f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41162/0 (socket says 172.21.15.12:41162) 2023-10-21T18:28:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.722+0000 7f23f3fff640 1 -- 172.21.15.12:0/754419195 learned_addr learned my addr 172.21.15.12:0/754419195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.725+0000 7f23f2ffd640 1 -- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 msgr2=0x7f23f41f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.725+0000 7f23f2ffd640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 0x7f23f41f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.725+0000 7f23f2ffd640 1 -- 172.21.15.12:0/754419195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f406b7d0 msgr2=0x7f23f40adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.725+0000 7f23f2ffd640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f406b7d0 0x7f23f40adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.725+0000 7f23f2ffd640 1 -- 172.21.15.12:0/754419195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec009b30 con 0x7f23f40c7e90 2023-10-21T18:28:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.727+0000 7f23f2ffd640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 0x7f23f41f0b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23e800e870 tx=0x7f23e800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.731+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800ee60 con 0x7f23f40c7e90 2023-10-21T18:28:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.731+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800c940 con 0x7f23f40c7e90 2023-10-21T18:28:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.731+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800ccd0 con 0x7f23f40c7e90 2023-10-21T18:28:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.731+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f41f1730 con 0x7f23f40c7e90 2023-10-21T18:28:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.731+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f41e2520 con 0x7f23f40c7e90 2023-10-21T18:28:14.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.732+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f4067560 con 0x7f23f40c7e90 2023-10-21T18:28:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.752+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f23e8013470 con 0x7f23f40c7e90 2023-10-21T18:28:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.753+0000 7f23dbfff640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 0x7f23e006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.753+0000 7f23f37fe640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 0x7f23e006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.754+0000 7f23f37fe640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 0x7f23e006d3b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f60 tx=0x7f23e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.754+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f23e800ce30 con 0x7f23f40c7e90 2023-10-21T18:28:14.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:14.989+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23e8054e50 con 0x7f23f40c7e90 2023-10-21T18:28:15.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.220+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23f4159a10 con 0x7f23f40c7e90 2023-10-21T18:28:15.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.233+0000 7f23dbfff640 1 -- 172.21.15.12:0/754419195 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23e8021020 con 0x7f23f40c7e90 2023-10-21T18:28:15.236 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-21T18:28:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.236+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 msgr2=0x7f23e006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.236+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 0x7f23e006d3b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f60 tx=0x7f23e4009040 comp rx=0 tx=0).stop 2023-10-21T18:28:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 msgr2=0x7f23f41f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 0x7f23f41f0b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23e800e870 tx=0x7f23e800ed30 comp rx=0 tx=0).stop 2023-10-21T18:28:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 shutdown_connections 2023-10-21T18:28:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f23e006aef0 0x7f23e006d3b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:15.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23f4159470 0x7f23f41f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:15.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40c7e90 0x7f23f41f0b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:15.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 --2- 172.21.15.12:0/754419195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f406b7d0 0x7f23f40adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:15.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 >> 172.21.15.12:0/754419195 conn(0x7f23f4065ab0 msgr2=0x7f23f4152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:15.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 shutdown_connections 2023-10-21T18:28:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:15.237+0000 7f23f88bb640 1 -- 172.21.15.12:0/754419195 wait complete. 2023-10-21T18:28:15.262 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-21T18:28:15.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T18:28:15.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-21T18:28:15.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:28:15.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T18:28:15.801 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-21T18:28:15.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T18:28:15.866 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-21T18:28:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-21T18:28:15.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T18:28:15.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-21T18:28:16.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-21T18:28:16.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-21T18:28:16.108 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-21T18:28:16.117 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-21T18:28:16.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:28:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.317+0000 7ff8fec21640 1 Processor -- start 2023-10-21T18:28:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.317+0000 7ff8fec21640 1 -- start start 2023-10-21T18:28:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fec21640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8f80c8ca0 0x7ff8f80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fec21640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8f80ca760 0x7ff8f806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fec21640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f80cab90 con 0x7ff8f814f6a0 2023-10-21T18:28:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fec21640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80c61d0 con 0x7ff8f80c8ca0 2023-10-21T18:28:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fec21640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80c1000 con 0x7ff8f80ca760 2023-10-21T18:28:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.319+0000 7ff8fd1be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8f80ca760 0x7ff8f806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.320+0000 7ff8fd1be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8f80ca760 0x7ff8f806bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44248/0 (socket says 172.21.15.12:44248) 2023-10-21T18:28:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.320+0000 7ff8fd1be640 1 -- 172.21.15.12:0/3935251174 learned_addr learned my addr 172.21.15.12:0/3935251174 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.322+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/3935251174 >> v2:172.21.15.12:3300/0 conn(0x7ff8f80c8ca0 0x7ff8f80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.322+0000 7ff8fd1be640 1 -- 172.21.15.12:0/3935251174 >> v2:172.21.15.12:3300/0 conn(0x7ff8f80c8ca0 msgr2=0x7ff8f80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.322+0000 7ff8fd1be640 1 --2- 172.21.15.12:0/3935251174 >> v2:172.21.15.12:3300/0 conn(0x7ff8f80c8ca0 0x7ff8f80c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.322+0000 7ff8fd1be640 1 -- 172.21.15.12:0/3935251174 >> v1:172.21.15.12:6789/0 conn(0x7ff8f814f6a0 legacy=0x7ff8f80c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.322+0000 7ff8fd1be640 1 -- 172.21.15.12:0/3935251174 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80c9d90 con 0x7ff8f80ca760 2023-10-21T18:28:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.330+0000 7ff8fd1be640 1 --2- 172.21.15.12:0/3935251174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f80ca760 0x7ff8f806bdc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8153040 tx=0x7ff8f002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea89af2440859b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.379+0000 7ff8f77fe640 1 -- 172.21.15.12:0/3935251174 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f002cb20 con 0x7ff8f80ca760 2023-10-21T18:28:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.379+0000 7ff8f77fe640 1 -- 172.21.15.12:0/3935251174 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f002cc80 con 0x7ff8f80ca760 2023-10-21T18:28:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.379+0000 7ff8f77fe640 1 -- 172.21.15.12:0/3935251174 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00343f0 con 0x7ff8f80ca760 2023-10-21T18:28:16.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 -- 172.21.15.12:0/3935251174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f80ca760 msgr2=0x7ff8f806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 --2- 172.21.15.12:0/3935251174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f80ca760 0x7ff8f806bdc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8153040 tx=0x7ff8f002bf80 comp rx=0 tx=0).stop 2023-10-21T18:28:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 -- 172.21.15.12:0/3935251174 shutdown_connections 2023-10-21T18:28:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 --2- 172.21.15.12:0/3935251174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f80ca760 0x7ff8f806bdc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 --2- 172.21.15.12:0/3935251174 >> v2:172.21.15.12:3300/0 conn(0x7ff8f80c8ca0 0x7ff8f80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 -- 172.21.15.12:0/3935251174 >> 172.21.15.12:0/3935251174 conn(0x7ff8f80cb200 msgr2=0x7ff8f80cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.380+0000 7ff8fec21640 1 -- 172.21.15.12:0/3935251174 shutdown_connections 2023-10-21T18:28:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.381+0000 7ff8fec21640 1 -- 172.21.15.12:0/3935251174 wait complete. 2023-10-21T18:28:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.383+0000 7ff8fec21640 1 Processor -- start 2023-10-21T18:28:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.383+0000 7ff8fec21640 1 -- start start 2023-10-21T18:28:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.384+0000 7ff8fec21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80c8ca0 0x7ff8f8071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.385+0000 7ff8fec21640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.385+0000 7ff8fec21640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f814f6a0 0x7ff8f81ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.385+0000 7ff8fec21640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81ee7e0 con 0x7ff8f80c8ca0 2023-10-21T18:28:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.385+0000 7ff8fec21640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81f2a70 con 0x7ff8f814f6a0 2023-10-21T18:28:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.385+0000 7ff8fec21640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81f1ef0 con 0x7ff8f80ca760 2023-10-21T18:28:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.386+0000 7ff8f7fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.386+0000 7ff8f7fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41176/0 (socket says 172.21.15.12:41176) 2023-10-21T18:28:16.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.386+0000 7ff8f7fff640 1 -- 172.21.15.12:0/781483691 learned_addr learned my addr 172.21.15.12:0/781483691 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:16.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.388+0000 7ff8fc9bd640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80c8ca0 0x7ff8f8071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.391+0000 7ff8f7fff640 1 -- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f814f6a0 msgr2=0x7ff8f81ef1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.391+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f814f6a0 0x7ff8f81ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.391+0000 7ff8f7fff640 1 -- 172.21.15.12:0/781483691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80c8ca0 msgr2=0x7ff8f8071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.391+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80c8ca0 0x7ff8f8071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.391+0000 7ff8f7fff640 1 -- 172.21.15.12:0/781483691 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009b30 con 0x7ff8f80ca760 2023-10-21T18:28:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.398+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c7f0 tx=0x7ff8e400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:16.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.402+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4004220 con 0x7ff8f80ca760 2023-10-21T18:28:16.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.402+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4004380 con 0x7ff8f80ca760 2023-10-21T18:28:16.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.402+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4007840 con 0x7ff8f80ca760 2023-10-21T18:28:16.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.402+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f81f21d0 con 0x7ff8f80ca760 2023-10-21T18:28:16.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.402+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81f2790 con 0x7ff8f80ca760 2023-10-21T18:28:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.404+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f80619f0 con 0x7ff8f80ca760 2023-10-21T18:28:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.423+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8e4007bb0 con 0x7ff8f80ca760 2023-10-21T18:28:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.424+0000 7ff8f57fa640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 0x7ff8dc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.424+0000 7ff8fc9bd640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 0x7ff8dc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.425+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff8e4058720 con 0x7ff8f80ca760 2023-10-21T18:28:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.425+0000 7ff8fc9bd640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 0x7ff8dc06d380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0017f0 tx=0x7ff8ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.661+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8e4054a60 con 0x7ff8f80ca760 2023-10-21T18:28:16.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.881+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8f80ca350 con 0x7ff8dc06aec0 2023-10-21T18:28:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.891+0000 7ff8f57fa640 1 -- 172.21.15.12:0/781483691 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289646 (secure 0 0 0) 0x7ff8ec001440 con 0x7ff8dc06aec0 2023-10-21T18:28:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:16.899 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:28:16.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 msgr2=0x7ff8dc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:16.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 0x7ff8dc06d380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0017f0 tx=0x7ff8ec009040 comp rx=0 tx=0).stop 2023-10-21T18:28:16.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 msgr2=0x7ff8f81eec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:16.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c7f0 tx=0x7ff8e400ccb0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 shutdown_connections 2023-10-21T18:28:16.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff8dc06aec0 0x7ff8dc06d380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8f814f6a0 0x7ff8f81ef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8f80ca760 0x7ff8f81eec70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 --2- 172.21.15.12:0/781483691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80c8ca0 0x7ff8f8071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 >> 172.21.15.12:0/781483691 conn(0x7ff8f80cb200 msgr2=0x7ff8f8065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 shutdown_connections 2023-10-21T18:28:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:16.899+0000 7ff8fec21640 1 -- 172.21.15.12:0/781483691 wait complete. 2023-10-21T18:28:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3655,"stamp":"2023-10-21T18:28:15.133903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216928687,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2669,"num_read_kb":3400355,"num_write":48786,"num_write_kb":4575225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49863,"ondisk_log_size":49863,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":962536,"kb_used_data":425768,"kb_used_omap":12,"kb_used_meta":536691,"kb_avail":754012184,"statfs":{"total":773094113280,"available":772108476416,"internally_reserved":0,"allocated":435986432,"data_stored":434610773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":549572154},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65527,"num_objects":-44,"num_object_clones":0,"num_object_copies":-88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":85,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003373"},"pg_stats":[{"pgid":"3.3f","version":"25'403","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.712606+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T18:27:58.712606+0000","last_peered":"2023-10-21T18:27:58.712606+0000","last_clean":"2023-10-21T18:27:58.712606+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:27:58.712606+0000","last_undegraded":"2023-10-21T18:27:58.712606+0000","last_fullsized":"2023-10-21T18:27:58.712606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'416","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876126+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T18:27:42.876126+0000","last_peered":"2023-10-21T18:27:42.876126+0000","last_clean":"2023-10-21T18:27:42.876126+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:27:42.876126+0000","last_undegraded":"2023-10-21T18:27:42.876126+0000","last_fullsized":"2023-10-21T18:27:42.876126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'367","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.847865+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T18:27:42.847865+0000","last_peered":"2023-10-21T18:27:42.847865+0000","last_clean":"2023-10-21T18:27:42.847865+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:27:42.847865+0000","last_undegraded":"2023-10-21T18:27:42.847865+0000","last_fullsized":"2023-10-21T18:27:42.847865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.665547+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T18:27:48.665547+0000","last_peered":"2023-10-21T18:27:48.665547+0000","last_clean":"2023-10-21T18:27:48.665547+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:27:48.665547+0000","last_undegraded":"2023-10-21T18:27:48.665547+0000","last_fullsized":"2023-10-21T18:27:48.665547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'421","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.692950+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:27:58.692950+0000","last_peered":"2023-10-21T18:27:58.692950+0000","last_clean":"2023-10-21T18:27:58.692950+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:27:58.692950+0000","last_undegraded":"2023-10-21T18:27:58.692950+0000","last_fullsized":"2023-10-21T18:27:58.692950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:21:43.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'379","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.779286+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T18:27:37.779286+0000","last_peered":"2023-10-21T18:27:37.779286+0000","last_clean":"2023-10-21T18:27:37.779286+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:27:37.779286+0000","last_undegraded":"2023-10-21T18:27:37.779286+0000","last_fullsized":"2023-10-21T18:27:37.779286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.784262+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T18:27:37.784262+0000","last_peered":"2023-10-21T18:27:37.784262+0000","last_clean":"2023-10-21T18:27:37.784262+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:27:37.784262+0000","last_undegraded":"2023-10-21T18:27:37.784262+0000","last_fullsized":"2023-10-21T18:27:37.784262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'377","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.344409+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:27:33.344409+0000","last_peered":"2023-10-21T18:27:33.344409+0000","last_clean":"2023-10-21T18:27:33.344409+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:27:33.344409+0000","last_undegraded":"2023-10-21T18:27:33.344409+0000","last_fullsized":"2023-10-21T18:27:33.344409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'421","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.801302+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T18:27:48.801302+0000","last_peered":"2023-10-21T18:27:48.801302+0000","last_clean":"2023-10-21T18:27:48.801302+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:27:48.801302+0000","last_undegraded":"2023-10-21T18:27:48.801302+0000","last_fullsized":"2023-10-21T18:27:48.801302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'405","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.787014+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T18:27:37.787014+0000","last_peered":"2023-10-21T18:27:37.787014+0000","last_clean":"2023-10-21T18:27:37.787014+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:27:37.787014+0000","last_undegraded":"2023-10-21T18:27:37.787014+0000","last_fullsized":"2023-10-21T18:27:37.787014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'362","reported_seq":432,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876147+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T18:27:42.876147+0000","last_peered":"2023-10-21T18:27:42.876147+0000","last_clean":"2023-10-21T18:27:42.876147+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:27:42.876147+0000","last_undegraded":"2023-10-21T18:27:42.876147+0000","last_fullsized":"2023-10-21T18:27:42.876147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'365","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.338666+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T18:26:58.338666+0000","last_peered":"2023-10-21T18:26:58.338666+0000","last_clean":"2023-10-21T18:26:58.338666+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:26:58.338666+0000","last_undegraded":"2023-10-21T18:26:58.338666+0000","last_fullsized":"2023-10-21T18:26:58.338666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'405","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967931+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T18:27:42.967931+0000","last_peered":"2023-10-21T18:27:42.967931+0000","last_clean":"2023-10-21T18:27:42.967931+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:27:42.967931+0000","last_undegraded":"2023-10-21T18:27:42.967931+0000","last_fullsized":"2023-10-21T18:27:42.967931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'403","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.736421+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T18:27:48.736421+0000","last_peered":"2023-10-21T18:27:48.736421+0000","last_clean":"2023-10-21T18:27:48.736421+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:27:48.736421+0000","last_undegraded":"2023-10-21T18:27:48.736421+0000","last_fullsized":"2023-10-21T18:27:48.736421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'424","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.707424+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T18:27:58.707424+0000","last_peered":"2023-10-21T18:27:58.707424+0000","last_clean":"2023-10-21T18:27:58.707424+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:27:58.707424+0000","last_undegraded":"2023-10-21T18:27:58.707424+0000","last_fullsized":"2023-10-21T18:27:58.707424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'421","reported_seq":510,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.177241+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T18:27:27.177241+0000","last_peered":"2023-10-21T18:27:27.177241+0000","last_clean":"2023-10-21T18:27:27.177241+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:27:27.177241+0000","last_undegraded":"2023-10-21T18:27:27.177241+0000","last_fullsized":"2023-10-21T18:27:27.177241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'456","reported_seq":558,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.811937+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:27:42.811937+0000","last_peered":"2023-10-21T18:27:42.811937+0000","last_clean":"2023-10-21T18:27:42.811937+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:27:42.811937+0000","last_undegraded":"2023-10-21T18:27:42.811937+0000","last_fullsized":"2023-10-21T18:27:42.811937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'390","reported_seq":474,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.869493+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T18:27:42.869493+0000","last_peered":"2023-10-21T18:27:42.869493+0000","last_clean":"2023-10-21T18:27:42.869493+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:27:42.869493+0000","last_undegraded":"2023-10-21T18:27:42.869493+0000","last_fullsized":"2023-10-21T18:27:42.869493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'399","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051608+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:27:43.051608+0000","last_peered":"2023-10-21T18:27:43.051608+0000","last_clean":"2023-10-21T18:27:43.051608+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:27:43.051608+0000","last_undegraded":"2023-10-21T18:27:43.051608+0000","last_fullsized":"2023-10-21T18:27:43.051608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'429","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226963+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T18:28:04.226963+0000","last_peered":"2023-10-21T18:28:04.226963+0000","last_clean":"2023-10-21T18:28:04.226963+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:28:04.226963+0000","last_undegraded":"2023-10-21T18:28:04.226963+0000","last_fullsized":"2023-10-21T18:28:04.226963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'391","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222352+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T18:27:27.222352+0000","last_peered":"2023-10-21T18:27:27.222352+0000","last_clean":"2023-10-21T18:27:27.222352+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:27:27.222352+0000","last_undegraded":"2023-10-21T18:27:27.222352+0000","last_fullsized":"2023-10-21T18:27:27.222352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'446","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434630+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T18:27:54.434630+0000","last_peered":"2023-10-21T18:27:54.434630+0000","last_clean":"2023-10-21T18:27:54.434630+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:27:54.434630+0000","last_undegraded":"2023-10-21T18:27:54.434630+0000","last_fullsized":"2023-10-21T18:27:54.434630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'391","reported_seq":471,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737511+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T18:27:48.737511+0000","last_peered":"2023-10-21T18:27:48.737511+0000","last_clean":"2023-10-21T18:27:48.737511+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:27:48.737511+0000","last_undegraded":"2023-10-21T18:27:48.737511+0000","last_fullsized":"2023-10-21T18:27:48.737511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'402","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.241274+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T18:28:04.241274+0000","last_peered":"2023-10-21T18:28:04.241274+0000","last_clean":"2023-10-21T18:28:04.241274+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:04.241274+0000","last_undegraded":"2023-10-21T18:28:04.241274+0000","last_fullsized":"2023-10-21T18:28:04.241274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'402","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432920+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:27:54.432920+0000","last_peered":"2023-10-21T18:27:54.432920+0000","last_clean":"2023-10-21T18:27:54.432920+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:27:54.432920+0000","last_undegraded":"2023-10-21T18:27:54.432920+0000","last_fullsized":"2023-10-21T18:27:54.432920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'482","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.317127+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T18:27:27.317127+0000","last_peered":"2023-10-21T18:27:27.317127+0000","last_clean":"2023-10-21T18:27:27.317127+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:27:27.317127+0000","last_undegraded":"2023-10-21T18:27:27.317127+0000","last_fullsized":"2023-10-21T18:27:27.317127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'415","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.702102+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T18:27:58.702102+0000","last_peered":"2023-10-21T18:27:58.702102+0000","last_clean":"2023-10-21T18:27:58.702102+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:27:58.702102+0000","last_undegraded":"2023-10-21T18:27:58.702102+0000","last_fullsized":"2023-10-21T18:27:58.702102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'400","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.348099+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T18:27:33.348099+0000","last_peered":"2023-10-21T18:27:33.348099+0000","last_clean":"2023-10-21T18:27:33.348099+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:27:33.348099+0000","last_undegraded":"2023-10-21T18:27:33.348099+0000","last_fullsized":"2023-10-21T18:27:33.348099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'393","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.427953+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T18:27:54.427953+0000","last_peered":"2023-10-21T18:27:54.427953+0000","last_clean":"2023-10-21T18:27:54.427953+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:27:54.427953+0000","last_undegraded":"2023-10-21T18:27:54.427953+0000","last_fullsized":"2023-10-21T18:27:54.427953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'461","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.428419+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:27:54.428419+0000","last_peered":"2023-10-21T18:27:54.428419+0000","last_clean":"2023-10-21T18:27:54.428419+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:27:54.428419+0000","last_undegraded":"2023-10-21T18:27:54.428419+0000","last_fullsized":"2023-10-21T18:27:54.428419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'447","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.328081+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T18:27:54.328081+0000","last_peered":"2023-10-21T18:27:54.328081+0000","last_clean":"2023-10-21T18:27:54.328081+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:27:54.328081+0000","last_undegraded":"2023-10-21T18:27:54.328081+0000","last_fullsized":"2023-10-21T18:27:54.328081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'418","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.054873+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T18:27:05.054873+0000","last_peered":"2023-10-21T18:27:05.054873+0000","last_clean":"2023-10-21T18:27:05.054873+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:27:05.054873+0000","last_undegraded":"2023-10-21T18:27:05.054873+0000","last_fullsized":"2023-10-21T18:27:05.054873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'411","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.749356+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T18:27:58.749356+0000","last_peered":"2023-10-21T18:27:58.749356+0000","last_clean":"2023-10-21T18:27:58.749356+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:27:58.749356+0000","last_undegraded":"2023-10-21T18:27:58.749356+0000","last_fullsized":"2023-10-21T18:27:58.749356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'222","reported_seq":284,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.046052+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T18:27:05.046052+0000","last_peered":"2023-10-21T18:27:05.046052+0000","last_clean":"2023-10-21T18:27:05.046052+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:27:05.046052+0000","last_undegraded":"2023-10-21T18:27:05.046052+0000","last_fullsized":"2023-10-21T18:27:05.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.711894+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T18:27:58.711894+0000","last_peered":"2023-10-21T18:27:58.711894+0000","last_clean":"2023-10-21T18:27:58.711894+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:27:58.711894+0000","last_undegraded":"2023-10-21T18:27:58.711894+0000","last_fullsized":"2023-10-21T18:27:58.711894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1317","reported_seq":1379,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.451979+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T18:27:29.451979+0000","last_peered":"2023-10-21T18:27:29.451979+0000","last_clean":"2023-10-21T18:27:29.451979+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:27:29.451979+0000","last_undegraded":"2023-10-21T18:27:29.451979+0000","last_fullsized":"2023-10-21T18:27:29.451979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'775","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:27.483016+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T18:26:27.483016+0000","last_peered":"2023-10-21T18:26:27.483016+0000","last_clean":"2023-10-21T18:26:27.483016+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:26:27.483016+0000","last_undegraded":"2023-10-21T18:26:27.483016+0000","last_fullsized":"2023-10-21T18:26:27.483016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'461","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.234570+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:04.234570+0000","last_peered":"2023-10-21T18:28:04.234570+0000","last_clean":"2023-10-21T18:28:04.234570+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:04.234570+0000","last_undegraded":"2023-10-21T18:28:04.234570+0000","last_fullsized":"2023-10-21T18:28:04.234570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'904","reported_seq":967,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:54.821337+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T18:25:54.821337+0000","last_peered":"2023-10-21T18:25:54.821337+0000","last_clean":"2023-10-21T18:25:54.821337+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:25:54.821337+0000","last_undegraded":"2023-10-21T18:25:54.821337+0000","last_fullsized":"2023-10-21T18:25:54.821337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'404","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222280+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T18:27:27.222280+0000","last_peered":"2023-10-21T18:27:27.222280+0000","last_clean":"2023-10-21T18:27:27.222280+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:27:27.222280+0000","last_undegraded":"2023-10-21T18:27:27.222280+0000","last_fullsized":"2023-10-21T18:27:27.222280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:08.791748+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T18:25:08.791748+0000","last_peered":"2023-10-21T18:25:08.791748+0000","last_clean":"2023-10-21T18:25:08.791748+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:25:08.791748+0000","last_undegraded":"2023-10-21T18:25:08.791748+0000","last_fullsized":"2023-10-21T18:25:08.791748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'410","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329141+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T18:27:33.329141+0000","last_peered":"2023-10-21T18:27:33.329141+0000","last_clean":"2023-10-21T18:27:33.329141+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:27:33.329141+0000","last_undegraded":"2023-10-21T18:27:33.329141+0000","last_fullsized":"2023-10-21T18:27:33.329141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1384","reported_seq":1447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:11.595704+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T18:28:11.595704+0000","last_peered":"2023-10-21T18:28:11.595704+0000","last_clean":"2023-10-21T18:28:11.595704+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:11.595704+0000","last_undegraded":"2023-10-21T18:28:11.595704+0000","last_fullsized":"2023-10-21T18:28:11.595704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13547777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":13902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'406","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.877687+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:27:42.877687+0000","last_peered":"2023-10-21T18:27:42.877687+0000","last_clean":"2023-10-21T18:27:42.877687+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:27:42.877687+0000","last_undegraded":"2023-10-21T18:27:42.877687+0000","last_fullsized":"2023-10-21T18:27:42.877687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1992","reported_seq":2055,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.773714+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T18:28:04.773714+0000","last_peered":"2023-10-21T18:28:04.773714+0000","last_clean":"2023-10-21T18:28:04.773714+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:04.773714+0000","last_undegraded":"2023-10-21T18:28:04.773714+0000","last_fullsized":"2023-10-21T18:28:04.773714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":9723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'393","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432568+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:27:54.432568+0000","last_peered":"2023-10-21T18:27:54.432568+0000","last_clean":"2023-10-21T18:27:54.432568+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:27:54.432568+0000","last_undegraded":"2023-10-21T18:27:54.432568+0000","last_fullsized":"2023-10-21T18:27:54.432568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1719","reported_seq":1784,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:56.446128+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T18:27:56.446128+0000","last_peered":"2023-10-21T18:27:56.446128+0000","last_clean":"2023-10-21T18:27:56.446128+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:27:56.446128+0000","last_undegraded":"2023-10-21T18:27:56.446128+0000","last_fullsized":"2023-10-21T18:27:56.446128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'394","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.785294+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T18:27:37.785294+0000","last_peered":"2023-10-21T18:27:37.785294+0000","last_clean":"2023-10-21T18:27:37.785294+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:27:37.785294+0000","last_undegraded":"2023-10-21T18:27:37.785294+0000","last_fullsized":"2023-10-21T18:27:37.785294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'322","reported_seq":387,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.534971+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T18:26:31.534971+0000","last_peered":"2023-10-21T18:26:31.534971+0000","last_clean":"2023-10-21T18:26:31.534971+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:26:31.534971+0000","last_undegraded":"2023-10-21T18:26:31.534971+0000","last_fullsized":"2023-10-21T18:26:31.534971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'379","reported_seq":453,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.347969+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T18:27:33.347969+0000","last_peered":"2023-10-21T18:27:33.347969+0000","last_clean":"2023-10-21T18:27:33.347969+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:27:33.347969+0000","last_undegraded":"2023-10-21T18:27:33.347969+0000","last_fullsized":"2023-10-21T18:27:33.347969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.568467+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:10.568467+0000","last_peered":"2023-10-21T18:28:10.568467+0000","last_clean":"2023-10-21T18:28:10.568467+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:10.568467+0000","last_undegraded":"2023-10-21T18:28:10.568467+0000","last_fullsized":"2023-10-21T18:28:10.568467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'421","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.239805+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:04.239805+0000","last_peered":"2023-10-21T18:28:04.239805+0000","last_clean":"2023-10-21T18:28:04.239805+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:04.239805+0000","last_undegraded":"2023-10-21T18:28:04.239805+0000","last_fullsized":"2023-10-21T18:28:04.239805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.763257+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T18:26:14.763257+0000","last_peered":"2023-10-21T18:26:14.763257+0000","last_clean":"2023-10-21T18:26:14.763257+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:26:14.763257+0000","last_undegraded":"2023-10-21T18:26:14.763257+0000","last_fullsized":"2023-10-21T18:26:14.763257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'421","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434652+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T18:27:54.434652+0000","last_peered":"2023-10-21T18:27:54.434652+0000","last_clean":"2023-10-21T18:27:54.434652+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:27:54.434652+0000","last_undegraded":"2023-10-21T18:27:54.434652+0000","last_fullsized":"2023-10-21T18:27:54.434652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'813","reported_seq":878,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:32.552240+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T18:26:32.552240+0000","last_peered":"2023-10-21T18:26:32.552240+0000","last_clean":"2023-10-21T18:26:32.552240+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:26:32.552240+0000","last_undegraded":"2023-10-21T18:26:32.552240+0000","last_fullsized":"2023-10-21T18:26:32.552240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'479","reported_seq":565,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432466+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T18:27:54.432466+0000","last_peered":"2023-10-21T18:27:54.432466+0000","last_clean":"2023-10-21T18:27:54.432466+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:27:54.432466+0000","last_undegraded":"2023-10-21T18:27:54.432466+0000","last_fullsized":"2023-10-21T18:27:54.432466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'736","reported_seq":803,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.155469+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T18:26:31.155469+0000","last_peered":"2023-10-21T18:26:31.155469+0000","last_clean":"2023-10-21T18:26:31.155469+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:26:31.155469+0000","last_undegraded":"2023-10-21T18:26:31.155469+0000","last_fullsized":"2023-10-21T18:26:31.155469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'360","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329049+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T18:27:33.329049+0000","last_peered":"2023-10-21T18:27:33.329049+0000","last_clean":"2023-10-21T18:27:33.329049+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:27:33.329049+0000","last_undegraded":"2023-10-21T18:27:33.329049+0000","last_fullsized":"2023-10-21T18:27:33.329049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'780","reported_seq":847,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.553964+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T18:26:47.553964+0000","last_peered":"2023-10-21T18:26:47.553964+0000","last_clean":"2023-10-21T18:26:47.553964+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:26:47.553964+0000","last_undegraded":"2023-10-21T18:26:47.553964+0000","last_fullsized":"2023-10-21T18:26:47.553964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'346","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.115112+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T18:27:43.115112+0000","last_peered":"2023-10-21T18:27:43.115112+0000","last_clean":"2023-10-21T18:27:43.115112+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:27:43.115112+0000","last_undegraded":"2023-10-21T18:27:43.115112+0000","last_fullsized":"2023-10-21T18:27:43.115112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'243","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.554425+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T18:26:47.554425+0000","last_peered":"2023-10-21T18:26:47.554425+0000","last_clean":"2023-10-21T18:26:47.554425+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:26:47.554425+0000","last_undegraded":"2023-10-21T18:26:47.554425+0000","last_fullsized":"2023-10-21T18:26:47.554425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'434","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.333013+0000","last_change":"2023-10-21T16:27:57.700525+0000","last_active":"2023-10-21T18:26:58.333013+0000","last_peered":"2023-10-21T18:26:58.333013+0000","last_clean":"2023-10-21T18:26:58.333013+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:26:58.333013+0000","last_undegraded":"2023-10-21T18:26:58.333013+0000","last_fullsized":"2023-10-21T18:26:58.333013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'366","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737322+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T18:27:48.737322+0000","last_peered":"2023-10-21T18:27:48.737322+0000","last_clean":"2023-10-21T18:27:48.737322+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:27:48.737322+0000","last_undegraded":"2023-10-21T18:27:48.737322+0000","last_fullsized":"2023-10-21T18:27:48.737322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'398","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051848+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:27:43.051848+0000","last_peered":"2023-10-21T18:27:43.051848+0000","last_clean":"2023-10-21T18:27:43.051848+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:27:43.051848+0000","last_undegraded":"2023-10-21T18:27:43.051848+0000","last_fullsized":"2023-10-21T18:27:43.051848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":227,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:29.725075+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T18:25:29.725075+0000","last_peered":"2023-10-21T18:25:29.725075+0000","last_clean":"2023-10-21T18:25:29.725075+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:25:29.725075+0000","last_undegraded":"2023-10-21T18:25:29.725075+0000","last_fullsized":"2023-10-21T18:25:29.725075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'328","reported_seq":399,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:25.854398+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T18:26:25.854398+0000","last_peered":"2023-10-21T18:26:25.854398+0000","last_clean":"2023-10-21T18:26:25.854398+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:26:25.854398+0000","last_undegraded":"2023-10-21T18:26:25.854398+0000","last_fullsized":"2023-10-21T18:26:25.854398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'400","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.413780+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T18:27:54.413780+0000","last_peered":"2023-10-21T18:27:54.413780+0000","last_clean":"2023-10-21T18:27:54.413780+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:27:54.413780+0000","last_undegraded":"2023-10-21T18:27:54.413780+0000","last_fullsized":"2023-10-21T18:27:54.413780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'723","reported_seq":797,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.299845+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T18:27:27.299845+0000","last_peered":"2023-10-21T18:27:27.299845+0000","last_clean":"2023-10-21T18:27:27.299845+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:27:27.299845+0000","last_undegraded":"2023-10-21T18:27:27.299845+0000","last_fullsized":"2023-10-21T18:27:27.299845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.244300+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T18:28:04.244300+0000","last_peered":"2023-10-21T18:28:04.244300+0000","last_clean":"2023-10-21T18:28:04.244300+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:04.244300+0000","last_undegraded":"2023-10-21T18:28:04.244300+0000","last_fullsized":"2023-10-21T18:28:04.244300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1495","reported_seq":3006,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.282905+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T18:28:10.282905+0000","last_peered":"2023-10-21T18:28:10.282905+0000","last_clean":"2023-10-21T18:28:10.282905+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:10.282905+0000","last_undegraded":"2023-10-21T18:28:10.282905+0000","last_fullsized":"2023-10-21T18:28:10.282905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462480,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1440,"num_read_kb":2458,"num_write":1441,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'377","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.545050+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T18:28:10.545050+0000","last_peered":"2023-10-21T18:28:10.545050+0000","last_clean":"2023-10-21T18:28:10.545050+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:10.545050+0000","last_undegraded":"2023-10-21T18:28:10.545050+0000","last_fullsized":"2023-10-21T18:28:10.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'392","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.825818+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T18:26:14.825818+0000","last_peered":"2023-10-21T18:26:14.825818+0000","last_clean":"2023-10-21T18:26:14.825818+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:26:14.825818+0000","last_undegraded":"2023-10-21T18:26:14.825818+0000","last_fullsized":"2023-10-21T18:26:14.825818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'384","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226669+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T18:28:04.226669+0000","last_peered":"2023-10-21T18:28:04.226669+0000","last_clean":"2023-10-21T18:28:04.226669+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:28:04.226669+0000","last_undegraded":"2023-10-21T18:28:04.226669+0000","last_fullsized":"2023-10-21T18:28:04.226669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'411","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.028546+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T18:27:05.028546+0000","last_peered":"2023-10-21T18:27:05.028546+0000","last_clean":"2023-10-21T18:27:05.028546+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:27:05.028546+0000","last_undegraded":"2023-10-21T18:27:05.028546+0000","last_fullsized":"2023-10-21T18:27:05.028546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'396","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.667404+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T18:27:48.667404+0000","last_peered":"2023-10-21T18:27:48.667404+0000","last_clean":"2023-10-21T18:27:48.667404+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:27:48.667404+0000","last_undegraded":"2023-10-21T18:27:48.667404+0000","last_fullsized":"2023-10-21T18:27:48.667404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":659,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:10.237903+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:27:10.237903+0000","last_peered":"2023-10-21T18:27:10.237903+0000","last_clean":"2023-10-21T18:27:10.237903+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:27:10.237903+0000","last_undegraded":"2023-10-21T18:27:10.237903+0000","last_fullsized":"2023-10-21T18:27:10.237903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'369","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.326927+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T18:27:27.326927+0000","last_peered":"2023-10-21T18:27:27.326927+0000","last_clean":"2023-10-21T18:27:27.326927+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:27:27.326927+0000","last_undegraded":"2023-10-21T18:27:27.326927+0000","last_fullsized":"2023-10-21T18:27:27.326927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1345","reported_seq":1414,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.560713+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T18:28:10.560713+0000","last_peered":"2023-10-21T18:28:10.560713+0000","last_clean":"2023-10-21T18:28:10.560713+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:10.560713+0000","last_undegraded":"2023-10-21T18:28:10.560713+0000","last_fullsized":"2023-10-21T18:28:10.560713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3532,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'360","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967247+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T18:27:42.967247+0000","last_peered":"2023-10-21T18:27:42.967247+0000","last_clean":"2023-10-21T18:27:42.967247+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:27:42.967247+0000","last_undegraded":"2023-10-21T18:27:42.967247+0000","last_fullsized":"2023-10-21T18:27:42.967247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'319","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.831936+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T18:26:39.831936+0000","last_peered":"2023-10-21T18:26:39.831936+0000","last_clean":"2023-10-21T18:26:39.831936+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:26:39.831936+0000","last_undegraded":"2023-10-21T18:26:39.831936+0000","last_fullsized":"2023-10-21T18:26:39.831936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:42.553412+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T18:26:42.553412+0000","last_peered":"2023-10-21T18:26:42.553412+0000","last_clean":"2023-10-21T18:26:42.553412+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:26:42.553412+0000","last_undegraded":"2023-10-21T18:26:42.553412+0000","last_fullsized":"2023-10-21T18:26:42.553412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'261","reported_seq":330,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.673965+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T18:26:39.673965+0000","last_peered":"2023-10-21T18:26:39.673965+0000","last_clean":"2023-10-21T18:26:39.673965+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:26:39.673965+0000","last_undegraded":"2023-10-21T18:26:39.673965+0000","last_fullsized":"2023-10-21T18:26:39.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'413","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.526407+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T18:28:10.526407+0000","last_peered":"2023-10-21T18:28:10.526407+0000","last_clean":"2023-10-21T18:28:10.526407+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:10.526407+0000","last_undegraded":"2023-10-21T18:28:10.526407+0000","last_fullsized":"2023-10-21T18:28:10.526407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'420","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.170683+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T18:26:31.170683+0000","last_peered":"2023-10-21T18:26:31.170683+0000","last_clean":"2023-10-21T18:26:31.170683+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:26:31.170683+0000","last_undegraded":"2023-10-21T18:26:31.170683+0000","last_fullsized":"2023-10-21T18:26:31.170683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'397","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.242474+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T18:28:04.242474+0000","last_peered":"2023-10-21T18:28:04.242474+0000","last_clean":"2023-10-21T18:28:04.242474+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:04.242474+0000","last_undegraded":"2023-10-21T18:28:04.242474+0000","last_fullsized":"2023-10-21T18:28:04.242474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1148","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:37.076924+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T18:26:37.076924+0000","last_peered":"2023-10-21T18:26:37.076924+0000","last_clean":"2023-10-21T18:26:37.076924+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:26:37.076924+0000","last_undegraded":"2023-10-21T18:26:37.076924+0000","last_fullsized":"2023-10-21T18:26:37.076924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'425","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.227245+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T18:28:04.227245+0000","last_peered":"2023-10-21T18:28:04.227245+0000","last_clean":"2023-10-21T18:28:04.227245+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:04.227245+0000","last_undegraded":"2023-10-21T18:28:04.227245+0000","last_fullsized":"2023-10-21T18:28:04.227245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1137","reported_seq":1204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.168962+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T18:26:31.168962+0000","last_peered":"2023-10-21T18:26:31.168962+0000","last_clean":"2023-10-21T18:26:31.168962+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:26:31.168962+0000","last_undegraded":"2023-10-21T18:26:31.168962+0000","last_fullsized":"2023-10-21T18:26:31.168962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'440","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.692035+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:27:48.692035+0000","last_peered":"2023-10-21T18:27:48.692035+0000","last_clean":"2023-10-21T18:27:48.692035+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:27:48.692035+0000","last_undegraded":"2023-10-21T18:27:48.692035+0000","last_fullsized":"2023-10-21T18:27:48.692035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'441","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.453245+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:27:34.453245+0000","last_peered":"2023-10-21T18:27:34.453245+0000","last_clean":"2023-10-21T18:27:34.453245+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:27:34.453245+0000","last_undegraded":"2023-10-21T18:27:34.453245+0000","last_fullsized":"2023-10-21T18:27:34.453245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'765","reported_seq":827,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:43.346529+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T18:26:43.346529+0000","last_peered":"2023-10-21T18:26:43.346529+0000","last_clean":"2023-10-21T18:26:43.346529+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:26:43.346529+0000","last_undegraded":"2023-10-21T18:26:43.346529+0000","last_fullsized":"2023-10-21T18:26:43.346529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'366","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.437434+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T18:27:34.437434+0000","last_peered":"2023-10-21T18:27:34.437434+0000","last_clean":"2023-10-21T18:27:34.437434+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:27:34.437434+0000","last_undegraded":"2023-10-21T18:27:34.437434+0000","last_fullsized":"2023-10-21T18:27:34.437434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1571","reported_seq":1633,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:57.549801+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T18:25:57.549801+0000","last_peered":"2023-10-21T18:25:57.549801+0000","last_clean":"2023-10-21T18:25:57.549801+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:25:57.549801+0000","last_undegraded":"2023-10-21T18:25:57.549801+0000","last_fullsized":"2023-10-21T18:25:57.549801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'356","reported_seq":443,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.845257+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:27:37.845257+0000","last_peered":"2023-10-21T18:27:37.845257+0000","last_clean":"2023-10-21T18:27:37.845257+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:27:37.845257+0000","last_undegraded":"2023-10-21T18:27:37.845257+0000","last_fullsized":"2023-10-21T18:27:37.845257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'568","reported_seq":642,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.295042+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T18:27:54.295042+0000","last_peered":"2023-10-21T18:27:54.295042+0000","last_clean":"2023-10-21T18:27:54.295042+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:27:54.295042+0000","last_undegraded":"2023-10-21T18:27:54.295042+0000","last_fullsized":"2023-10-21T18:27:54.295042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'368","reported_seq":460,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.237947+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T18:28:04.237947+0000","last_peered":"2023-10-21T18:28:04.237947+0000","last_clean":"2023-10-21T18:28:04.237947+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:28:04.237947+0000","last_undegraded":"2023-10-21T18:28:04.237947+0000","last_fullsized":"2023-10-21T18:28:04.237947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'607","reported_seq":678,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:21.018625+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T18:27:21.018625+0000","last_peered":"2023-10-21T18:27:21.018625+0000","last_clean":"2023-10-21T18:27:21.018625+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:27:21.018625+0000","last_undegraded":"2023-10-21T18:27:21.018625+0000","last_fullsized":"2023-10-21T18:27:21.018625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25934,"ondisk_log_size":25934,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216338319,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1440,"num_read_kb":2458,"num_write":24239,"num_write_kb":225033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432676638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23812,"ondisk_log_size":23812,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478194,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.093},"min":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.67000000000000004},"max":{"1min":1.704,"5min":1.704,"15min":2.2519999999999998},"last":1.04},{"interface":"front","average":{"1min":1.117,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.70399999999999996,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.871,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.7629999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2749999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7889999999999999,"5min":2.25,"15min":2.2610000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.298,"5min":1.3819999999999999,"15min":1.409},"min":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.69399999999999995},"max":{"1min":1.675,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.4550000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.526,"15min":1.5209999999999999},"min":{"1min":0.85599999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0670000000000002,"5min":2.367,"15min":2.367},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.536,"15min":1.5700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8109999999999999,"5min":2.0449999999999999,"15min":2.6669999999999998},"last":2.1200000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.974,"15min":2.782},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3300000000000001,"15min":1.375},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.319},"last":0.877}]},{"osd":5,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.431,"15min":1.482},"min":{"1min":0.874,"5min":0.874,"15min":0.70099999999999996},"max":{"1min":1.863,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.95799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.994,"5min":2.1760000000000002,"15min":2.423},"last":1.1910000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.49,"15min":1.512},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.9249999999999998},"last":2.0950000000000002},{"interface":"front","average":{"1min":1.52,"5min":1.607,"15min":1.6359999999999999},"min":{"1min":1.008,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.044,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.97899999999999998}]},{"osd":7,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.615,"15min":1.669},"min":{"1min":1.1579999999999999,"5min":1.01,"15min":0.999},"max":{"1min":2.1850000000000001,"5min":2.29,"15min":2.5859999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.6060000000000001,"15min":1.6439999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.2400000000000002,"5min":2.2429999999999999,"15min":3.0449999999999999},"last":2.1600000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.048},"min":{"1min":0.75700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7430000000000001,"5min":2.004,"15min":3.153},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.2310000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.899,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.806,"5min":2.1920000000000002,"15min":2.7480000000000002},"last":1.478},{"interface":"front","average":{"1min":1.512,"5min":1.4890000000000001,"15min":1.4379999999999999},"min":{"1min":0.78200000000000003,"5min":0.70999999999999996,"15min":0.63400000000000001},"max":{"1min":2.335,"5min":2.335,"15min":2.621},"last":1.417}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4079999999999999,"15min":1.409},"min":{"1min":0.90800000000000003,"5min":0.71299999999999997,"15min":0.55400000000000005},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.611,"15min":1.6240000000000001},"min":{"1min":1.01,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.1709999999999998,"5min":2.3130000000000002,"15min":3.867},"last":1.669}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3340000000000001,"15min":1.3560000000000001},"min":{"1min":0.83599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.782,"5min":2.048,"15min":2.895},"last":1.159},{"interface":"front","average":{"1min":1.456,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":1.0800000000000001,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":0.96399999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.524},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3839999999999999,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.71899999999999997,"15min":0.59899999999999998},"max":{"1min":2.1389999999999998,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":1.0640000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.46},"min":{"1min":0.93700000000000006,"5min":0.874,"15min":0.64400000000000002},"max":{"1min":2.282,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.296},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.5189999999999999},"min":{"1min":1.0900000000000001,"5min":0.85899999999999999,"15min":0.77300000000000002},"max":{"1min":2.0230000000000001,"5min":2.3780000000000001,"15min":3.0259999999999998},"last":1.359}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.619,"15min":1.5960000000000001},"min":{"1min":1.266,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2200000000000002,"5min":2.2330000000000001,"15min":2.8029999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6160000000000001,"15min":1.583},"min":{"1min":1.1679999999999999,"5min":0.93300000000000005,"15min":0.622},"max":{"1min":2.1720000000000002,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.5509999999999999}]}]},{"osd":1,"up_from":16,"seq":68719478195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51978808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0289999999999999,"15min":1.0720000000000001},"min":{"1min":0.71699999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4810000000000001,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.2989999999999999,"15min":1.274},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.82799999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0009999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.385,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":1.0549999999999999,"5min":0.83899999999999997,"15min":0.69699999999999995},"max":{"1min":1.875,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.6579999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.474,"15min":1.518},"min":{"1min":1.1299999999999999,"5min":0.88300000000000001,"15min":0.77300000000000002},"max":{"1min":2.0249999999999999,"5min":2.1099999999999999,"15min":2.681},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.526,"15min":1.5429999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.958,"5min":2.1480000000000001,"15min":2.544},"last":1.0129999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.3740000000000001},"min":{"1min":0.82299999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7150000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.3700000000000001,"15min":1.3740000000000001},"min":{"1min":0.91900000000000004,"5min":0.84499999999999997,"15min":0.746},"max":{"1min":1.766,"5min":1.958,"15min":2.1600000000000001},"last":1.337}]},{"osd":5,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.488,"15min":1.4750000000000001},"min":{"1min":0.98799999999999999,"5min":0.95199999999999996,"15min":0.87},"max":{"1min":1.8939999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.484,"15min":1.5249999999999999},"min":{"1min":0.97799999999999998,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.6850000000000001},"last":1.417}]},{"osd":6,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.526,"15min":1.534},"min":{"1min":1.069,"5min":0.875,"15min":0.83499999999999996},"max":{"1min":1.8779999999999999,"5min":2.173,"15min":2.5459999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6060000000000001,"15min":1.615},"min":{"1min":0.99099999999999999,"5min":0.94299999999999995,"15min":0.78900000000000003},"max":{"1min":1.998,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.601}]},{"osd":7,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.639,"15min":1.679},"min":{"1min":1.099,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.55},{"interface":"front","average":{"1min":1.669,"5min":1.679,"15min":1.7},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.7849999999999999}]}]},{"osd":0,"up_from":16,"seq":68719478196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84942858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1000000000000001,"15min":1.0820000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.528,"5min":2.016,"15min":2.04},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2629999999999999,"15min":1.264},"min":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.624},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.161},"last":1.881}]},{"osd":2,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2689999999999999,"15min":1.29},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.60599999999999998},"max":{"1min":1.95,"5min":1.95,"15min":2.3820000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.425,"15min":1.4379999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0590000000000002,"5min":2.1419999999999999,"15min":2.5550000000000002},"last":1.516}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4910000000000001,"15min":1.47},"min":{"1min":1.016,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.008,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.512,"15min":1.5209999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.78300000000000003},"max":{"1min":2.242,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.9330000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.371,"15min":1.3740000000000001},"min":{"1min":0.84199999999999997,"5min":0.76900000000000002,"15min":0.73999999999999999},"max":{"1min":1.8420000000000001,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.8089999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.343},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.78100000000000003},"max":{"1min":2.113,"5min":2.113,"15min":2.1600000000000001},"last":1.119}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.413,"15min":1.417},"min":{"1min":1.0169999999999999,"5min":0.83999999999999997,"15min":0.746},"max":{"1min":1.7509999999999999,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.5369999999999999,"15min":1.5389999999999999},"min":{"1min":1.1080000000000001,"5min":0.84699999999999998,"15min":0.76800000000000002},"max":{"1min":2.0009999999999999,"5min":2.597,"15min":2.7370000000000001},"last":1.968}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.454,"15min":1.4830000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.85299999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.004},{"interface":"front","average":{"1min":1.579,"5min":1.5720000000000001,"15min":1.5600000000000001},"min":{"1min":1.0680000000000001,"5min":0.95299999999999996,"15min":0.93799999999999994},"max":{"1min":2.0369999999999999,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":1.169}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.657,"15min":1.681},"min":{"1min":1.1659999999999999,"5min":1.0629999999999999,"15min":1.048},"max":{"1min":2.0750000000000002,"5min":2.206,"15min":2.5249999999999999},"last":1.266},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6739999999999999,"15min":1.694},"min":{"1min":1.036,"5min":0.91500000000000004,"15min":0.877},"max":{"1min":2.1150000000000002,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":2.1110000000000002}]}]},{"osd":6,"up_from":15,"seq":64424510898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.41499999999999998},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.1419999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.626}]},{"osd":1,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.47999999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0800000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":1.079,"5min":1.395,"15min":1.395},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1080000000000001,"5min":1.232,"15min":1.5069999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48599999999999999},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":2.1840000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"max":{"1min":1.1759999999999999,"5min":1.2969999999999999,"15min":1.327},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.82699999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.61199999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.36099999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.59199999999999997,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.72099999999999997,"15min":0.85699999999999998},"last":0.40400000000000003}]}]},{"osd":5,"up_from":15,"seq":64424510898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131172,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94240668,"statfs":{"total":96636764160,"available":96502444032,"internally_reserved":0,"allocated":52654080,"data_stored":52476445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81656263},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.45700000000000002,"15min":0.36899999999999999},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.212},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85999999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":0.98099999999999998,"5min":1.2549999999999999,"15min":1.554},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.026,"5min":1.1899999999999999,"15min":1.419},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.442,"15min":0.39300000000000002},"max":{"1min":1.036,"5min":1.264,"15min":1.3069999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47599999999999998},"max":{"1min":1.0740000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83199999999999996,"15min":0.79700000000000004},"min":{"1min":0.626,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1759999999999999,"5min":1.379,"15min":1.518},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.67900000000000005},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.26200000000000001},"max":{"1min":0.51500000000000001,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.53700000000000003,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.33300000000000002}]},{"osd":7,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.317,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":0.55500000000000005,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.377},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.57599999999999996,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.32200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424510898,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.1850000000000001,"15min":1.349},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.355},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.78400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.1830000000000001,"15min":1.429},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.499,"15min":0.42799999999999999},"max":{"1min":1.087,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.432},"max":{"1min":1.0680000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.76700000000000002},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.1719999999999999,"5min":1.24,"15min":1.349},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.121,"5min":1.2869999999999999,"15min":1.361},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0249999999999999,"5min":1.893,"15min":1.893},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.61699999999999999,"15min":0.68400000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.625,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.39600000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.59299999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.67700000000000005,"15min":0.77700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.81499999999999995},"last":0.55700000000000005}]}]},{"osd":7,"up_from":14,"seq":60129543601,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101752,"kb_used_data":34480,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270088,"statfs":{"total":96636764160,"available":96532570112,"internally_reserved":0,"allocated":35307520,"data_stored":35127436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.503}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51296583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:28:16.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:28:17.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.205+0000 7f006d190640 1 Processor -- start 2023-10-21T18:28:17.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.205+0000 7f006d190640 1 -- start start 2023-10-21T18:28:17.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.207+0000 7f006d190640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0068156c40 0x7f006806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:17.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.207+0000 7f006d190640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006815a450 con 0x7f00681500d0 2023-10-21T18:28:17.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.207+0000 7f006d190640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0068156050 con 0x7f0068071510 2023-10-21T18:28:17.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.207+0000 7f006d190640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0068159eb0 con 0x7f0068156c40 2023-10-21T18:28:17.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.207+0000 7f0066d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f00681500d0 0x7f00680c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:57690/0 (socket says 172.21.15.12:57690) 2023-10-21T18:28:17.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.208+0000 7f0066d9d640 1 -- 172.21.15.12:0/1124568727 learned_addr learned my addr 172.21.15.12:0/1124568727 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:17.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.208+0000 7f006759e640 1 --2- 172.21.15.12:0/1124568727 >> v2:172.21.15.99:3300/0 conn(0x7f0068156c40 0x7f006806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:17.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.211+0000 7f0065d9b640 1 -- 172.21.15.12:0/1124568727 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211641465 0 0) 0x7f0058001110 con 0x7f00681500d0 2023-10-21T18:28:17.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.211+0000 7f0065d9b640 1 -- 172.21.15.12:0/1124568727 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0054003520 con 0x7f00681500d0 2023-10-21T18:28:17.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.212+0000 7f006759e640 1 -- 172.21.15.12:0/1124568727 >> v1:172.21.15.99:6789/0 conn(0x7f0068071510 legacy=0x7f0068156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.212+0000 7f006759e640 1 -- 172.21.15.12:0/1124568727 >> v1:172.21.15.12:6789/0 conn(0x7f00681500d0 legacy=0x7f00680c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.212+0000 7f006759e640 1 -- 172.21.15.12:0/1124568727 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680721c0 con 0x7f0068156c40 2023-10-21T18:28:17.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.216+0000 7f006759e640 1 --2- 172.21.15.12:0/1124568727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f006806fd70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b0dbe7d9a9b034 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:17.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.220+0000 7f0065d9b640 1 -- 172.21.15.12:0/1124568727 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006002ccf0 con 0x7f0068156c40 2023-10-21T18:28:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.220+0000 7f0065d9b640 1 -- 172.21.15.12:0/1124568727 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006002ce50 con 0x7f0068156c40 2023-10-21T18:28:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.220+0000 7f0065d9b640 1 -- 172.21.15.12:0/1124568727 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060034660 con 0x7f0068156c40 2023-10-21T18:28:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 -- 172.21.15.12:0/1124568727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 msgr2=0x7f006806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 --2- 172.21.15.12:0/1124568727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f006806fd70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006002bf40 comp rx=0 tx=0).stop 2023-10-21T18:28:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 -- 172.21.15.12:0/1124568727 shutdown_connections 2023-10-21T18:28:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 --2- 172.21.15.12:0/1124568727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f006806fd70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 -- 172.21.15.12:0/1124568727 >> 172.21.15.12:0/1124568727 conn(0x7f0068069de0 msgr2=0x7f006806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:17.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 -- 172.21.15.12:0/1124568727 shutdown_connections 2023-10-21T18:28:17.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.221+0000 7f006d190640 1 -- 172.21.15.12:0/1124568727 wait complete. 2023-10-21T18:28:17.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.223+0000 7f006d190640 1 Processor -- start 2023-10-21T18:28:17.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.224+0000 7f006d190640 1 -- start start 2023-10-21T18:28:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0068071510 0x7f0068157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00681500d0 0x7f00680ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068154700 con 0x7f00681500d0 2023-10-21T18:28:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068158370 con 0x7f0068156c40 2023-10-21T18:28:17.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.225+0000 7f006d190640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00681ed1d0 con 0x7f0068071510 2023-10-21T18:28:17.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.226+0000 7f006759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:17.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.226+0000 7f006659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00681500d0 0x7f00680ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:17.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.226+0000 7f0066d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0068071510 0x7f0068157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:17.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.226+0000 7f006759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44274/0 (socket says 172.21.15.12:44274) 2023-10-21T18:28:17.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.226+0000 7f006759e640 1 -- 172.21.15.12:0/4259823348 learned_addr learned my addr 172.21.15.12:0/4259823348 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:17.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.230+0000 7f006759e640 1 -- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0068071510 msgr2=0x7f0068157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.230+0000 7f006759e640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0068071510 0x7f0068157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.230+0000 7f006759e640 1 -- 172.21.15.12:0/4259823348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00681500d0 msgr2=0x7f00680ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.230+0000 7f006759e640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00681500d0 0x7f00680ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.230+0000 7f006759e640 1 -- 172.21.15.12:0/4259823348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060009a70 con 0x7f0068156c40 2023-10-21T18:28:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.232+0000 7f006759e640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0060009eb0 tx=0x7f0060004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.236+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006003e610 con 0x7f0068156c40 2023-10-21T18:28:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.236+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006003e770 con 0x7f0068156c40 2023-10-21T18:28:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.236+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006003eb20 con 0x7f0068156c40 2023-10-21T18:28:17.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.236+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00681ed470 con 0x7f0068156c40 2023-10-21T18:28:17.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.236+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00681eda30 con 0x7f0068156c40 2023-10-21T18:28:17.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.237+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680619f0 con 0x7f0068156c40 2023-10-21T18:28:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.483+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f006003b050 con 0x7f0068156c40 2023-10-21T18:28:17.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.485+0000 7f005f7fe640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 0x7f004806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:17.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.485+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f00600ac140 con 0x7f0068156c40 2023-10-21T18:28:17.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.486+0000 7f0066d9d640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 0x7f004806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:17.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.487+0000 7f0066d9d640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 0x7f004806d3b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0058001270 tx=0x7f0058007bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:17.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.493+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00600771b0 con 0x7f0068156c40 2023-10-21T18:28:17.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.698+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0068071c00 con 0x7f004806aef0 2023-10-21T18:28:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.707+0000 7f005f7fe640 1 -- 172.21.15.12:0/4259823348 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289646 (secure 0 0 0) 0x7f0058005850 con 0x7f004806aef0 2023-10-21T18:28:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:28:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 msgr2=0x7f004806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 0x7f004806d3b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0058001270 tx=0x7f0058007bb0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 msgr2=0x7f0068155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:17.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0060009eb0 tx=0x7f0060004a40 comp rx=0 tx=0).stop 2023-10-21T18:28:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 shutdown_connections 2023-10-21T18:28:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f004806aef0 0x7f004806d3b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0068156c40 0x7f0068155010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00681500d0 0x7f00680ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 --2- 172.21.15.12:0/4259823348 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0068071510 0x7f0068157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.713+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 >> 172.21.15.12:0/4259823348 conn(0x7f0068069de0 msgr2=0x7f006806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.714+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 shutdown_connections 2023-10-21T18:28:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:17.714+0000 7f006d190640 1 -- 172.21.15.12:0/4259823348 wait complete. 2023-10-21T18:28:17.739 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3656,"stamp":"2023-10-21T18:28:17.134389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216928788,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48788,"num_write_kb":4575227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49886,"ondisk_log_size":49886,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":962512,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":536691,"kb_avail":754012208,"statfs":{"total":773094113280,"available":772108500992,"internally_reserved":0,"allocated":435961856,"data_stored":434592331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":549572154},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62317,"num_objects":-32,"num_object_clones":0,"num_object_copies":-64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32,"num_whiteouts":0,"num_read":5,"num_read_kb":9,"num_write":60,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003274"},"pg_stats":[{"pgid":"3.3f","version":"25'403","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.712606+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T18:27:58.712606+0000","last_peered":"2023-10-21T18:27:58.712606+0000","last_clean":"2023-10-21T18:27:58.712606+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:27:58.712606+0000","last_undegraded":"2023-10-21T18:27:58.712606+0000","last_fullsized":"2023-10-21T18:27:58.712606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'416","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876126+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T18:27:42.876126+0000","last_peered":"2023-10-21T18:27:42.876126+0000","last_clean":"2023-10-21T18:27:42.876126+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:27:42.876126+0000","last_undegraded":"2023-10-21T18:27:42.876126+0000","last_fullsized":"2023-10-21T18:27:42.876126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'367","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.847865+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T18:27:42.847865+0000","last_peered":"2023-10-21T18:27:42.847865+0000","last_clean":"2023-10-21T18:27:42.847865+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:27:42.847865+0000","last_undegraded":"2023-10-21T18:27:42.847865+0000","last_fullsized":"2023-10-21T18:27:42.847865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.665547+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T18:27:48.665547+0000","last_peered":"2023-10-21T18:27:48.665547+0000","last_clean":"2023-10-21T18:27:48.665547+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:27:48.665547+0000","last_undegraded":"2023-10-21T18:27:48.665547+0000","last_fullsized":"2023-10-21T18:27:48.665547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.779222+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:28:15.779222+0000","last_peered":"2023-10-21T18:28:15.779222+0000","last_clean":"2023-10-21T18:28:15.779222+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:28:15.779222+0000","last_undegraded":"2023-10-21T18:28:15.779222+0000","last_fullsized":"2023-10-21T18:28:15.779222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:21:43.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'379","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.779286+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T18:27:37.779286+0000","last_peered":"2023-10-21T18:27:37.779286+0000","last_clean":"2023-10-21T18:27:37.779286+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:27:37.779286+0000","last_undegraded":"2023-10-21T18:27:37.779286+0000","last_fullsized":"2023-10-21T18:27:37.779286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.784262+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T18:27:37.784262+0000","last_peered":"2023-10-21T18:27:37.784262+0000","last_clean":"2023-10-21T18:27:37.784262+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:27:37.784262+0000","last_undegraded":"2023-10-21T18:27:37.784262+0000","last_fullsized":"2023-10-21T18:27:37.784262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'377","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.344409+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:27:33.344409+0000","last_peered":"2023-10-21T18:27:33.344409+0000","last_clean":"2023-10-21T18:27:33.344409+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:27:33.344409+0000","last_undegraded":"2023-10-21T18:27:33.344409+0000","last_fullsized":"2023-10-21T18:27:33.344409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'421","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.801302+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T18:27:48.801302+0000","last_peered":"2023-10-21T18:27:48.801302+0000","last_clean":"2023-10-21T18:27:48.801302+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:27:48.801302+0000","last_undegraded":"2023-10-21T18:27:48.801302+0000","last_fullsized":"2023-10-21T18:27:48.801302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'405","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.787014+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T18:27:37.787014+0000","last_peered":"2023-10-21T18:27:37.787014+0000","last_clean":"2023-10-21T18:27:37.787014+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:27:37.787014+0000","last_undegraded":"2023-10-21T18:27:37.787014+0000","last_fullsized":"2023-10-21T18:27:37.787014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'362","reported_seq":432,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876147+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T18:27:42.876147+0000","last_peered":"2023-10-21T18:27:42.876147+0000","last_clean":"2023-10-21T18:27:42.876147+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:27:42.876147+0000","last_undegraded":"2023-10-21T18:27:42.876147+0000","last_fullsized":"2023-10-21T18:27:42.876147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'365","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.338666+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T18:26:58.338666+0000","last_peered":"2023-10-21T18:26:58.338666+0000","last_clean":"2023-10-21T18:26:58.338666+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:26:58.338666+0000","last_undegraded":"2023-10-21T18:26:58.338666+0000","last_fullsized":"2023-10-21T18:26:58.338666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'405","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967931+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T18:27:42.967931+0000","last_peered":"2023-10-21T18:27:42.967931+0000","last_clean":"2023-10-21T18:27:42.967931+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:27:42.967931+0000","last_undegraded":"2023-10-21T18:27:42.967931+0000","last_fullsized":"2023-10-21T18:27:42.967931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'403","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.736421+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T18:27:48.736421+0000","last_peered":"2023-10-21T18:27:48.736421+0000","last_clean":"2023-10-21T18:27:48.736421+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:27:48.736421+0000","last_undegraded":"2023-10-21T18:27:48.736421+0000","last_fullsized":"2023-10-21T18:27:48.736421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'424","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.707424+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T18:27:58.707424+0000","last_peered":"2023-10-21T18:27:58.707424+0000","last_clean":"2023-10-21T18:27:58.707424+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:27:58.707424+0000","last_undegraded":"2023-10-21T18:27:58.707424+0000","last_fullsized":"2023-10-21T18:27:58.707424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'421","reported_seq":510,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.177241+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T18:27:27.177241+0000","last_peered":"2023-10-21T18:27:27.177241+0000","last_clean":"2023-10-21T18:27:27.177241+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:27:27.177241+0000","last_undegraded":"2023-10-21T18:27:27.177241+0000","last_fullsized":"2023-10-21T18:27:27.177241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'456","reported_seq":558,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.811937+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:27:42.811937+0000","last_peered":"2023-10-21T18:27:42.811937+0000","last_clean":"2023-10-21T18:27:42.811937+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:27:42.811937+0000","last_undegraded":"2023-10-21T18:27:42.811937+0000","last_fullsized":"2023-10-21T18:27:42.811937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.771246+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T18:28:15.771246+0000","last_peered":"2023-10-21T18:28:15.771246+0000","last_clean":"2023-10-21T18:28:15.771246+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:15.771246+0000","last_undegraded":"2023-10-21T18:28:15.771246+0000","last_fullsized":"2023-10-21T18:28:15.771246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'399","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051608+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:27:43.051608+0000","last_peered":"2023-10-21T18:27:43.051608+0000","last_clean":"2023-10-21T18:27:43.051608+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:27:43.051608+0000","last_undegraded":"2023-10-21T18:27:43.051608+0000","last_fullsized":"2023-10-21T18:27:43.051608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'429","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226963+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T18:28:04.226963+0000","last_peered":"2023-10-21T18:28:04.226963+0000","last_clean":"2023-10-21T18:28:04.226963+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:28:04.226963+0000","last_undegraded":"2023-10-21T18:28:04.226963+0000","last_fullsized":"2023-10-21T18:28:04.226963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'391","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222352+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T18:27:27.222352+0000","last_peered":"2023-10-21T18:27:27.222352+0000","last_clean":"2023-10-21T18:27:27.222352+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:27:27.222352+0000","last_undegraded":"2023-10-21T18:27:27.222352+0000","last_fullsized":"2023-10-21T18:27:27.222352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'446","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434630+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T18:27:54.434630+0000","last_peered":"2023-10-21T18:27:54.434630+0000","last_clean":"2023-10-21T18:27:54.434630+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:27:54.434630+0000","last_undegraded":"2023-10-21T18:27:54.434630+0000","last_fullsized":"2023-10-21T18:27:54.434630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'391","reported_seq":471,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737511+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T18:27:48.737511+0000","last_peered":"2023-10-21T18:27:48.737511+0000","last_clean":"2023-10-21T18:27:48.737511+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:27:48.737511+0000","last_undegraded":"2023-10-21T18:27:48.737511+0000","last_fullsized":"2023-10-21T18:27:48.737511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'402","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.241274+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T18:28:04.241274+0000","last_peered":"2023-10-21T18:28:04.241274+0000","last_clean":"2023-10-21T18:28:04.241274+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:04.241274+0000","last_undegraded":"2023-10-21T18:28:04.241274+0000","last_fullsized":"2023-10-21T18:28:04.241274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'402","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432920+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:27:54.432920+0000","last_peered":"2023-10-21T18:27:54.432920+0000","last_clean":"2023-10-21T18:27:54.432920+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:27:54.432920+0000","last_undegraded":"2023-10-21T18:27:54.432920+0000","last_fullsized":"2023-10-21T18:27:54.432920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'482","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.317127+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T18:27:27.317127+0000","last_peered":"2023-10-21T18:27:27.317127+0000","last_clean":"2023-10-21T18:27:27.317127+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:27:27.317127+0000","last_undegraded":"2023-10-21T18:27:27.317127+0000","last_fullsized":"2023-10-21T18:27:27.317127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'415","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.702102+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T18:27:58.702102+0000","last_peered":"2023-10-21T18:27:58.702102+0000","last_clean":"2023-10-21T18:27:58.702102+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:27:58.702102+0000","last_undegraded":"2023-10-21T18:27:58.702102+0000","last_fullsized":"2023-10-21T18:27:58.702102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'400","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.348099+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T18:27:33.348099+0000","last_peered":"2023-10-21T18:27:33.348099+0000","last_clean":"2023-10-21T18:27:33.348099+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:27:33.348099+0000","last_undegraded":"2023-10-21T18:27:33.348099+0000","last_fullsized":"2023-10-21T18:27:33.348099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'393","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.427953+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T18:27:54.427953+0000","last_peered":"2023-10-21T18:27:54.427953+0000","last_clean":"2023-10-21T18:27:54.427953+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:27:54.427953+0000","last_undegraded":"2023-10-21T18:27:54.427953+0000","last_fullsized":"2023-10-21T18:27:54.427953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'461","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.428419+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:27:54.428419+0000","last_peered":"2023-10-21T18:27:54.428419+0000","last_clean":"2023-10-21T18:27:54.428419+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:27:54.428419+0000","last_undegraded":"2023-10-21T18:27:54.428419+0000","last_fullsized":"2023-10-21T18:27:54.428419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.778271+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T18:28:15.778271+0000","last_peered":"2023-10-21T18:28:15.778271+0000","last_clean":"2023-10-21T18:28:15.778271+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:15.778271+0000","last_undegraded":"2023-10-21T18:28:15.778271+0000","last_fullsized":"2023-10-21T18:28:15.778271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'418","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.054873+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T18:27:05.054873+0000","last_peered":"2023-10-21T18:27:05.054873+0000","last_clean":"2023-10-21T18:27:05.054873+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:27:05.054873+0000","last_undegraded":"2023-10-21T18:27:05.054873+0000","last_fullsized":"2023-10-21T18:27:05.054873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'411","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.749356+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T18:27:58.749356+0000","last_peered":"2023-10-21T18:27:58.749356+0000","last_clean":"2023-10-21T18:27:58.749356+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:27:58.749356+0000","last_undegraded":"2023-10-21T18:27:58.749356+0000","last_fullsized":"2023-10-21T18:27:58.749356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'222","reported_seq":284,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.046052+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T18:27:05.046052+0000","last_peered":"2023-10-21T18:27:05.046052+0000","last_clean":"2023-10-21T18:27:05.046052+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:27:05.046052+0000","last_undegraded":"2023-10-21T18:27:05.046052+0000","last_fullsized":"2023-10-21T18:27:05.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.711894+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T18:27:58.711894+0000","last_peered":"2023-10-21T18:27:58.711894+0000","last_clean":"2023-10-21T18:27:58.711894+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:27:58.711894+0000","last_undegraded":"2023-10-21T18:27:58.711894+0000","last_fullsized":"2023-10-21T18:27:58.711894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1317","reported_seq":1379,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.451979+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T18:27:29.451979+0000","last_peered":"2023-10-21T18:27:29.451979+0000","last_clean":"2023-10-21T18:27:29.451979+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:27:29.451979+0000","last_undegraded":"2023-10-21T18:27:29.451979+0000","last_fullsized":"2023-10-21T18:27:29.451979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'775","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:27.483016+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T18:26:27.483016+0000","last_peered":"2023-10-21T18:26:27.483016+0000","last_clean":"2023-10-21T18:26:27.483016+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:26:27.483016+0000","last_undegraded":"2023-10-21T18:26:27.483016+0000","last_fullsized":"2023-10-21T18:26:27.483016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'461","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.234570+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:04.234570+0000","last_peered":"2023-10-21T18:28:04.234570+0000","last_clean":"2023-10-21T18:28:04.234570+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:04.234570+0000","last_undegraded":"2023-10-21T18:28:04.234570+0000","last_fullsized":"2023-10-21T18:28:04.234570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'904","reported_seq":967,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:54.821337+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T18:25:54.821337+0000","last_peered":"2023-10-21T18:25:54.821337+0000","last_clean":"2023-10-21T18:25:54.821337+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:25:54.821337+0000","last_undegraded":"2023-10-21T18:25:54.821337+0000","last_fullsized":"2023-10-21T18:25:54.821337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'404","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222280+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T18:27:27.222280+0000","last_peered":"2023-10-21T18:27:27.222280+0000","last_clean":"2023-10-21T18:27:27.222280+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:27:27.222280+0000","last_undegraded":"2023-10-21T18:27:27.222280+0000","last_fullsized":"2023-10-21T18:27:27.222280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:08.791748+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T18:25:08.791748+0000","last_peered":"2023-10-21T18:25:08.791748+0000","last_clean":"2023-10-21T18:25:08.791748+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:25:08.791748+0000","last_undegraded":"2023-10-21T18:25:08.791748+0000","last_fullsized":"2023-10-21T18:25:08.791748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'410","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329141+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T18:27:33.329141+0000","last_peered":"2023-10-21T18:27:33.329141+0000","last_clean":"2023-10-21T18:27:33.329141+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:27:33.329141+0000","last_undegraded":"2023-10-21T18:27:33.329141+0000","last_fullsized":"2023-10-21T18:27:33.329141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1384","reported_seq":1447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:11.595704+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T18:28:11.595704+0000","last_peered":"2023-10-21T18:28:11.595704+0000","last_clean":"2023-10-21T18:28:11.595704+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:11.595704+0000","last_undegraded":"2023-10-21T18:28:11.595704+0000","last_fullsized":"2023-10-21T18:28:11.595704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13547777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":13902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'406","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.877687+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:27:42.877687+0000","last_peered":"2023-10-21T18:27:42.877687+0000","last_clean":"2023-10-21T18:27:42.877687+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:27:42.877687+0000","last_undegraded":"2023-10-21T18:27:42.877687+0000","last_fullsized":"2023-10-21T18:27:42.877687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1993","reported_seq":2056,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.614704+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T18:28:10.614704+0000","last_peered":"2023-10-21T18:28:10.614704+0000","last_clean":"2023-10-21T18:28:10.614704+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:10.614704+0000","last_undegraded":"2023-10-21T18:28:10.614704+0000","last_fullsized":"2023-10-21T18:28:10.614704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'393","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432568+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:27:54.432568+0000","last_peered":"2023-10-21T18:27:54.432568+0000","last_clean":"2023-10-21T18:27:54.432568+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:27:54.432568+0000","last_undegraded":"2023-10-21T18:27:54.432568+0000","last_fullsized":"2023-10-21T18:27:54.432568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1719","reported_seq":1784,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:56.446128+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T18:27:56.446128+0000","last_peered":"2023-10-21T18:27:56.446128+0000","last_clean":"2023-10-21T18:27:56.446128+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:27:56.446128+0000","last_undegraded":"2023-10-21T18:27:56.446128+0000","last_fullsized":"2023-10-21T18:27:56.446128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'394","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.785294+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T18:27:37.785294+0000","last_peered":"2023-10-21T18:27:37.785294+0000","last_clean":"2023-10-21T18:27:37.785294+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:27:37.785294+0000","last_undegraded":"2023-10-21T18:27:37.785294+0000","last_fullsized":"2023-10-21T18:27:37.785294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'322","reported_seq":387,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.534971+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T18:26:31.534971+0000","last_peered":"2023-10-21T18:26:31.534971+0000","last_clean":"2023-10-21T18:26:31.534971+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:26:31.534971+0000","last_undegraded":"2023-10-21T18:26:31.534971+0000","last_fullsized":"2023-10-21T18:26:31.534971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'379","reported_seq":453,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.347969+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T18:27:33.347969+0000","last_peered":"2023-10-21T18:27:33.347969+0000","last_clean":"2023-10-21T18:27:33.347969+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:27:33.347969+0000","last_undegraded":"2023-10-21T18:27:33.347969+0000","last_fullsized":"2023-10-21T18:27:33.347969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.568467+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:10.568467+0000","last_peered":"2023-10-21T18:28:10.568467+0000","last_clean":"2023-10-21T18:28:10.568467+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:10.568467+0000","last_undegraded":"2023-10-21T18:28:10.568467+0000","last_fullsized":"2023-10-21T18:28:10.568467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'421","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.239805+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:04.239805+0000","last_peered":"2023-10-21T18:28:04.239805+0000","last_clean":"2023-10-21T18:28:04.239805+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:04.239805+0000","last_undegraded":"2023-10-21T18:28:04.239805+0000","last_fullsized":"2023-10-21T18:28:04.239805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.763257+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T18:26:14.763257+0000","last_peered":"2023-10-21T18:26:14.763257+0000","last_clean":"2023-10-21T18:26:14.763257+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:26:14.763257+0000","last_undegraded":"2023-10-21T18:26:14.763257+0000","last_fullsized":"2023-10-21T18:26:14.763257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'421","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434652+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T18:27:54.434652+0000","last_peered":"2023-10-21T18:27:54.434652+0000","last_clean":"2023-10-21T18:27:54.434652+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:27:54.434652+0000","last_undegraded":"2023-10-21T18:27:54.434652+0000","last_fullsized":"2023-10-21T18:27:54.434652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'813","reported_seq":878,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:32.552240+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T18:26:32.552240+0000","last_peered":"2023-10-21T18:26:32.552240+0000","last_clean":"2023-10-21T18:26:32.552240+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:26:32.552240+0000","last_undegraded":"2023-10-21T18:26:32.552240+0000","last_fullsized":"2023-10-21T18:26:32.552240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'479","reported_seq":565,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432466+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T18:27:54.432466+0000","last_peered":"2023-10-21T18:27:54.432466+0000","last_clean":"2023-10-21T18:27:54.432466+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:27:54.432466+0000","last_undegraded":"2023-10-21T18:27:54.432466+0000","last_fullsized":"2023-10-21T18:27:54.432466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'736","reported_seq":803,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.155469+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T18:26:31.155469+0000","last_peered":"2023-10-21T18:26:31.155469+0000","last_clean":"2023-10-21T18:26:31.155469+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:26:31.155469+0000","last_undegraded":"2023-10-21T18:26:31.155469+0000","last_fullsized":"2023-10-21T18:26:31.155469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'360","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329049+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T18:27:33.329049+0000","last_peered":"2023-10-21T18:27:33.329049+0000","last_clean":"2023-10-21T18:27:33.329049+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:27:33.329049+0000","last_undegraded":"2023-10-21T18:27:33.329049+0000","last_fullsized":"2023-10-21T18:27:33.329049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'780","reported_seq":847,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.553964+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T18:26:47.553964+0000","last_peered":"2023-10-21T18:26:47.553964+0000","last_clean":"2023-10-21T18:26:47.553964+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:26:47.553964+0000","last_undegraded":"2023-10-21T18:26:47.553964+0000","last_fullsized":"2023-10-21T18:26:47.553964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'346","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.115112+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T18:27:43.115112+0000","last_peered":"2023-10-21T18:27:43.115112+0000","last_clean":"2023-10-21T18:27:43.115112+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:27:43.115112+0000","last_undegraded":"2023-10-21T18:27:43.115112+0000","last_fullsized":"2023-10-21T18:27:43.115112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'243","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.554425+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T18:26:47.554425+0000","last_peered":"2023-10-21T18:26:47.554425+0000","last_clean":"2023-10-21T18:26:47.554425+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:26:47.554425+0000","last_undegraded":"2023-10-21T18:26:47.554425+0000","last_fullsized":"2023-10-21T18:26:47.554425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'434","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.333013+0000","last_change":"2023-10-21T16:27:57.700525+0000","last_active":"2023-10-21T18:26:58.333013+0000","last_peered":"2023-10-21T18:26:58.333013+0000","last_clean":"2023-10-21T18:26:58.333013+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:26:58.333013+0000","last_undegraded":"2023-10-21T18:26:58.333013+0000","last_fullsized":"2023-10-21T18:26:58.333013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'366","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737322+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T18:27:48.737322+0000","last_peered":"2023-10-21T18:27:48.737322+0000","last_clean":"2023-10-21T18:27:48.737322+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:27:48.737322+0000","last_undegraded":"2023-10-21T18:27:48.737322+0000","last_fullsized":"2023-10-21T18:27:48.737322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'398","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051848+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:27:43.051848+0000","last_peered":"2023-10-21T18:27:43.051848+0000","last_clean":"2023-10-21T18:27:43.051848+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:27:43.051848+0000","last_undegraded":"2023-10-21T18:27:43.051848+0000","last_fullsized":"2023-10-21T18:27:43.051848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":227,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:29.725075+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T18:25:29.725075+0000","last_peered":"2023-10-21T18:25:29.725075+0000","last_clean":"2023-10-21T18:25:29.725075+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:25:29.725075+0000","last_undegraded":"2023-10-21T18:25:29.725075+0000","last_fullsized":"2023-10-21T18:25:29.725075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'328","reported_seq":399,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:25.854398+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T18:26:25.854398+0000","last_peered":"2023-10-21T18:26:25.854398+0000","last_clean":"2023-10-21T18:26:25.854398+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:26:25.854398+0000","last_undegraded":"2023-10-21T18:26:25.854398+0000","last_fullsized":"2023-10-21T18:26:25.854398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'400","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.413780+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T18:27:54.413780+0000","last_peered":"2023-10-21T18:27:54.413780+0000","last_clean":"2023-10-21T18:27:54.413780+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:27:54.413780+0000","last_undegraded":"2023-10-21T18:27:54.413780+0000","last_fullsized":"2023-10-21T18:27:54.413780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'723","reported_seq":797,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.299845+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T18:27:27.299845+0000","last_peered":"2023-10-21T18:27:27.299845+0000","last_clean":"2023-10-21T18:27:27.299845+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:27:27.299845+0000","last_undegraded":"2023-10-21T18:27:27.299845+0000","last_fullsized":"2023-10-21T18:27:27.299845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.244300+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T18:28:04.244300+0000","last_peered":"2023-10-21T18:28:04.244300+0000","last_clean":"2023-10-21T18:28:04.244300+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:04.244300+0000","last_undegraded":"2023-10-21T18:28:04.244300+0000","last_fullsized":"2023-10-21T18:28:04.244300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3008,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.182809+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T18:28:15.182809+0000","last_peered":"2023-10-21T18:28:15.182809+0000","last_clean":"2023-10-21T18:28:15.182809+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:15.182809+0000","last_undegraded":"2023-10-21T18:28:15.182809+0000","last_fullsized":"2023-10-21T18:28:15.182809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'377","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.545050+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T18:28:10.545050+0000","last_peered":"2023-10-21T18:28:10.545050+0000","last_clean":"2023-10-21T18:28:10.545050+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:10.545050+0000","last_undegraded":"2023-10-21T18:28:10.545050+0000","last_fullsized":"2023-10-21T18:28:10.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'392","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.825818+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T18:26:14.825818+0000","last_peered":"2023-10-21T18:26:14.825818+0000","last_clean":"2023-10-21T18:26:14.825818+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:26:14.825818+0000","last_undegraded":"2023-10-21T18:26:14.825818+0000","last_fullsized":"2023-10-21T18:26:14.825818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'384","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226669+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T18:28:04.226669+0000","last_peered":"2023-10-21T18:28:04.226669+0000","last_clean":"2023-10-21T18:28:04.226669+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:28:04.226669+0000","last_undegraded":"2023-10-21T18:28:04.226669+0000","last_fullsized":"2023-10-21T18:28:04.226669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'411","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.028546+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T18:27:05.028546+0000","last_peered":"2023-10-21T18:27:05.028546+0000","last_clean":"2023-10-21T18:27:05.028546+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:27:05.028546+0000","last_undegraded":"2023-10-21T18:27:05.028546+0000","last_fullsized":"2023-10-21T18:27:05.028546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'396","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.667404+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T18:27:48.667404+0000","last_peered":"2023-10-21T18:27:48.667404+0000","last_clean":"2023-10-21T18:27:48.667404+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:27:48.667404+0000","last_undegraded":"2023-10-21T18:27:48.667404+0000","last_fullsized":"2023-10-21T18:27:48.667404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":659,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:10.237903+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:27:10.237903+0000","last_peered":"2023-10-21T18:27:10.237903+0000","last_clean":"2023-10-21T18:27:10.237903+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:27:10.237903+0000","last_undegraded":"2023-10-21T18:27:10.237903+0000","last_fullsized":"2023-10-21T18:27:10.237903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'369","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.326927+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T18:27:27.326927+0000","last_peered":"2023-10-21T18:27:27.326927+0000","last_clean":"2023-10-21T18:27:27.326927+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:27:27.326927+0000","last_undegraded":"2023-10-21T18:27:27.326927+0000","last_fullsized":"2023-10-21T18:27:27.326927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1345","reported_seq":1414,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.560713+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T18:28:10.560713+0000","last_peered":"2023-10-21T18:28:10.560713+0000","last_clean":"2023-10-21T18:28:10.560713+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:10.560713+0000","last_undegraded":"2023-10-21T18:28:10.560713+0000","last_fullsized":"2023-10-21T18:28:10.560713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3532,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'360","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967247+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T18:27:42.967247+0000","last_peered":"2023-10-21T18:27:42.967247+0000","last_clean":"2023-10-21T18:27:42.967247+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:27:42.967247+0000","last_undegraded":"2023-10-21T18:27:42.967247+0000","last_fullsized":"2023-10-21T18:27:42.967247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'319","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.831936+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T18:26:39.831936+0000","last_peered":"2023-10-21T18:26:39.831936+0000","last_clean":"2023-10-21T18:26:39.831936+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:26:39.831936+0000","last_undegraded":"2023-10-21T18:26:39.831936+0000","last_fullsized":"2023-10-21T18:26:39.831936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:42.553412+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T18:26:42.553412+0000","last_peered":"2023-10-21T18:26:42.553412+0000","last_clean":"2023-10-21T18:26:42.553412+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:26:42.553412+0000","last_undegraded":"2023-10-21T18:26:42.553412+0000","last_fullsized":"2023-10-21T18:26:42.553412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'261","reported_seq":330,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.673965+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T18:26:39.673965+0000","last_peered":"2023-10-21T18:26:39.673965+0000","last_clean":"2023-10-21T18:26:39.673965+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:26:39.673965+0000","last_undegraded":"2023-10-21T18:26:39.673965+0000","last_fullsized":"2023-10-21T18:26:39.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'413","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.526407+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T18:28:10.526407+0000","last_peered":"2023-10-21T18:28:10.526407+0000","last_clean":"2023-10-21T18:28:10.526407+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:10.526407+0000","last_undegraded":"2023-10-21T18:28:10.526407+0000","last_fullsized":"2023-10-21T18:28:10.526407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'420","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.170683+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T18:26:31.170683+0000","last_peered":"2023-10-21T18:26:31.170683+0000","last_clean":"2023-10-21T18:26:31.170683+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:26:31.170683+0000","last_undegraded":"2023-10-21T18:26:31.170683+0000","last_fullsized":"2023-10-21T18:26:31.170683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'397","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.242474+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T18:28:04.242474+0000","last_peered":"2023-10-21T18:28:04.242474+0000","last_clean":"2023-10-21T18:28:04.242474+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:04.242474+0000","last_undegraded":"2023-10-21T18:28:04.242474+0000","last_fullsized":"2023-10-21T18:28:04.242474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1148","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:37.076924+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T18:26:37.076924+0000","last_peered":"2023-10-21T18:26:37.076924+0000","last_clean":"2023-10-21T18:26:37.076924+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:26:37.076924+0000","last_undegraded":"2023-10-21T18:26:37.076924+0000","last_fullsized":"2023-10-21T18:26:37.076924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.776854+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T18:28:15.776854+0000","last_peered":"2023-10-21T18:28:15.776854+0000","last_clean":"2023-10-21T18:28:15.776854+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:15.776854+0000","last_undegraded":"2023-10-21T18:28:15.776854+0000","last_fullsized":"2023-10-21T18:28:15.776854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1137","reported_seq":1204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.168962+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T18:26:31.168962+0000","last_peered":"2023-10-21T18:26:31.168962+0000","last_clean":"2023-10-21T18:26:31.168962+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:26:31.168962+0000","last_undegraded":"2023-10-21T18:26:31.168962+0000","last_fullsized":"2023-10-21T18:26:31.168962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'440","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.692035+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:27:48.692035+0000","last_peered":"2023-10-21T18:27:48.692035+0000","last_clean":"2023-10-21T18:27:48.692035+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:27:48.692035+0000","last_undegraded":"2023-10-21T18:27:48.692035+0000","last_fullsized":"2023-10-21T18:27:48.692035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'441","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.453245+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:27:34.453245+0000","last_peered":"2023-10-21T18:27:34.453245+0000","last_clean":"2023-10-21T18:27:34.453245+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:27:34.453245+0000","last_undegraded":"2023-10-21T18:27:34.453245+0000","last_fullsized":"2023-10-21T18:27:34.453245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'765","reported_seq":827,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:43.346529+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T18:26:43.346529+0000","last_peered":"2023-10-21T18:26:43.346529+0000","last_clean":"2023-10-21T18:26:43.346529+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:26:43.346529+0000","last_undegraded":"2023-10-21T18:26:43.346529+0000","last_fullsized":"2023-10-21T18:26:43.346529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'366","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.437434+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T18:27:34.437434+0000","last_peered":"2023-10-21T18:27:34.437434+0000","last_clean":"2023-10-21T18:27:34.437434+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:27:34.437434+0000","last_undegraded":"2023-10-21T18:27:34.437434+0000","last_fullsized":"2023-10-21T18:27:34.437434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1571","reported_seq":1633,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:57.549801+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T18:25:57.549801+0000","last_peered":"2023-10-21T18:25:57.549801+0000","last_clean":"2023-10-21T18:25:57.549801+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:25:57.549801+0000","last_undegraded":"2023-10-21T18:25:57.549801+0000","last_fullsized":"2023-10-21T18:25:57.549801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'356","reported_seq":443,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.845257+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:27:37.845257+0000","last_peered":"2023-10-21T18:27:37.845257+0000","last_clean":"2023-10-21T18:27:37.845257+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:27:37.845257+0000","last_undegraded":"2023-10-21T18:27:37.845257+0000","last_fullsized":"2023-10-21T18:27:37.845257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'568","reported_seq":642,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.295042+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T18:27:54.295042+0000","last_peered":"2023-10-21T18:27:54.295042+0000","last_clean":"2023-10-21T18:27:54.295042+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:27:54.295042+0000","last_undegraded":"2023-10-21T18:27:54.295042+0000","last_fullsized":"2023-10-21T18:27:54.295042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'368","reported_seq":460,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.237947+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T18:28:04.237947+0000","last_peered":"2023-10-21T18:28:04.237947+0000","last_clean":"2023-10-21T18:28:04.237947+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:28:04.237947+0000","last_undegraded":"2023-10-21T18:28:04.237947+0000","last_fullsized":"2023-10-21T18:28:04.237947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'607","reported_seq":678,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:21.018625+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T18:27:21.018625+0000","last_peered":"2023-10-21T18:27:21.018625+0000","last_clean":"2023-10-21T18:27:21.018625+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:27:21.018625+0000","last_undegraded":"2023-10-21T18:27:21.018625+0000","last_fullsized":"2023-10-21T18:27:21.018625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25955,"ondisk_log_size":25955,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216338420,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24241,"num_write_kb":225035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432676739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23814,"ondisk_log_size":23814,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478194,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.093},"min":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.67000000000000004},"max":{"1min":1.704,"5min":1.704,"15min":2.2519999999999998},"last":1.04},{"interface":"front","average":{"1min":1.117,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.70399999999999996,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.871,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.7629999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2749999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7889999999999999,"5min":2.25,"15min":2.2610000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.298,"5min":1.3819999999999999,"15min":1.409},"min":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.69399999999999995},"max":{"1min":1.675,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.4550000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.526,"15min":1.5209999999999999},"min":{"1min":0.85599999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0670000000000002,"5min":2.367,"15min":2.367},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.536,"15min":1.5700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8109999999999999,"5min":2.0449999999999999,"15min":2.6669999999999998},"last":2.1200000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.974,"15min":2.782},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3300000000000001,"15min":1.375},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.319},"last":0.877}]},{"osd":5,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.431,"15min":1.482},"min":{"1min":0.874,"5min":0.874,"15min":0.70099999999999996},"max":{"1min":1.863,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.95799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.994,"5min":2.1760000000000002,"15min":2.423},"last":1.1910000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.49,"15min":1.512},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.9249999999999998},"last":2.0950000000000002},{"interface":"front","average":{"1min":1.52,"5min":1.607,"15min":1.6359999999999999},"min":{"1min":1.008,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.044,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.97899999999999998}]},{"osd":7,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.615,"15min":1.669},"min":{"1min":1.1579999999999999,"5min":1.01,"15min":0.999},"max":{"1min":2.1850000000000001,"5min":2.29,"15min":2.5859999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.6060000000000001,"15min":1.6439999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.2400000000000002,"5min":2.2429999999999999,"15min":3.0449999999999999},"last":2.1600000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.048},"min":{"1min":0.75700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7430000000000001,"5min":2.004,"15min":3.153},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.2310000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.899,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.806,"5min":2.1920000000000002,"15min":2.7480000000000002},"last":1.478},{"interface":"front","average":{"1min":1.512,"5min":1.4890000000000001,"15min":1.4379999999999999},"min":{"1min":0.78200000000000003,"5min":0.70999999999999996,"15min":0.63400000000000001},"max":{"1min":2.335,"5min":2.335,"15min":2.621},"last":1.417}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4079999999999999,"15min":1.409},"min":{"1min":0.90800000000000003,"5min":0.71299999999999997,"15min":0.55400000000000005},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.611,"15min":1.6240000000000001},"min":{"1min":1.01,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.1709999999999998,"5min":2.3130000000000002,"15min":3.867},"last":1.669}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3340000000000001,"15min":1.3560000000000001},"min":{"1min":0.83599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.782,"5min":2.048,"15min":2.895},"last":1.159},{"interface":"front","average":{"1min":1.456,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":1.0800000000000001,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":0.96399999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.524},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3839999999999999,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.71899999999999997,"15min":0.59899999999999998},"max":{"1min":2.1389999999999998,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":1.0640000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.46},"min":{"1min":0.93700000000000006,"5min":0.874,"15min":0.64400000000000002},"max":{"1min":2.282,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.296},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.5189999999999999},"min":{"1min":1.0900000000000001,"5min":0.85899999999999999,"15min":0.77300000000000002},"max":{"1min":2.0230000000000001,"5min":2.3780000000000001,"15min":3.0259999999999998},"last":1.359}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.619,"15min":1.5960000000000001},"min":{"1min":1.266,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2200000000000002,"5min":2.2330000000000001,"15min":2.8029999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6160000000000001,"15min":1.583},"min":{"1min":1.1679999999999999,"5min":0.93300000000000005,"15min":0.622},"max":{"1min":2.1720000000000002,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.5509999999999999}]}]},{"osd":1,"up_from":16,"seq":68719478195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51978808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0289999999999999,"15min":1.0720000000000001},"min":{"1min":0.71699999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4810000000000001,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.2989999999999999,"15min":1.274},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.82799999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0009999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.385,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":1.0549999999999999,"5min":0.83899999999999997,"15min":0.69699999999999995},"max":{"1min":1.875,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.6579999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.474,"15min":1.518},"min":{"1min":1.1299999999999999,"5min":0.88300000000000001,"15min":0.77300000000000002},"max":{"1min":2.0249999999999999,"5min":2.1099999999999999,"15min":2.681},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.526,"15min":1.5429999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.958,"5min":2.1480000000000001,"15min":2.544},"last":1.0129999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.3740000000000001},"min":{"1min":0.82299999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7150000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.3700000000000001,"15min":1.3740000000000001},"min":{"1min":0.91900000000000004,"5min":0.84499999999999997,"15min":0.746},"max":{"1min":1.766,"5min":1.958,"15min":2.1600000000000001},"last":1.337}]},{"osd":5,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.488,"15min":1.4750000000000001},"min":{"1min":0.98799999999999999,"5min":0.95199999999999996,"15min":0.87},"max":{"1min":1.8939999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.484,"15min":1.5249999999999999},"min":{"1min":0.97799999999999998,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.6850000000000001},"last":1.417}]},{"osd":6,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.526,"15min":1.534},"min":{"1min":1.069,"5min":0.875,"15min":0.83499999999999996},"max":{"1min":1.8779999999999999,"5min":2.173,"15min":2.5459999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6060000000000001,"15min":1.615},"min":{"1min":0.99099999999999999,"5min":0.94299999999999995,"15min":0.78900000000000003},"max":{"1min":1.998,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.601}]},{"osd":7,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.639,"15min":1.679},"min":{"1min":1.099,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.55},{"interface":"front","average":{"1min":1.669,"5min":1.679,"15min":1.7},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.7849999999999999}]}]},{"osd":0,"up_from":16,"seq":68719478196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84942858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1000000000000001,"15min":1.0820000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.528,"5min":2.016,"15min":2.04},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2629999999999999,"15min":1.264},"min":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.624},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.161},"last":1.881}]},{"osd":2,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2689999999999999,"15min":1.29},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.60599999999999998},"max":{"1min":1.95,"5min":1.95,"15min":2.3820000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.425,"15min":1.4379999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0590000000000002,"5min":2.1419999999999999,"15min":2.5550000000000002},"last":1.516}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4910000000000001,"15min":1.47},"min":{"1min":1.016,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.008,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.512,"15min":1.5209999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.78300000000000003},"max":{"1min":2.242,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.9330000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.371,"15min":1.3740000000000001},"min":{"1min":0.84199999999999997,"5min":0.76900000000000002,"15min":0.73999999999999999},"max":{"1min":1.8420000000000001,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.8089999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.343},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.78100000000000003},"max":{"1min":2.113,"5min":2.113,"15min":2.1600000000000001},"last":1.119}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.413,"15min":1.417},"min":{"1min":1.0169999999999999,"5min":0.83999999999999997,"15min":0.746},"max":{"1min":1.7509999999999999,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.5369999999999999,"15min":1.5389999999999999},"min":{"1min":1.1080000000000001,"5min":0.84699999999999998,"15min":0.76800000000000002},"max":{"1min":2.0009999999999999,"5min":2.597,"15min":2.7370000000000001},"last":1.968}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.454,"15min":1.4830000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.85299999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.004},{"interface":"front","average":{"1min":1.579,"5min":1.5720000000000001,"15min":1.5600000000000001},"min":{"1min":1.0680000000000001,"5min":0.95299999999999996,"15min":0.93799999999999994},"max":{"1min":2.0369999999999999,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":1.169}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.657,"15min":1.681},"min":{"1min":1.1659999999999999,"5min":1.0629999999999999,"15min":1.048},"max":{"1min":2.0750000000000002,"5min":2.206,"15min":2.5249999999999999},"last":1.266},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6739999999999999,"15min":1.694},"min":{"1min":1.036,"5min":0.91500000000000004,"15min":0.877},"max":{"1min":2.1150000000000002,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":2.1110000000000002}]}]},{"osd":6,"up_from":15,"seq":64424510898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.41499999999999998},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.1419999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.626}]},{"osd":1,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.47999999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0800000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":1.079,"5min":1.395,"15min":1.395},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1080000000000001,"5min":1.232,"15min":1.5069999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48599999999999999},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":2.1840000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"max":{"1min":1.1759999999999999,"5min":1.2969999999999999,"15min":1.327},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.82699999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.61199999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.36099999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.59199999999999997,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.72099999999999997,"15min":0.85699999999999998},"last":0.40400000000000003}]}]},{"osd":5,"up_from":15,"seq":64424510898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131172,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94240668,"statfs":{"total":96636764160,"available":96502444032,"internally_reserved":0,"allocated":52654080,"data_stored":52476445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81656263},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.45700000000000002,"15min":0.36899999999999999},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.212},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85999999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":0.98099999999999998,"5min":1.2549999999999999,"15min":1.554},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.026,"5min":1.1899999999999999,"15min":1.419},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.442,"15min":0.39300000000000002},"max":{"1min":1.036,"5min":1.264,"15min":1.3069999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47599999999999998},"max":{"1min":1.0740000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83199999999999996,"15min":0.79700000000000004},"min":{"1min":0.626,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1759999999999999,"5min":1.379,"15min":1.518},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.67900000000000005},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.26200000000000001},"max":{"1min":0.51500000000000001,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.53700000000000003,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.33300000000000002}]},{"osd":7,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.317,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":0.55500000000000005,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.377},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.57599999999999996,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.32200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424510898,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.1850000000000001,"15min":1.349},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.355},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.78400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.1830000000000001,"15min":1.429},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.499,"15min":0.42799999999999999},"max":{"1min":1.087,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.432},"max":{"1min":1.0680000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.76700000000000002},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.1719999999999999,"5min":1.24,"15min":1.349},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.121,"5min":1.2869999999999999,"15min":1.361},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0249999999999999,"5min":1.893,"15min":1.893},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.61699999999999999,"15min":0.68400000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.625,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.39600000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.59299999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.67700000000000005,"15min":0.77700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.81499999999999995},"last":0.55700000000000005}]}]},{"osd":7,"up_from":14,"seq":60129543602,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":0.93100000000000005}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":1.5760000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":1.268},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.2569999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55300000000000005}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51296583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:28:17.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-21T18:28:17.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:28:18.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.015+0000 7f5a0732e640 1 Processor -- start 2023-10-21T18:28:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.016+0000 7f5a0732e640 1 -- start start 2023-10-21T18:28:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a00153200 0x7f5a00158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a000c3fc0 0x7f5a0015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0015c570 con 0x7f5a000c3fc0 2023-10-21T18:28:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0015cac0 con 0x7f5a00153200 2023-10-21T18:28:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.017+0000 7f5a0732e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a001594c0 con 0x7f5a000c3a50 2023-10-21T18:28:18.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.018+0000 7f5a06b2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.018+0000 7f5a0632c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a00153200 0x7f5a00158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.018+0000 7f5a06b2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41190/0 (socket says 172.21.15.12:41190) 2023-10-21T18:28:18.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.018+0000 7f5a06b2d640 1 -- 172.21.15.12:0/3589866355 learned_addr learned my addr 172.21.15.12:0/3589866355 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:18.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.018+0000 7f5a05b2b640 1 --2- 172.21.15.12:0/3589866355 >> v2:172.21.15.12:3300/0 conn(0x7f5a000c3fc0 0x7f5a0015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.020+0000 7f5a06b2d640 1 -- 172.21.15.12:0/3589866355 >> v2:172.21.15.99:3300/0 conn(0x7f5a00153200 msgr2=0x7f5a00158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:18.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.020+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/3589866355 >> v2:172.21.15.99:3300/0 conn(0x7f5a00153200 0x7f5a00158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.020+0000 7f5a06b2d640 1 -- 172.21.15.12:0/3589866355 >> v2:172.21.15.12:3300/0 conn(0x7f5a000c3fc0 msgr2=0x7f5a0015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:18.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.020+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/3589866355 >> v2:172.21.15.12:3300/0 conn(0x7f5a000c3fc0 0x7f5a0015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.020+0000 7f5a06b2d640 1 -- 172.21.15.12:0/3589866355 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0015d490 con 0x7f5a000c3a50 2023-10-21T18:28:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.023+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/3589866355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a00071b30 tx=0x7f59f802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a84aec69fca54e75 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.026+0000 7f5a0532a640 1 -- 172.21.15.12:0/3589866355 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8031870 con 0x7f5a000c3a50 2023-10-21T18:28:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.026+0000 7f5a0532a640 1 -- 172.21.15.12:0/3589866355 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f80319d0 con 0x7f5a000c3a50 2023-10-21T18:28:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.026+0000 7f5a0532a640 1 -- 172.21.15.12:0/3589866355 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8031d60 con 0x7f5a000c3a50 2023-10-21T18:28:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 -- 172.21.15.12:0/3589866355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 msgr2=0x7f5a000ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 --2- 172.21.15.12:0/3589866355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a00071b30 tx=0x7f59f802b910 comp rx=0 tx=0).stop 2023-10-21T18:28:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 -- 172.21.15.12:0/3589866355 shutdown_connections 2023-10-21T18:28:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 --2- 172.21.15.12:0/3589866355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a000c3a50 0x7f5a000ce760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 --2- 172.21.15.12:0/3589866355 >> v2:172.21.15.12:3300/0 conn(0x7f5a000c3fc0 0x7f5a0015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 --2- 172.21.15.12:0/3589866355 >> v2:172.21.15.99:3300/0 conn(0x7f5a00153200 0x7f5a00158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 -- 172.21.15.12:0/3589866355 >> 172.21.15.12:0/3589866355 conn(0x7f5a00071510 msgr2=0x7f5a0006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 -- 172.21.15.12:0/3589866355 shutdown_connections 2023-10-21T18:28:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.027+0000 7f5a0732e640 1 -- 172.21.15.12:0/3589866355 wait complete. 2023-10-21T18:28:18.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.029+0000 7f5a0732e640 1 Processor -- start 2023-10-21T18:28:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.029+0000 7f5a0732e640 1 -- start start 2023-10-21T18:28:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a000c3a50 0x7f5a000b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a000c3fc0 0x7f5a00158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0014f640 con 0x7f5a000c3a50 2023-10-21T18:28:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00148930 con 0x7f5a000c3fc0 2023-10-21T18:28:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.030+0000 7f5a0732e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0014d620 con 0x7f5a00153200 2023-10-21T18:28:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.031+0000 7f5a06b2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.031+0000 7f5a05b2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a000c3fc0 0x7f5a00158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.031+0000 7f5a06b2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41206/0 (socket says 172.21.15.12:41206) 2023-10-21T18:28:18.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.031+0000 7f5a06b2d640 1 -- 172.21.15.12:0/2937190307 learned_addr learned my addr 172.21.15.12:0/2937190307 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:18.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.031+0000 7f5a0632c640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a000c3a50 0x7f5a000b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.034+0000 7f5a06b2d640 1 -- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a000c3fc0 msgr2=0x7f5a00158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.035+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a000c3fc0 0x7f5a00158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.035+0000 7f5a06b2d640 1 -- 172.21.15.12:0/2937190307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a000c3a50 msgr2=0x7f5a000b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.035+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a000c3a50 0x7f5a000b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.035+0000 7f5a06b2d640 1 -- 172.21.15.12:0/2937190307 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80094d0 con 0x7f5a00153200 2023-10-21T18:28:18.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.037+0000 7f5a06b2d640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f59f802b950 tx=0x7f59f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.040+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f803ab60 con 0x7f5a00153200 2023-10-21T18:28:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.040+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f803ace0 con 0x7f5a00153200 2023-10-21T18:28:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.040+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8044630 con 0x7f5a00153200 2023-10-21T18:28:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.040+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a001eebb0 con 0x7f5a00153200 2023-10-21T18:28:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.040+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0014d8e0 con 0x7f5a00153200 2023-10-21T18:28:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.042+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a00067560 con 0x7f5a00153200 2023-10-21T18:28:18.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.061+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59f8044790 con 0x7f5a00153200 2023-10-21T18:28:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.061+0000 7f59feffd640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 0x7f59ec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.062+0000 7f5a0632c640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 0x7f59ec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.063+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f59f802d040 con 0x7f5a00153200 2023-10-21T18:28:18.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.063+0000 7f5a0632c640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 0x7f59ec06d380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f59f0011340 tx=0x7f59f000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:18.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.297+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59f80771b0 con 0x7f5a00153200 2023-10-21T18:28:18.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.502+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a0014d4a0 con 0x7f59ec06aec0 2023-10-21T18:28:18.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.511+0000 7f59feffd640 1 -- 172.21.15.12:0/2937190307 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289646 (secure 0 0 0) 0x7f59f000f040 con 0x7f59ec06aec0 2023-10-21T18:28:18.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:28:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 msgr2=0x7f59ec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 0x7f59ec06d380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f59f0011340 tx=0x7f59f000b040 comp rx=0 tx=0).stop 2023-10-21T18:28:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 msgr2=0x7f5a00158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f59f802b950 tx=0x7f59f80046c0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 shutdown_connections 2023-10-21T18:28:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f59ec06aec0 0x7f59ec06d380 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a00153200 0x7f5a00158d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a000c3fc0 0x7f5a00158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 --2- 172.21.15.12:0/2937190307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a000c3a50 0x7f5a000b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 >> 172.21.15.12:0/2937190307 conn(0x7f5a00071510 msgr2=0x7f5a000c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 shutdown_connections 2023-10-21T18:28:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.517+0000 7f5a0732e640 1 -- 172.21.15.12:0/2937190307 wait complete. 2023-10-21T18:28:18.540 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3656,"stamp":"2023-10-21T18:28:17.134389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216928788,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48788,"num_write_kb":4575227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49886,"ondisk_log_size":49886,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":962512,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":536691,"kb_avail":754012208,"statfs":{"total":773094113280,"available":772108500992,"internally_reserved":0,"allocated":435961856,"data_stored":434592331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":549572154},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62317,"num_objects":-32,"num_object_clones":0,"num_object_copies":-64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32,"num_whiteouts":0,"num_read":5,"num_read_kb":9,"num_write":60,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003274"},"pg_stats":[{"pgid":"3.3f","version":"25'403","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.712606+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T18:27:58.712606+0000","last_peered":"2023-10-21T18:27:58.712606+0000","last_clean":"2023-10-21T18:27:58.712606+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:27:58.712606+0000","last_undegraded":"2023-10-21T18:27:58.712606+0000","last_fullsized":"2023-10-21T18:27:58.712606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'416","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876126+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T18:27:42.876126+0000","last_peered":"2023-10-21T18:27:42.876126+0000","last_clean":"2023-10-21T18:27:42.876126+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:27:42.876126+0000","last_undegraded":"2023-10-21T18:27:42.876126+0000","last_fullsized":"2023-10-21T18:27:42.876126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:23:09.305836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'367","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.847865+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T18:27:42.847865+0000","last_peered":"2023-10-21T18:27:42.847865+0000","last_clean":"2023-10-21T18:27:42.847865+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:27:42.847865+0000","last_undegraded":"2023-10-21T18:27:42.847865+0000","last_fullsized":"2023-10-21T18:27:42.847865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.665547+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T18:27:48.665547+0000","last_peered":"2023-10-21T18:27:48.665547+0000","last_clean":"2023-10-21T18:27:48.665547+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:27:48.665547+0000","last_undegraded":"2023-10-21T18:27:48.665547+0000","last_fullsized":"2023-10-21T18:27:48.665547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.779222+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:28:15.779222+0000","last_peered":"2023-10-21T18:28:15.779222+0000","last_clean":"2023-10-21T18:28:15.779222+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:28:15.779222+0000","last_undegraded":"2023-10-21T18:28:15.779222+0000","last_fullsized":"2023-10-21T18:28:15.779222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:21:43.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'379","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.779286+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T18:27:37.779286+0000","last_peered":"2023-10-21T18:27:37.779286+0000","last_clean":"2023-10-21T18:27:37.779286+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:27:37.779286+0000","last_undegraded":"2023-10-21T18:27:37.779286+0000","last_fullsized":"2023-10-21T18:27:37.779286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.784262+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T18:27:37.784262+0000","last_peered":"2023-10-21T18:27:37.784262+0000","last_clean":"2023-10-21T18:27:37.784262+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:27:37.784262+0000","last_undegraded":"2023-10-21T18:27:37.784262+0000","last_fullsized":"2023-10-21T18:27:37.784262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'377","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.344409+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:27:33.344409+0000","last_peered":"2023-10-21T18:27:33.344409+0000","last_clean":"2023-10-21T18:27:33.344409+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:27:33.344409+0000","last_undegraded":"2023-10-21T18:27:33.344409+0000","last_fullsized":"2023-10-21T18:27:33.344409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'421","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.801302+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T18:27:48.801302+0000","last_peered":"2023-10-21T18:27:48.801302+0000","last_clean":"2023-10-21T18:27:48.801302+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:27:48.801302+0000","last_undegraded":"2023-10-21T18:27:48.801302+0000","last_fullsized":"2023-10-21T18:27:48.801302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'405","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.787014+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T18:27:37.787014+0000","last_peered":"2023-10-21T18:27:37.787014+0000","last_clean":"2023-10-21T18:27:37.787014+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:27:37.787014+0000","last_undegraded":"2023-10-21T18:27:37.787014+0000","last_fullsized":"2023-10-21T18:27:37.787014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:41.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'362","reported_seq":432,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.876147+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T18:27:42.876147+0000","last_peered":"2023-10-21T18:27:42.876147+0000","last_clean":"2023-10-21T18:27:42.876147+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:27:42.876147+0000","last_undegraded":"2023-10-21T18:27:42.876147+0000","last_fullsized":"2023-10-21T18:27:42.876147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'365","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.338666+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T18:26:58.338666+0000","last_peered":"2023-10-21T18:26:58.338666+0000","last_clean":"2023-10-21T18:26:58.338666+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:26:58.338666+0000","last_undegraded":"2023-10-21T18:26:58.338666+0000","last_fullsized":"2023-10-21T18:26:58.338666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'405","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967931+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T18:27:42.967931+0000","last_peered":"2023-10-21T18:27:42.967931+0000","last_clean":"2023-10-21T18:27:42.967931+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:27:42.967931+0000","last_undegraded":"2023-10-21T18:27:42.967931+0000","last_fullsized":"2023-10-21T18:27:42.967931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'403","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.736421+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T18:27:48.736421+0000","last_peered":"2023-10-21T18:27:48.736421+0000","last_clean":"2023-10-21T18:27:48.736421+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:27:48.736421+0000","last_undegraded":"2023-10-21T18:27:48.736421+0000","last_fullsized":"2023-10-21T18:27:48.736421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'424","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.707424+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T18:27:58.707424+0000","last_peered":"2023-10-21T18:27:58.707424+0000","last_clean":"2023-10-21T18:27:58.707424+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:27:58.707424+0000","last_undegraded":"2023-10-21T18:27:58.707424+0000","last_fullsized":"2023-10-21T18:27:58.707424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'421","reported_seq":510,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.177241+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T18:27:27.177241+0000","last_peered":"2023-10-21T18:27:27.177241+0000","last_clean":"2023-10-21T18:27:27.177241+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:27:27.177241+0000","last_undegraded":"2023-10-21T18:27:27.177241+0000","last_fullsized":"2023-10-21T18:27:27.177241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'456","reported_seq":558,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.811937+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:27:42.811937+0000","last_peered":"2023-10-21T18:27:42.811937+0000","last_clean":"2023-10-21T18:27:42.811937+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:27:42.811937+0000","last_undegraded":"2023-10-21T18:27:42.811937+0000","last_fullsized":"2023-10-21T18:27:42.811937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.771246+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T18:28:15.771246+0000","last_peered":"2023-10-21T18:28:15.771246+0000","last_clean":"2023-10-21T18:28:15.771246+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:15.771246+0000","last_undegraded":"2023-10-21T18:28:15.771246+0000","last_fullsized":"2023-10-21T18:28:15.771246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'399","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051608+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:27:43.051608+0000","last_peered":"2023-10-21T18:27:43.051608+0000","last_clean":"2023-10-21T18:27:43.051608+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:27:43.051608+0000","last_undegraded":"2023-10-21T18:27:43.051608+0000","last_fullsized":"2023-10-21T18:27:43.051608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'429","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226963+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T18:28:04.226963+0000","last_peered":"2023-10-21T18:28:04.226963+0000","last_clean":"2023-10-21T18:28:04.226963+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:28:04.226963+0000","last_undegraded":"2023-10-21T18:28:04.226963+0000","last_fullsized":"2023-10-21T18:28:04.226963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'391","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222352+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T18:27:27.222352+0000","last_peered":"2023-10-21T18:27:27.222352+0000","last_clean":"2023-10-21T18:27:27.222352+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:27:27.222352+0000","last_undegraded":"2023-10-21T18:27:27.222352+0000","last_fullsized":"2023-10-21T18:27:27.222352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'446","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434630+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T18:27:54.434630+0000","last_peered":"2023-10-21T18:27:54.434630+0000","last_clean":"2023-10-21T18:27:54.434630+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:27:54.434630+0000","last_undegraded":"2023-10-21T18:27:54.434630+0000","last_fullsized":"2023-10-21T18:27:54.434630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:27.471884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'391","reported_seq":471,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737511+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T18:27:48.737511+0000","last_peered":"2023-10-21T18:27:48.737511+0000","last_clean":"2023-10-21T18:27:48.737511+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:27:48.737511+0000","last_undegraded":"2023-10-21T18:27:48.737511+0000","last_fullsized":"2023-10-21T18:27:48.737511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'402","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.241274+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T18:28:04.241274+0000","last_peered":"2023-10-21T18:28:04.241274+0000","last_clean":"2023-10-21T18:28:04.241274+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:04.241274+0000","last_undegraded":"2023-10-21T18:28:04.241274+0000","last_fullsized":"2023-10-21T18:28:04.241274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'402","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432920+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:27:54.432920+0000","last_peered":"2023-10-21T18:27:54.432920+0000","last_clean":"2023-10-21T18:27:54.432920+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:27:54.432920+0000","last_undegraded":"2023-10-21T18:27:54.432920+0000","last_fullsized":"2023-10-21T18:27:54.432920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:43.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'482","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.317127+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T18:27:27.317127+0000","last_peered":"2023-10-21T18:27:27.317127+0000","last_clean":"2023-10-21T18:27:27.317127+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:27:27.317127+0000","last_undegraded":"2023-10-21T18:27:27.317127+0000","last_fullsized":"2023-10-21T18:27:27.317127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'415","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.702102+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T18:27:58.702102+0000","last_peered":"2023-10-21T18:27:58.702102+0000","last_clean":"2023-10-21T18:27:58.702102+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:27:58.702102+0000","last_undegraded":"2023-10-21T18:27:58.702102+0000","last_fullsized":"2023-10-21T18:27:58.702102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'400","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.348099+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T18:27:33.348099+0000","last_peered":"2023-10-21T18:27:33.348099+0000","last_clean":"2023-10-21T18:27:33.348099+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:27:33.348099+0000","last_undegraded":"2023-10-21T18:27:33.348099+0000","last_fullsized":"2023-10-21T18:27:33.348099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'393","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.427953+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T18:27:54.427953+0000","last_peered":"2023-10-21T18:27:54.427953+0000","last_clean":"2023-10-21T18:27:54.427953+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:27:54.427953+0000","last_undegraded":"2023-10-21T18:27:54.427953+0000","last_fullsized":"2023-10-21T18:27:54.427953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'461","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.428419+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:27:54.428419+0000","last_peered":"2023-10-21T18:27:54.428419+0000","last_clean":"2023-10-21T18:27:54.428419+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:27:54.428419+0000","last_undegraded":"2023-10-21T18:27:54.428419+0000","last_fullsized":"2023-10-21T18:27:54.428419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.778271+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T18:28:15.778271+0000","last_peered":"2023-10-21T18:28:15.778271+0000","last_clean":"2023-10-21T18:28:15.778271+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:15.778271+0000","last_undegraded":"2023-10-21T18:28:15.778271+0000","last_fullsized":"2023-10-21T18:28:15.778271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'418","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.054873+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T18:27:05.054873+0000","last_peered":"2023-10-21T18:27:05.054873+0000","last_clean":"2023-10-21T18:27:05.054873+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:27:05.054873+0000","last_undegraded":"2023-10-21T18:27:05.054873+0000","last_fullsized":"2023-10-21T18:27:05.054873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:18:37.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'411","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.749356+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T18:27:58.749356+0000","last_peered":"2023-10-21T18:27:58.749356+0000","last_clean":"2023-10-21T18:27:58.749356+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:27:58.749356+0000","last_undegraded":"2023-10-21T18:27:58.749356+0000","last_fullsized":"2023-10-21T18:27:58.749356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:15.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'222","reported_seq":284,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.046052+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T18:27:05.046052+0000","last_peered":"2023-10-21T18:27:05.046052+0000","last_clean":"2023-10-21T18:27:05.046052+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:27:05.046052+0000","last_undegraded":"2023-10-21T18:27:05.046052+0000","last_fullsized":"2023-10-21T18:27:05.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:24:10.163577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'375","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:58.711894+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T18:27:58.711894+0000","last_peered":"2023-10-21T18:27:58.711894+0000","last_clean":"2023-10-21T18:27:58.711894+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:27:58.711894+0000","last_undegraded":"2023-10-21T18:27:58.711894+0000","last_fullsized":"2023-10-21T18:27:58.711894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:46.079510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1317","reported_seq":1379,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.451979+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T18:27:29.451979+0000","last_peered":"2023-10-21T18:27:29.451979+0000","last_clean":"2023-10-21T18:27:29.451979+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:27:29.451979+0000","last_undegraded":"2023-10-21T18:27:29.451979+0000","last_fullsized":"2023-10-21T18:27:29.451979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'775","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:27.483016+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T18:26:27.483016+0000","last_peered":"2023-10-21T18:26:27.483016+0000","last_clean":"2023-10-21T18:26:27.483016+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:26:27.483016+0000","last_undegraded":"2023-10-21T18:26:27.483016+0000","last_fullsized":"2023-10-21T18:26:27.483016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'461","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.234570+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:04.234570+0000","last_peered":"2023-10-21T18:28:04.234570+0000","last_clean":"2023-10-21T18:28:04.234570+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:04.234570+0000","last_undegraded":"2023-10-21T18:28:04.234570+0000","last_fullsized":"2023-10-21T18:28:04.234570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:24.220537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'904","reported_seq":967,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:54.821337+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T18:25:54.821337+0000","last_peered":"2023-10-21T18:25:54.821337+0000","last_clean":"2023-10-21T18:25:54.821337+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:25:54.821337+0000","last_undegraded":"2023-10-21T18:25:54.821337+0000","last_fullsized":"2023-10-21T18:25:54.821337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'404","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.222280+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T18:27:27.222280+0000","last_peered":"2023-10-21T18:27:27.222280+0000","last_clean":"2023-10-21T18:27:27.222280+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:27:27.222280+0000","last_undegraded":"2023-10-21T18:27:27.222280+0000","last_fullsized":"2023-10-21T18:27:27.222280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:44.777343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:08.791748+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T18:25:08.791748+0000","last_peered":"2023-10-21T18:25:08.791748+0000","last_clean":"2023-10-21T18:25:08.791748+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:25:08.791748+0000","last_undegraded":"2023-10-21T18:25:08.791748+0000","last_fullsized":"2023-10-21T18:25:08.791748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'410","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329141+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T18:27:33.329141+0000","last_peered":"2023-10-21T18:27:33.329141+0000","last_clean":"2023-10-21T18:27:33.329141+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:27:33.329141+0000","last_undegraded":"2023-10-21T18:27:33.329141+0000","last_fullsized":"2023-10-21T18:27:33.329141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1384","reported_seq":1447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:11.595704+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T18:28:11.595704+0000","last_peered":"2023-10-21T18:28:11.595704+0000","last_clean":"2023-10-21T18:28:11.595704+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:11.595704+0000","last_undegraded":"2023-10-21T18:28:11.595704+0000","last_fullsized":"2023-10-21T18:28:11.595704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:44:43.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13547777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":13902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'406","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.877687+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:27:42.877687+0000","last_peered":"2023-10-21T18:27:42.877687+0000","last_clean":"2023-10-21T18:27:42.877687+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:27:42.877687+0000","last_undegraded":"2023-10-21T18:27:42.877687+0000","last_fullsized":"2023-10-21T18:27:42.877687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1993","reported_seq":2056,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.614704+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T18:28:10.614704+0000","last_peered":"2023-10-21T18:28:10.614704+0000","last_clean":"2023-10-21T18:28:10.614704+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:10.614704+0000","last_undegraded":"2023-10-21T18:28:10.614704+0000","last_fullsized":"2023-10-21T18:28:10.614704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'393","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432568+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:27:54.432568+0000","last_peered":"2023-10-21T18:27:54.432568+0000","last_clean":"2023-10-21T18:27:54.432568+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:27:54.432568+0000","last_undegraded":"2023-10-21T18:27:54.432568+0000","last_fullsized":"2023-10-21T18:27:54.432568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1719","reported_seq":1784,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:56.446128+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T18:27:56.446128+0000","last_peered":"2023-10-21T18:27:56.446128+0000","last_clean":"2023-10-21T18:27:56.446128+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:27:56.446128+0000","last_undegraded":"2023-10-21T18:27:56.446128+0000","last_fullsized":"2023-10-21T18:27:56.446128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:20.970583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'394","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.785294+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T18:27:37.785294+0000","last_peered":"2023-10-21T18:27:37.785294+0000","last_clean":"2023-10-21T18:27:37.785294+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:27:37.785294+0000","last_undegraded":"2023-10-21T18:27:37.785294+0000","last_fullsized":"2023-10-21T18:27:37.785294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:59.291007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'322","reported_seq":387,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.534971+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T18:26:31.534971+0000","last_peered":"2023-10-21T18:26:31.534971+0000","last_clean":"2023-10-21T18:26:31.534971+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:26:31.534971+0000","last_undegraded":"2023-10-21T18:26:31.534971+0000","last_fullsized":"2023-10-21T18:26:31.534971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'379","reported_seq":453,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.347969+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T18:27:33.347969+0000","last_peered":"2023-10-21T18:27:33.347969+0000","last_clean":"2023-10-21T18:27:33.347969+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:27:33.347969+0000","last_undegraded":"2023-10-21T18:27:33.347969+0000","last_fullsized":"2023-10-21T18:27:33.347969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.568467+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:10.568467+0000","last_peered":"2023-10-21T18:28:10.568467+0000","last_clean":"2023-10-21T18:28:10.568467+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:10.568467+0000","last_undegraded":"2023-10-21T18:28:10.568467+0000","last_fullsized":"2023-10-21T18:28:10.568467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'421","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.239805+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:04.239805+0000","last_peered":"2023-10-21T18:28:04.239805+0000","last_clean":"2023-10-21T18:28:04.239805+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:04.239805+0000","last_undegraded":"2023-10-21T18:28:04.239805+0000","last_fullsized":"2023-10-21T18:28:04.239805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.763257+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T18:26:14.763257+0000","last_peered":"2023-10-21T18:26:14.763257+0000","last_clean":"2023-10-21T18:26:14.763257+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:26:14.763257+0000","last_undegraded":"2023-10-21T18:26:14.763257+0000","last_fullsized":"2023-10-21T18:26:14.763257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'421","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.434652+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T18:27:54.434652+0000","last_peered":"2023-10-21T18:27:54.434652+0000","last_clean":"2023-10-21T18:27:54.434652+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:27:54.434652+0000","last_undegraded":"2023-10-21T18:27:54.434652+0000","last_fullsized":"2023-10-21T18:27:54.434652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'813","reported_seq":878,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:32.552240+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T18:26:32.552240+0000","last_peered":"2023-10-21T18:26:32.552240+0000","last_clean":"2023-10-21T18:26:32.552240+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:26:32.552240+0000","last_undegraded":"2023-10-21T18:26:32.552240+0000","last_fullsized":"2023-10-21T18:26:32.552240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:06.667378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'479","reported_seq":565,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432466+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T18:27:54.432466+0000","last_peered":"2023-10-21T18:27:54.432466+0000","last_clean":"2023-10-21T18:27:54.432466+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:27:54.432466+0000","last_undegraded":"2023-10-21T18:27:54.432466+0000","last_fullsized":"2023-10-21T18:27:54.432466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'736","reported_seq":803,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.155469+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T18:26:31.155469+0000","last_peered":"2023-10-21T18:26:31.155469+0000","last_clean":"2023-10-21T18:26:31.155469+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:26:31.155469+0000","last_undegraded":"2023-10-21T18:26:31.155469+0000","last_fullsized":"2023-10-21T18:26:31.155469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:05.781804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'360","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:33.329049+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T18:27:33.329049+0000","last_peered":"2023-10-21T18:27:33.329049+0000","last_clean":"2023-10-21T18:27:33.329049+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:27:33.329049+0000","last_undegraded":"2023-10-21T18:27:33.329049+0000","last_fullsized":"2023-10-21T18:27:33.329049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'780","reported_seq":847,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.553964+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T18:26:47.553964+0000","last_peered":"2023-10-21T18:26:47.553964+0000","last_clean":"2023-10-21T18:26:47.553964+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:26:47.553964+0000","last_undegraded":"2023-10-21T18:26:47.553964+0000","last_fullsized":"2023-10-21T18:26:47.553964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'346","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.115112+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T18:27:43.115112+0000","last_peered":"2023-10-21T18:27:43.115112+0000","last_clean":"2023-10-21T18:27:43.115112+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:27:43.115112+0000","last_undegraded":"2023-10-21T18:27:43.115112+0000","last_fullsized":"2023-10-21T18:27:43.115112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'243","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:47.554425+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T18:26:47.554425+0000","last_peered":"2023-10-21T18:26:47.554425+0000","last_clean":"2023-10-21T18:26:47.554425+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:26:47.554425+0000","last_undegraded":"2023-10-21T18:26:47.554425+0000","last_fullsized":"2023-10-21T18:26:47.554425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:49:32.863538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'434","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:58.333013+0000","last_change":"2023-10-21T16:27:57.700525+0000","last_active":"2023-10-21T18:26:58.333013+0000","last_peered":"2023-10-21T18:26:58.333013+0000","last_clean":"2023-10-21T18:26:58.333013+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:26:58.333013+0000","last_undegraded":"2023-10-21T18:26:58.333013+0000","last_fullsized":"2023-10-21T18:26:58.333013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'366","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737322+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T18:27:48.737322+0000","last_peered":"2023-10-21T18:27:48.737322+0000","last_clean":"2023-10-21T18:27:48.737322+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:27:48.737322+0000","last_undegraded":"2023-10-21T18:27:48.737322+0000","last_fullsized":"2023-10-21T18:27:48.737322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'398","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:43.051848+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:27:43.051848+0000","last_peered":"2023-10-21T18:27:43.051848+0000","last_clean":"2023-10-21T18:27:43.051848+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:27:43.051848+0000","last_undegraded":"2023-10-21T18:27:43.051848+0000","last_fullsized":"2023-10-21T18:27:43.051848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":227,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:29.725075+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T18:25:29.725075+0000","last_peered":"2023-10-21T18:25:29.725075+0000","last_clean":"2023-10-21T18:25:29.725075+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:25:29.725075+0000","last_undegraded":"2023-10-21T18:25:29.725075+0000","last_fullsized":"2023-10-21T18:25:29.725075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:56:09.344889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'328","reported_seq":399,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:25.854398+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T18:26:25.854398+0000","last_peered":"2023-10-21T18:26:25.854398+0000","last_clean":"2023-10-21T18:26:25.854398+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:26:25.854398+0000","last_undegraded":"2023-10-21T18:26:25.854398+0000","last_fullsized":"2023-10-21T18:26:25.854398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'400","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.413780+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T18:27:54.413780+0000","last_peered":"2023-10-21T18:27:54.413780+0000","last_clean":"2023-10-21T18:27:54.413780+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:27:54.413780+0000","last_undegraded":"2023-10-21T18:27:54.413780+0000","last_fullsized":"2023-10-21T18:27:54.413780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'723","reported_seq":797,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.299845+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T18:27:27.299845+0000","last_peered":"2023-10-21T18:27:27.299845+0000","last_clean":"2023-10-21T18:27:27.299845+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:27:27.299845+0000","last_undegraded":"2023-10-21T18:27:27.299845+0000","last_fullsized":"2023-10-21T18:27:27.299845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.244300+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T18:28:04.244300+0000","last_peered":"2023-10-21T18:28:04.244300+0000","last_clean":"2023-10-21T18:28:04.244300+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:04.244300+0000","last_undegraded":"2023-10-21T18:28:04.244300+0000","last_fullsized":"2023-10-21T18:28:04.244300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3008,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.182809+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T18:28:15.182809+0000","last_peered":"2023-10-21T18:28:15.182809+0000","last_clean":"2023-10-21T18:28:15.182809+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:15.182809+0000","last_undegraded":"2023-10-21T18:28:15.182809+0000","last_fullsized":"2023-10-21T18:28:15.182809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'377","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.545050+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T18:28:10.545050+0000","last_peered":"2023-10-21T18:28:10.545050+0000","last_clean":"2023-10-21T18:28:10.545050+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:10.545050+0000","last_undegraded":"2023-10-21T18:28:10.545050+0000","last_fullsized":"2023-10-21T18:28:10.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'392","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:14.825818+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T18:26:14.825818+0000","last_peered":"2023-10-21T18:26:14.825818+0000","last_clean":"2023-10-21T18:26:14.825818+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:26:14.825818+0000","last_undegraded":"2023-10-21T18:26:14.825818+0000","last_fullsized":"2023-10-21T18:26:14.825818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'384","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.226669+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T18:28:04.226669+0000","last_peered":"2023-10-21T18:28:04.226669+0000","last_clean":"2023-10-21T18:28:04.226669+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:28:04.226669+0000","last_undegraded":"2023-10-21T18:28:04.226669+0000","last_fullsized":"2023-10-21T18:28:04.226669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'411","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:05.028546+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T18:27:05.028546+0000","last_peered":"2023-10-21T18:27:05.028546+0000","last_clean":"2023-10-21T18:27:05.028546+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:27:05.028546+0000","last_undegraded":"2023-10-21T18:27:05.028546+0000","last_fullsized":"2023-10-21T18:27:05.028546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:08:54.783802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'396","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.667404+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T18:27:48.667404+0000","last_peered":"2023-10-21T18:27:48.667404+0000","last_clean":"2023-10-21T18:27:48.667404+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:27:48.667404+0000","last_undegraded":"2023-10-21T18:27:48.667404+0000","last_fullsized":"2023-10-21T18:27:48.667404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:13.580533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":659,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:10.237903+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:27:10.237903+0000","last_peered":"2023-10-21T18:27:10.237903+0000","last_clean":"2023-10-21T18:27:10.237903+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:27:10.237903+0000","last_undegraded":"2023-10-21T18:27:10.237903+0000","last_fullsized":"2023-10-21T18:27:10.237903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'369","reported_seq":448,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.326927+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T18:27:27.326927+0000","last_peered":"2023-10-21T18:27:27.326927+0000","last_clean":"2023-10-21T18:27:27.326927+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:27:27.326927+0000","last_undegraded":"2023-10-21T18:27:27.326927+0000","last_fullsized":"2023-10-21T18:27:27.326927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1345","reported_seq":1414,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.560713+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T18:28:10.560713+0000","last_peered":"2023-10-21T18:28:10.560713+0000","last_clean":"2023-10-21T18:28:10.560713+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:10.560713+0000","last_undegraded":"2023-10-21T18:28:10.560713+0000","last_fullsized":"2023-10-21T18:28:10.560713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3532,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'360","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.967247+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T18:27:42.967247+0000","last_peered":"2023-10-21T18:27:42.967247+0000","last_clean":"2023-10-21T18:27:42.967247+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:27:42.967247+0000","last_undegraded":"2023-10-21T18:27:42.967247+0000","last_fullsized":"2023-10-21T18:27:42.967247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:07.060159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'319","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.831936+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T18:26:39.831936+0000","last_peered":"2023-10-21T18:26:39.831936+0000","last_clean":"2023-10-21T18:26:39.831936+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:26:39.831936+0000","last_undegraded":"2023-10-21T18:26:39.831936+0000","last_fullsized":"2023-10-21T18:26:39.831936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:42.553412+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T18:26:42.553412+0000","last_peered":"2023-10-21T18:26:42.553412+0000","last_clean":"2023-10-21T18:26:42.553412+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:26:42.553412+0000","last_undegraded":"2023-10-21T18:26:42.553412+0000","last_fullsized":"2023-10-21T18:26:42.553412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:43.338874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'261","reported_seq":330,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:39.673965+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T18:26:39.673965+0000","last_peered":"2023-10-21T18:26:39.673965+0000","last_clean":"2023-10-21T18:26:39.673965+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:26:39.673965+0000","last_undegraded":"2023-10-21T18:26:39.673965+0000","last_fullsized":"2023-10-21T18:26:39.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'413","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.526407+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T18:28:10.526407+0000","last_peered":"2023-10-21T18:28:10.526407+0000","last_clean":"2023-10-21T18:28:10.526407+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:10.526407+0000","last_undegraded":"2023-10-21T18:28:10.526407+0000","last_fullsized":"2023-10-21T18:28:10.526407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'420","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.170683+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T18:26:31.170683+0000","last_peered":"2023-10-21T18:26:31.170683+0000","last_clean":"2023-10-21T18:26:31.170683+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:26:31.170683+0000","last_undegraded":"2023-10-21T18:26:31.170683+0000","last_fullsized":"2023-10-21T18:26:31.170683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:27.159516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'397","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.242474+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T18:28:04.242474+0000","last_peered":"2023-10-21T18:28:04.242474+0000","last_clean":"2023-10-21T18:28:04.242474+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:04.242474+0000","last_undegraded":"2023-10-21T18:28:04.242474+0000","last_fullsized":"2023-10-21T18:28:04.242474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1148","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:37.076924+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T18:26:37.076924+0000","last_peered":"2023-10-21T18:26:37.076924+0000","last_clean":"2023-10-21T18:26:37.076924+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:26:37.076924+0000","last_undegraded":"2023-10-21T18:26:37.076924+0000","last_fullsized":"2023-10-21T18:26:37.076924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.776854+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T18:28:15.776854+0000","last_peered":"2023-10-21T18:28:15.776854+0000","last_clean":"2023-10-21T18:28:15.776854+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:15.776854+0000","last_undegraded":"2023-10-21T18:28:15.776854+0000","last_fullsized":"2023-10-21T18:28:15.776854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1137","reported_seq":1204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.168962+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T18:26:31.168962+0000","last_peered":"2023-10-21T18:26:31.168962+0000","last_clean":"2023-10-21T18:26:31.168962+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:26:31.168962+0000","last_undegraded":"2023-10-21T18:26:31.168962+0000","last_fullsized":"2023-10-21T18:26:31.168962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'440","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.692035+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:27:48.692035+0000","last_peered":"2023-10-21T18:27:48.692035+0000","last_clean":"2023-10-21T18:27:48.692035+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:27:48.692035+0000","last_undegraded":"2023-10-21T18:27:48.692035+0000","last_fullsized":"2023-10-21T18:27:48.692035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'441","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.453245+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:27:34.453245+0000","last_peered":"2023-10-21T18:27:34.453245+0000","last_clean":"2023-10-21T18:27:34.453245+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:27:34.453245+0000","last_undegraded":"2023-10-21T18:27:34.453245+0000","last_fullsized":"2023-10-21T18:27:34.453245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'765","reported_seq":827,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:43.346529+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T18:26:43.346529+0000","last_peered":"2023-10-21T18:26:43.346529+0000","last_clean":"2023-10-21T18:26:43.346529+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:26:43.346529+0000","last_undegraded":"2023-10-21T18:26:43.346529+0000","last_fullsized":"2023-10-21T18:26:43.346529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:52.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'366","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.437434+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T18:27:34.437434+0000","last_peered":"2023-10-21T18:27:34.437434+0000","last_clean":"2023-10-21T18:27:34.437434+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:27:34.437434+0000","last_undegraded":"2023-10-21T18:27:34.437434+0000","last_fullsized":"2023-10-21T18:27:34.437434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:44.934548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1571","reported_seq":1633,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:25:57.549801+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T18:25:57.549801+0000","last_peered":"2023-10-21T18:25:57.549801+0000","last_clean":"2023-10-21T18:25:57.549801+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:25:57.549801+0000","last_undegraded":"2023-10-21T18:25:57.549801+0000","last_fullsized":"2023-10-21T18:25:57.549801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:25.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'356","reported_seq":443,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.845257+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:27:37.845257+0000","last_peered":"2023-10-21T18:27:37.845257+0000","last_clean":"2023-10-21T18:27:37.845257+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:27:37.845257+0000","last_undegraded":"2023-10-21T18:27:37.845257+0000","last_fullsized":"2023-10-21T18:27:37.845257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:23.356717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'568","reported_seq":642,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.295042+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T18:27:54.295042+0000","last_peered":"2023-10-21T18:27:54.295042+0000","last_clean":"2023-10-21T18:27:54.295042+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:27:54.295042+0000","last_undegraded":"2023-10-21T18:27:54.295042+0000","last_fullsized":"2023-10-21T18:27:54.295042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'368","reported_seq":460,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:04.237947+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T18:28:04.237947+0000","last_peered":"2023-10-21T18:28:04.237947+0000","last_clean":"2023-10-21T18:28:04.237947+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:28:04.237947+0000","last_undegraded":"2023-10-21T18:28:04.237947+0000","last_fullsized":"2023-10-21T18:28:04.237947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:01:24.185840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'607","reported_seq":678,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:21.018625+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T18:27:21.018625+0000","last_peered":"2023-10-21T18:27:21.018625+0000","last_clean":"2023-10-21T18:27:21.018625+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:27:21.018625+0000","last_undegraded":"2023-10-21T18:27:21.018625+0000","last_fullsized":"2023-10-21T18:27:21.018625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:06.667203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25955,"ondisk_log_size":25955,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216338420,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24241,"num_write_kb":225035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432676739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23814,"ondisk_log_size":23814,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478194,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.093},"min":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.67000000000000004},"max":{"1min":1.704,"5min":1.704,"15min":2.2519999999999998},"last":1.04},{"interface":"front","average":{"1min":1.117,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.70399999999999996,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.871,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.7629999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2749999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7889999999999999,"5min":2.25,"15min":2.2610000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.298,"5min":1.3819999999999999,"15min":1.409},"min":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.69399999999999995},"max":{"1min":1.675,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.4550000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.526,"15min":1.5209999999999999},"min":{"1min":0.85599999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0670000000000002,"5min":2.367,"15min":2.367},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.536,"15min":1.5700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8109999999999999,"5min":2.0449999999999999,"15min":2.6669999999999998},"last":2.1200000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.974,"15min":2.782},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3300000000000001,"15min":1.375},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.319},"last":0.877}]},{"osd":5,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.431,"15min":1.482},"min":{"1min":0.874,"5min":0.874,"15min":0.70099999999999996},"max":{"1min":1.863,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.95799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.994,"5min":2.1760000000000002,"15min":2.423},"last":1.1910000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.49,"15min":1.512},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.9249999999999998},"last":2.0950000000000002},{"interface":"front","average":{"1min":1.52,"5min":1.607,"15min":1.6359999999999999},"min":{"1min":1.008,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.044,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.97899999999999998}]},{"osd":7,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.615,"15min":1.669},"min":{"1min":1.1579999999999999,"5min":1.01,"15min":0.999},"max":{"1min":2.1850000000000001,"5min":2.29,"15min":2.5859999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.6060000000000001,"15min":1.6439999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.2400000000000002,"5min":2.2429999999999999,"15min":3.0449999999999999},"last":2.1600000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.048},"min":{"1min":0.75700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7430000000000001,"5min":2.004,"15min":3.153},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.2310000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.899,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.806,"5min":2.1920000000000002,"15min":2.7480000000000002},"last":1.478},{"interface":"front","average":{"1min":1.512,"5min":1.4890000000000001,"15min":1.4379999999999999},"min":{"1min":0.78200000000000003,"5min":0.70999999999999996,"15min":0.63400000000000001},"max":{"1min":2.335,"5min":2.335,"15min":2.621},"last":1.417}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4079999999999999,"15min":1.409},"min":{"1min":0.90800000000000003,"5min":0.71299999999999997,"15min":0.55400000000000005},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.611,"15min":1.6240000000000001},"min":{"1min":1.01,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.1709999999999998,"5min":2.3130000000000002,"15min":3.867},"last":1.669}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3340000000000001,"15min":1.3560000000000001},"min":{"1min":0.83599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.782,"5min":2.048,"15min":2.895},"last":1.159},{"interface":"front","average":{"1min":1.456,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":1.0800000000000001,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":0.96399999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.524},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3839999999999999,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.71899999999999997,"15min":0.59899999999999998},"max":{"1min":2.1389999999999998,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":1.0640000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.46},"min":{"1min":0.93700000000000006,"5min":0.874,"15min":0.64400000000000002},"max":{"1min":2.282,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.296},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.5189999999999999},"min":{"1min":1.0900000000000001,"5min":0.85899999999999999,"15min":0.77300000000000002},"max":{"1min":2.0230000000000001,"5min":2.3780000000000001,"15min":3.0259999999999998},"last":1.359}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.619,"15min":1.5960000000000001},"min":{"1min":1.266,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2200000000000002,"5min":2.2330000000000001,"15min":2.8029999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6160000000000001,"15min":1.583},"min":{"1min":1.1679999999999999,"5min":0.93300000000000005,"15min":0.622},"max":{"1min":2.1720000000000002,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.5509999999999999}]}]},{"osd":1,"up_from":16,"seq":68719478195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51978808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0289999999999999,"15min":1.0720000000000001},"min":{"1min":0.71699999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4810000000000001,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.2989999999999999,"15min":1.274},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.82799999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0009999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.385,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":1.0549999999999999,"5min":0.83899999999999997,"15min":0.69699999999999995},"max":{"1min":1.875,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.6579999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.474,"15min":1.518},"min":{"1min":1.1299999999999999,"5min":0.88300000000000001,"15min":0.77300000000000002},"max":{"1min":2.0249999999999999,"5min":2.1099999999999999,"15min":2.681},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.526,"15min":1.5429999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.958,"5min":2.1480000000000001,"15min":2.544},"last":1.0129999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.3740000000000001},"min":{"1min":0.82299999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7150000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.3700000000000001,"15min":1.3740000000000001},"min":{"1min":0.91900000000000004,"5min":0.84499999999999997,"15min":0.746},"max":{"1min":1.766,"5min":1.958,"15min":2.1600000000000001},"last":1.337}]},{"osd":5,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.488,"15min":1.4750000000000001},"min":{"1min":0.98799999999999999,"5min":0.95199999999999996,"15min":0.87},"max":{"1min":1.8939999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.484,"15min":1.5249999999999999},"min":{"1min":0.97799999999999998,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.6850000000000001},"last":1.417}]},{"osd":6,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.526,"15min":1.534},"min":{"1min":1.069,"5min":0.875,"15min":0.83499999999999996},"max":{"1min":1.8779999999999999,"5min":2.173,"15min":2.5459999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6060000000000001,"15min":1.615},"min":{"1min":0.99099999999999999,"5min":0.94299999999999995,"15min":0.78900000000000003},"max":{"1min":1.998,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.601}]},{"osd":7,"last update":"Sat Oct 21 18:27:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.639,"15min":1.679},"min":{"1min":1.099,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.55},{"interface":"front","average":{"1min":1.669,"5min":1.679,"15min":1.7},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.7849999999999999}]}]},{"osd":0,"up_from":16,"seq":68719478196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84942858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1000000000000001,"15min":1.0820000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.528,"5min":2.016,"15min":2.04},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2629999999999999,"15min":1.264},"min":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.624},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.161},"last":1.881}]},{"osd":2,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2689999999999999,"15min":1.29},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.60599999999999998},"max":{"1min":1.95,"5min":1.95,"15min":2.3820000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.425,"15min":1.4379999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0590000000000002,"5min":2.1419999999999999,"15min":2.5550000000000002},"last":1.516}]},{"osd":3,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4910000000000001,"15min":1.47},"min":{"1min":1.016,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.008,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.512,"15min":1.5209999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.78300000000000003},"max":{"1min":2.242,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.9330000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.371,"15min":1.3740000000000001},"min":{"1min":0.84199999999999997,"5min":0.76900000000000002,"15min":0.73999999999999999},"max":{"1min":1.8420000000000001,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.8089999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.343},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.78100000000000003},"max":{"1min":2.113,"5min":2.113,"15min":2.1600000000000001},"last":1.119}]},{"osd":5,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.413,"15min":1.417},"min":{"1min":1.0169999999999999,"5min":0.83999999999999997,"15min":0.746},"max":{"1min":1.7509999999999999,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.5369999999999999,"15min":1.5389999999999999},"min":{"1min":1.1080000000000001,"5min":0.84699999999999998,"15min":0.76800000000000002},"max":{"1min":2.0009999999999999,"5min":2.597,"15min":2.7370000000000001},"last":1.968}]},{"osd":6,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.454,"15min":1.4830000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.85299999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.004},{"interface":"front","average":{"1min":1.579,"5min":1.5720000000000001,"15min":1.5600000000000001},"min":{"1min":1.0680000000000001,"5min":0.95299999999999996,"15min":0.93799999999999994},"max":{"1min":2.0369999999999999,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":1.169}]},{"osd":7,"last update":"Sat Oct 21 18:27:17 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.657,"15min":1.681},"min":{"1min":1.1659999999999999,"5min":1.0629999999999999,"15min":1.048},"max":{"1min":2.0750000000000002,"5min":2.206,"15min":2.5249999999999999},"last":1.266},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6739999999999999,"15min":1.694},"min":{"1min":1.036,"5min":0.91500000000000004,"15min":0.877},"max":{"1min":2.1150000000000002,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":2.1110000000000002}]}]},{"osd":6,"up_from":15,"seq":64424510898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.41499999999999998},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.1419999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.626}]},{"osd":1,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.47999999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0800000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":1.079,"5min":1.395,"15min":1.395},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1080000000000001,"5min":1.232,"15min":1.5069999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48599999999999999},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":2.1840000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"max":{"1min":1.1759999999999999,"5min":1.2969999999999999,"15min":1.327},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.82699999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.61199999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.36099999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.59199999999999997,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.72099999999999997,"15min":0.85699999999999998},"last":0.40400000000000003}]}]},{"osd":5,"up_from":15,"seq":64424510898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131172,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94240668,"statfs":{"total":96636764160,"available":96502444032,"internally_reserved":0,"allocated":52654080,"data_stored":52476445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81656263},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.45700000000000002,"15min":0.36899999999999999},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.212},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85999999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":0.98099999999999998,"5min":1.2549999999999999,"15min":1.554},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.026,"5min":1.1899999999999999,"15min":1.419},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.442,"15min":0.39300000000000002},"max":{"1min":1.036,"5min":1.264,"15min":1.3069999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47599999999999998},"max":{"1min":1.0740000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83199999999999996,"15min":0.79700000000000004},"min":{"1min":0.626,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1759999999999999,"5min":1.379,"15min":1.518},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.67900000000000005},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.26200000000000001},"max":{"1min":0.51500000000000001,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.53700000000000003,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.33300000000000002}]},{"osd":7,"last update":"Sat Oct 21 18:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.317,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":0.55500000000000005,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.377},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.57599999999999996,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.32200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424510898,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.1850000000000001,"15min":1.349},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.355},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.78400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.1830000000000001,"15min":1.429},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.499,"15min":0.42799999999999999},"max":{"1min":1.087,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.432},"max":{"1min":1.0680000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.76700000000000002},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.1719999999999999,"5min":1.24,"15min":1.349},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.121,"5min":1.2869999999999999,"15min":1.361},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0249999999999999,"5min":1.893,"15min":1.893},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.61699999999999999,"15min":0.68400000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.625,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.39600000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.59299999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.67700000000000005,"15min":0.77700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.81499999999999995},"last":0.55700000000000005}]}]},{"osd":7,"up_from":14,"seq":60129543602,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":0.93100000000000005}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":1.5760000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":1.268},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.2569999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55300000000000005}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51296583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:28:18.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T18:28:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.797+0000 7fd564101640 1 Processor -- start 2023-10-21T18:28:18.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.798+0000 7fd564101640 1 -- start start 2023-10-21T18:28:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.799+0000 7fd564101640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd55c151370 0x7fd55c0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.799+0000 7fd564101640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.799+0000 7fd564101640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c15b170 con 0x7fd55c0c6770 2023-10-21T18:28:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.799+0000 7fd564101640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c151750 con 0x7fd55c151370 2023-10-21T18:28:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.799+0000 7fd564101640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0c3e40 con 0x7fd55c0c84b0 2023-10-21T18:28:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.800+0000 7fd56169c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.800+0000 7fd561e9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd55c151370 0x7fd55c0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.800+0000 7fd56169c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41218/0 (socket says 172.21.15.12:41218) 2023-10-21T18:28:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.800+0000 7fd56169c640 1 -- 172.21.15.12:0/1039653377 learned_addr learned my addr 172.21.15.12:0/1039653377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:18.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.802+0000 7fd56169c640 1 -- 172.21.15.12:0/1039653377 >> v2:172.21.15.12:3300/0 conn(0x7fd55c151370 msgr2=0x7fd55c0c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:18.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.802+0000 7fd56169c640 1 --2- 172.21.15.12:0/1039653377 >> v2:172.21.15.12:3300/0 conn(0x7fd55c151370 0x7fd55c0c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.802+0000 7fd56169c640 1 -- 172.21.15.12:0/1039653377 >> v1:172.21.15.12:6789/0 conn(0x7fd55c0c6770 legacy=0x7fd55c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.802+0000 7fd56169c640 1 -- 172.21.15.12:0/1039653377 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c15b410 con 0x7fd55c0c84b0 2023-10-21T18:28:18.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.805+0000 7fd56169c640 1 --2- 172.21.15.12:0/1039653377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009870 tx=0x7fd54c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ed37153bc3bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.808+0000 7fd560e9b640 1 -- 172.21.15.12:0/1039653377 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c02f830 con 0x7fd55c0c84b0 2023-10-21T18:28:18.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd560e9b640 1 -- 172.21.15.12:0/1039653377 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c02f990 con 0x7fd55c0c84b0 2023-10-21T18:28:18.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd560e9b640 1 -- 172.21.15.12:0/1039653377 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c02fd20 con 0x7fd55c0c84b0 2023-10-21T18:28:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 -- 172.21.15.12:0/1039653377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 msgr2=0x7fd55c0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 --2- 172.21.15.12:0/1039653377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009870 tx=0x7fd54c02ba10 comp rx=0 tx=0).stop 2023-10-21T18:28:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 -- 172.21.15.12:0/1039653377 shutdown_connections 2023-10-21T18:28:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 --2- 172.21.15.12:0/1039653377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c0c84b0 0x7fd55c0c71a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 --2- 172.21.15.12:0/1039653377 >> v2:172.21.15.12:3300/0 conn(0x7fd55c151370 0x7fd55c0c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.809+0000 7fd564101640 1 -- 172.21.15.12:0/1039653377 >> 172.21.15.12:0/1039653377 conn(0x7fd55c06fad0 msgr2=0x7fd55c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.810+0000 7fd564101640 1 -- 172.21.15.12:0/1039653377 shutdown_connections 2023-10-21T18:28:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.810+0000 7fd564101640 1 -- 172.21.15.12:0/1039653377 wait complete. 2023-10-21T18:28:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.811+0000 7fd564101640 1 Processor -- start 2023-10-21T18:28:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.812+0000 7fd564101640 1 -- start start 2023-10-21T18:28:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.812+0000 7fd564101640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd55c0c6770 0x7fd55c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.812+0000 7fd564101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd55c0c84b0 0x7fd55c133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.812+0000 7fd564101640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd564101640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0cc840 con 0x7fd55c0c84b0 2023-10-21T18:28:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd564101640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0cb3d0 con 0x7fd55c0c6770 2023-10-21T18:28:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd564101640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c158a60 con 0x7fd55c151370 2023-10-21T18:28:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd56269e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd561e9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd55c0c6770 0x7fd55c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd56169c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd55c0c84b0 0x7fd55c133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd56269e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41232/0 (socket says 172.21.15.12:41232) 2023-10-21T18:28:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.813+0000 7fd56269e640 1 -- 172.21.15.12:0/3867944072 learned_addr learned my addr 172.21.15.12:0/3867944072 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:18.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.817+0000 7fd56269e640 1 -- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd55c0c6770 msgr2=0x7fd55c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.817+0000 7fd56269e640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd55c0c6770 0x7fd55c06c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.817+0000 7fd56269e640 1 -- 172.21.15.12:0/3867944072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd55c0c84b0 msgr2=0x7fd55c133fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.817+0000 7fd56269e640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd55c0c84b0 0x7fd55c133fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.817+0000 7fd56269e640 1 -- 172.21.15.12:0/3867944072 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0094d0 con 0x7fd55c151370 2023-10-21T18:28:18.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.819+0000 7fd56269e640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd55400c7a0 tx=0x7fd55400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:18.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.822+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554003b70 con 0x7fd55c151370 2023-10-21T18:28:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.822+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd554003cf0 con 0x7fd55c151370 2023-10-21T18:28:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.822+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554003ea0 con 0x7fd55c151370 2023-10-21T18:28:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.823+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55c0ca7c0 con 0x7fd55c151370 2023-10-21T18:28:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.823+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c0cad80 con 0x7fd55c151370 2023-10-21T18:28:18.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.824+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55c0619f0 con 0x7fd55c151370 2023-10-21T18:28:18.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.843+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd55400aa90 con 0x7fd55c151370 2023-10-21T18:28:18.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.844+0000 7fd5527fc640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 0x7fd54006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:18.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.845+0000 7fd561e9d640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 0x7fd54006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:18.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.845+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd554058be0 con 0x7fd55c151370 2023-10-21T18:28:18.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:18.846+0000 7fd561e9d640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 0x7fd54006d380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd5580079a0 tx=0x7fd558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.076+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd554054f20 con 0x7fd55c151370 2023-10-21T18:28:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.285+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd55c149870 con 0x7fd55c151370 2023-10-21T18:28:19.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.323+0000 7fd5527fc640 1 -- 172.21.15.12:0/3867944072 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16520 (secure 0 0 0) 0x7fd554059e60 con 0x7fd55c151370 2023-10-21T18:28:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:19.326 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:57.353629+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T18:28:19.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.326+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 msgr2=0x7fd54006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:19.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.326+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 0x7fd54006d380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd5580079a0 tx=0x7fd558008040 comp rx=0 tx=0).stop 2023-10-21T18:28:19.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.326+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 msgr2=0x7fd55c134500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:19.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.326+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd55400c7a0 tx=0x7fd55400cc60 comp rx=0 tx=0).stop 2023-10-21T18:28:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 shutdown_connections 2023-10-21T18:28:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd54006aec0 0x7fd54006d380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd55c151370 0x7fd55c134500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd55c0c84b0 0x7fd55c133fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 --2- 172.21.15.12:0/3867944072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd55c0c6770 0x7fd55c06c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 >> 172.21.15.12:0/3867944072 conn(0x7fd55c06fad0 msgr2=0x7fd55c0c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 shutdown_connections 2023-10-21T18:28:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:19.327+0000 7fd564101640 1 -- 172.21.15.12:0/3867944072 wait complete. 2023-10-21T18:28:20.350 INFO:tasks.ceph:Scrubbing osd.0 2023-10-21T18:28:20.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.584+0000 7f250d834640 1 Processor -- start 2023-10-21T18:28:20.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.585+0000 7f250d834640 1 -- start start 2023-10-21T18:28:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f250d834640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25080c59d0 0x7f2508150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f250d834640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 0x7f2508151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f250d834640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25080c23f0 con 0x7f25080c55f0 2023-10-21T18:28:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f250d834640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2508156fa0 con 0x7f25080c59d0 2023-10-21T18:28:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f250d834640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250815aaf0 con 0x7f250815a590 2023-10-21T18:28:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f2506ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f25080c55f0 0x7f2508157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:58162/0 (socket says 172.21.15.12:58162) 2023-10-21T18:28:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f2506ffd640 1 -- 172.21.15.12:0/85400244 learned_addr learned my addr 172.21.15.12:0/85400244 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.587+0000 7f25077fe640 1 --2- 172.21.15.12:0/85400244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 0x7f2508151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.588+0000 7f24fe7fc640 1 --2- 172.21.15.12:0/85400244 >> v2:172.21.15.12:3300/0 conn(0x7f25080c59d0 0x7f2508150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25067fc640 1 -- 172.21.15.12:0/85400244 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859287179 0 0) 0x7f25080c23f0 con 0x7f25080c55f0 2023-10-21T18:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25067fc640 1 -- 172.21.15.12:0/85400244 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f4003520 con 0x7f25080c55f0 2023-10-21T18:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25077fe640 1 -- 172.21.15.12:0/85400244 >> v2:172.21.15.12:3300/0 conn(0x7f25080c59d0 msgr2=0x7f2508150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25077fe640 1 --2- 172.21.15.12:0/85400244 >> v2:172.21.15.12:3300/0 conn(0x7f25080c59d0 0x7f2508150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25077fe640 1 -- 172.21.15.12:0/85400244 >> v1:172.21.15.99:6789/0 conn(0x7f25080c55f0 legacy=0x7f2508157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.590+0000 7f25077fe640 1 -- 172.21.15.12:0/85400244 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250815add0 con 0x7f250815a590 2023-10-21T18:28:20.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.592+0000 7f25077fe640 1 --2- 172.21.15.12:0/85400244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 0x7f2508151320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2500009d90 tx=0x7f250002bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=615d0f67c3ca1688 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.596+0000 7f25067fc640 1 -- 172.21.15.12:0/85400244 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250002ccf0 con 0x7f250815a590 2023-10-21T18:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.596+0000 7f25067fc640 1 -- 172.21.15.12:0/85400244 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250002ce50 con 0x7f250815a590 2023-10-21T18:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.596+0000 7f25067fc640 1 -- 172.21.15.12:0/85400244 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500034660 con 0x7f250815a590 2023-10-21T18:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 -- 172.21.15.12:0/85400244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 msgr2=0x7f2508151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 --2- 172.21.15.12:0/85400244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 0x7f2508151320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2500009d90 tx=0x7f250002bf40 comp rx=0 tx=0).stop 2023-10-21T18:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 -- 172.21.15.12:0/85400244 shutdown_connections 2023-10-21T18:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 --2- 172.21.15.12:0/85400244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f250815a590 0x7f2508151320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 --2- 172.21.15.12:0/85400244 >> v2:172.21.15.12:3300/0 conn(0x7f25080c59d0 0x7f2508150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 -- 172.21.15.12:0/85400244 >> 172.21.15.12:0/85400244 conn(0x7f2508069de0 msgr2=0x7f250806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 -- 172.21.15.12:0/85400244 shutdown_connections 2023-10-21T18:28:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.597+0000 7f250d834640 1 -- 172.21.15.12:0/85400244 wait complete. 2023-10-21T18:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.599+0000 7f250d834640 1 Processor -- start 2023-10-21T18:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.599+0000 7f250d834640 1 -- start start 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25080c55f0 0x7f25080c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25080c59d0 0x7f25080c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f250815a590 0x7f25081460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080c9300 con 0x7f250815a590 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25081edb00 con 0x7f25080c59d0 2023-10-21T18:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.600+0000 7f250d834640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080ca210 con 0x7f25080c55f0 2023-10-21T18:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.601+0000 7f24fe7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25080c59d0 0x7f25080c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.601+0000 7f2506ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25080c55f0 0x7f25080c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.601+0000 7f25077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f250815a590 0x7f25081460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.601+0000 7f2506ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25080c55f0 0x7f25080c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41236/0 (socket says 172.21.15.12:41236) 2023-10-21T18:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.601+0000 7f2506ffd640 1 -- 172.21.15.12:0/177610985 learned_addr learned my addr 172.21.15.12:0/177610985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.604+0000 7f24fe7fc640 1 -- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25080c55f0 msgr2=0x7f25080c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.604+0000 7f24fe7fc640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25080c55f0 0x7f25080c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.604+0000 7f24fe7fc640 1 -- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f250815a590 msgr2=0x7f25081460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.604+0000 7f24fe7fc640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f250815a590 0x7f25081460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.604+0000 7f24fe7fc640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500009a70 con 0x7f25080c59d0 2023-10-21T18:28:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.607+0000 7f24fe7fc640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25080c59d0 0x7f25080c8dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24f000e850 tx=0x7f24f000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.610+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00095b0 con 0x7f25080c59d0 2023-10-21T18:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.610+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000c940 con 0x7f25080c59d0 2023-10-21T18:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.610+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000ccd0 con 0x7f25080c59d0 2023-10-21T18:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.610+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25081edd50 con 0x7f25080c59d0 2023-10-21T18:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.610+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25081ee310 con 0x7f25080c59d0 2023-10-21T18:28:20.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.611+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f250815b390 con 0x7f25080c59d0 2023-10-21T18:28:20.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.631+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24f0013470 con 0x7f25080c59d0 2023-10-21T18:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.633+0000 7f2504ff9640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f24e806aef0 0x7f24e806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.633+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f24f0054f40 con 0x7f25080c59d0 2023-10-21T18:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.633+0000 7f2504ff9640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f24e8073150 0x7f24e8075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.633+0000 7f2506ffd640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f24e806aef0 0x7f24e806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.633+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24e8075c60 con 0x7f24e8073150 2023-10-21T18:28:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.634+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f0055100 con 0x7f25080c59d0 2023-10-21T18:28:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.634+0000 7f25077fe640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f24e8073150 0x7f24e8075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.634+0000 7f2506ffd640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f24e806aef0 0x7f24e806d3b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24f8005880 tx=0x7f24f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.635+0000 7f25077fe640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f24e8073150 0x7f24e8075590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.636+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== osd.0 v2:172.21.15.12:6800/669872713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f24e8075c60 con 0x7f24e8073150 2023-10-21T18:28:20.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.653+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 --> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f250815b0b0 con 0x7f24e8073150 2023-10-21T18:28:20.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.654+0000 7f2504ff9640 1 -- 172.21.15.12:0/177610985 <== osd.0 v2:172.21.15.12:6800/669872713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2500034440 con 0x7f24e8073150 2023-10-21T18:28:20.656 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:20.657 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:20.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.654+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f24e8073150 msgr2=0x7f24e8075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.654+0000 7f250d834640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.12:6800/669872713,v1:172.21.15.12:6801/669872713] conn(0x7f24e8073150 0x7f24e8075590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f24e806aef0 msgr2=0x7f24e806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f24e806aef0 0x7f24e806d3b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24f8005880 tx=0x7f24f8009040 comp rx=0 tx=0).stop 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25080c59d0 msgr2=0x7f25080c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 --2- 172.21.15.12:0/177610985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25080c59d0 0x7f25080c8dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24f000e850 tx=0x7f24f000ed10 comp rx=0 tx=0).stop 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f25077fe640 1 -- 172.21.15.12:0/177610985 reap_dead start 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 shutdown_connections 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 >> 172.21.15.12:0/177610985 conn(0x7f2508069de0 msgr2=0x7f2508147370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:20.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 shutdown_connections 2023-10-21T18:28:20.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.655+0000 7f250d834640 1 -- 172.21.15.12:0/177610985 wait complete. 2023-10-21T18:28:20.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-21T18:28:20.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.894+0000 7f85adc59640 1 Processor -- start 2023-10-21T18:28:20.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.894+0000 7f85adc59640 1 -- start start 2023-10-21T18:28:20.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.896+0000 7f85adc59640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85a8150ff0 0x7f85a806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.896+0000 7f85adc59640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a815a610 0x7f85a815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.896+0000 7f85adc59640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a815afe0 con 0x7f85a806e0a0 2023-10-21T18:28:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.896+0000 7f85adc59640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a8157db0 con 0x7f85a8150ff0 2023-10-21T18:28:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.896+0000 7f85adc59640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c65a0 con 0x7f85a815a610 2023-10-21T18:28:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.897+0000 7f85acc57640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85a8150ff0 0x7f85a806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.897+0000 7f85ad458640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a815a610 0x7f85a815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.897+0000 7f85acc57640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85a8150ff0 0x7f85a806d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44314/0 (socket says 172.21.15.12:44314) 2023-10-21T18:28:20.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.897+0000 7f85acc57640 1 -- 172.21.15.12:0/1651099286 learned_addr learned my addr 172.21.15.12:0/1651099286 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.899+0000 7f85acc57640 1 -- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a815a610 msgr2=0x7f85a815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.899+0000 7f85acc57640 1 --2- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a815a610 0x7f85a815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.899+0000 7f85acc57640 1 -- 172.21.15.12:0/1651099286 >> v1:172.21.15.12:6789/0 conn(0x7f85a806e0a0 legacy=0x7f85a80ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.899+0000 7f85acc57640 1 -- 172.21.15.12:0/1651099286 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8156e70 con 0x7f85a8150ff0 2023-10-21T18:28:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.902+0000 7f85acc57640 1 --2- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a806d4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f859c009870 tx=0x7f859c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f98be560bcb156 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.906+0000 7f85a77fe640 1 -- 172.21.15.12:0/1651099286 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c030840 con 0x7f85a8150ff0 2023-10-21T18:28:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.906+0000 7f85a77fe640 1 -- 172.21.15.12:0/1651099286 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0309a0 con 0x7f85a8150ff0 2023-10-21T18:28:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.906+0000 7f85a77fe640 1 -- 172.21.15.12:0/1651099286 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c030d30 con 0x7f85a8150ff0 2023-10-21T18:28:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.906+0000 7f85adc59640 1 -- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 msgr2=0x7f85a806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.906+0000 7f85adc59640 1 --2- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a806d4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f859c009870 tx=0x7f859c02b980 comp rx=0 tx=0).stop 2023-10-21T18:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 -- 172.21.15.12:0/1651099286 shutdown_connections 2023-10-21T18:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 --2- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a815a610 0x7f85a815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 --2- 172.21.15.12:0/1651099286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a806d4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 -- 172.21.15.12:0/1651099286 >> 172.21.15.12:0/1651099286 conn(0x7f85a806bac0 msgr2=0x7f85a806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 -- 172.21.15.12:0/1651099286 shutdown_connections 2023-10-21T18:28:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.907+0000 7f85adc59640 1 -- 172.21.15.12:0/1651099286 wait complete. 2023-10-21T18:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.908+0000 7f85adc59640 1 Processor -- start 2023-10-21T18:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.909+0000 7f85adc59640 1 -- start start 2023-10-21T18:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.909+0000 7f85adc59640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 0x7f85a8152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.909+0000 7f85adc59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a81558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.910+0000 7f85adc59640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85a815a610 0x7f85a81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:20.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.910+0000 7f85adc59640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81580d0 con 0x7f85a815a610 2023-10-21T18:28:20.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.910+0000 7f85adc59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8158370 con 0x7f85a8150ff0 2023-10-21T18:28:20.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.910+0000 7f85adc59640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8158650 con 0x7f85a806e0a0 2023-10-21T18:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.910+0000 7f85acc57640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 0x7f85a8152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.911+0000 7f85acc57640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 0x7f85a8152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41246/0 (socket says 172.21.15.12:41246) 2023-10-21T18:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.911+0000 7f85acc57640 1 -- 172.21.15.12:0/4225716781 learned_addr learned my addr 172.21.15.12:0/4225716781 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.911+0000 7f85a7fff640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a81558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.911+0000 7f85ad458640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85a815a610 0x7f85a81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.914+0000 7f85a7fff640 1 -- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 msgr2=0x7f85a8152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.914+0000 7f85a7fff640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 0x7f85a8152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.914+0000 7f85a7fff640 1 -- 172.21.15.12:0/4225716781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85a815a610 msgr2=0x7f85a81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.914+0000 7f85a7fff640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85a815a610 0x7f85a81541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.914+0000 7f85a7fff640 1 -- 172.21.15.12:0/4225716781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0094d0 con 0x7f85a8150ff0 2023-10-21T18:28:20.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.916+0000 7f85a7fff640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a81558f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f859400c390 tx=0x7f859400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.920+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940052d0 con 0x7f85a8150ff0 2023-10-21T18:28:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.920+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594005430 con 0x7f85a8150ff0 2023-10-21T18:28:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.920+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a8158930 con 0x7f85a8150ff0 2023-10-21T18:28:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.920+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594003830 con 0x7f85a8150ff0 2023-10-21T18:28:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.920+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8071610 con 0x7f85a8150ff0 2023-10-21T18:28:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:20.921+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a8067560 con 0x7f85a8150ff0 2023-10-21T18:28:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.164+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8594003990 con 0x7f85a8150ff0 2023-10-21T18:28:21.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.166+0000 7f85a57fa640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 0x7f858c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.166+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8594088c40 con 0x7f85a8150ff0 2023-10-21T18:28:21.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.167+0000 7f85acc57640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 0x7f858c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.168+0000 7f85acc57640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 0x7f858c06d3b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f859c009870 tx=0x7f859c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.176+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8594053ed0 con 0x7f85a8150ff0 2023-10-21T18:28:21.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.418+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f85a8157410 con 0x7f858c06aef0 2023-10-21T18:28:21.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.419+0000 7f85a57fa640 1 -- 172.21.15.12:0/4225716781 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f859c030b90 con 0x7f858c06aef0 2023-10-21T18:28:21.421 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2023-10-21T18:28:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.421+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 msgr2=0x7f858c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.421+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 0x7f858c06d3b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f859c009870 tx=0x7f859c008030 comp rx=0 tx=0).stop 2023-10-21T18:28:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.421+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 msgr2=0x7f85a81558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.421+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a81558f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f859400c390 tx=0x7f859400c850 comp rx=0 tx=0).stop 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 shutdown_connections 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f858c06aef0 0x7f858c06d3b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85a815a610 0x7f85a81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a8150ff0 0x7f85a81558f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 --2- 172.21.15.12:0/4225716781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85a806e0a0 0x7f85a8152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 >> 172.21.15.12:0/4225716781 conn(0x7f85a806bac0 msgr2=0x7f85a80c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:21.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 shutdown_connections 2023-10-21T18:28:21.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.422+0000 7f85adc59640 1 -- 172.21.15.12:0/4225716781 wait complete. 2023-10-21T18:28:21.442 INFO:tasks.ceph:Scrubbing osd.1 2023-10-21T18:28:21.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.663+0000 7fc1213e2640 1 Processor -- start 2023-10-21T18:28:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.663+0000 7fc1213e2640 1 -- start start 2023-10-21T18:28:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.665+0000 7fc1213e2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc11c0c55f0 0x7fc11c157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.665+0000 7fc1213e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc11c0c59d0 0x7fc11c0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.665+0000 7fc1213e2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0c23f0 con 0x7fc11c157cc0 2023-10-21T18:28:21.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.665+0000 7fc1213e2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c156fa0 con 0x7fc11c0c59d0 2023-10-21T18:28:21.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.665+0000 7fc1213e2640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c15aaf0 con 0x7fc11c0c55f0 2023-10-21T18:28:21.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.666+0000 7fc11b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc11c0c59d0 0x7fc11c0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.667+0000 7fc11affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc11c0c55f0 0x7fc11c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.667+0000 7fc1127fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc11c157cc0 0x7fc11c150de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:58170/0 (socket says 172.21.15.12:58170) 2023-10-21T18:28:21.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.667+0000 7fc1127fc640 1 -- 172.21.15.12:0/554770664 learned_addr learned my addr 172.21.15.12:0/554770664 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:21.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.670+0000 7fc11b7fe640 1 -- 172.21.15.12:0/554770664 >> v2:172.21.15.99:3300/0 conn(0x7fc11c0c55f0 msgr2=0x7fc11c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:21.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.670+0000 7fc11b7fe640 1 --2- 172.21.15.12:0/554770664 >> v2:172.21.15.99:3300/0 conn(0x7fc11c0c55f0 0x7fc11c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.670+0000 7fc11b7fe640 1 -- 172.21.15.12:0/554770664 >> v1:172.21.15.99:6789/0 conn(0x7fc11c157cc0 legacy=0x7fc11c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.670+0000 7fc11b7fe640 1 -- 172.21.15.12:0/554770664 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c15add0 con 0x7fc11c0c59d0 2023-10-21T18:28:21.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.672+0000 7fc11b7fe640 1 --2- 172.21.15.12:0/554770664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c0c59d0 0x7fc11c0c7020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0c50a0 tx=0x7fc11402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9a5aa7f504ecda server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.677+0000 7fc11a7fc640 1 -- 172.21.15.12:0/554770664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11402cd00 con 0x7fc11c0c59d0 2023-10-21T18:28:21.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc11a7fc640 1 -- 172.21.15.12:0/554770664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11402ce60 con 0x7fc11c0c59d0 2023-10-21T18:28:21.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc11a7fc640 1 -- 172.21.15.12:0/554770664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114034660 con 0x7fc11c0c59d0 2023-10-21T18:28:21.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 -- 172.21.15.12:0/554770664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c0c59d0 msgr2=0x7fc11c0c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 --2- 172.21.15.12:0/554770664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c0c59d0 0x7fc11c0c7020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0c50a0 tx=0x7fc11402bf50 comp rx=0 tx=0).stop 2023-10-21T18:28:21.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 -- 172.21.15.12:0/554770664 shutdown_connections 2023-10-21T18:28:21.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 --2- 172.21.15.12:0/554770664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c0c59d0 0x7fc11c0c7020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 --2- 172.21.15.12:0/554770664 >> v2:172.21.15.99:3300/0 conn(0x7fc11c0c55f0 0x7fc11c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.678+0000 7fc1213e2640 1 -- 172.21.15.12:0/554770664 >> 172.21.15.12:0/554770664 conn(0x7fc11c069de0 msgr2=0x7fc11c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:21.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.679+0000 7fc1213e2640 1 -- 172.21.15.12:0/554770664 shutdown_connections 2023-10-21T18:28:21.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.679+0000 7fc1213e2640 1 -- 172.21.15.12:0/554770664 wait complete. 2023-10-21T18:28:21.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.681+0000 7fc1213e2640 1 Processor -- start 2023-10-21T18:28:21.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.681+0000 7fc1213e2640 1 -- start start 2023-10-21T18:28:21.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc11c0c55f0 0x7fc11c143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 0x7fc11c151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c157cc0 0x7fc11c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c14bc50 con 0x7fc11c157cc0 2023-10-21T18:28:21.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c153210 con 0x7fc11c0c59d0 2023-10-21T18:28:21.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.682+0000 7fc1213e2640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c150d50 con 0x7fc11c0c55f0 2023-10-21T18:28:21.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.683+0000 7fc11b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c157cc0 0x7fc11c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.683+0000 7fc1127fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 0x7fc11c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.683+0000 7fc11affd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc11c0c55f0 0x7fc11c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.683+0000 7fc1127fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 0x7fc11c151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44328/0 (socket says 172.21.15.12:44328) 2023-10-21T18:28:21.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.683+0000 7fc1127fc640 1 -- 172.21.15.12:0/1107295451 learned_addr learned my addr 172.21.15.12:0/1107295451 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:21.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.686+0000 7fc1127fc640 1 -- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc11c0c55f0 msgr2=0x7fc11c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.686+0000 7fc1127fc640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc11c0c55f0 0x7fc11c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.686+0000 7fc1127fc640 1 -- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c157cc0 msgr2=0x7fc11c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.686+0000 7fc1127fc640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc11c157cc0 0x7fc11c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.686+0000 7fc1127fc640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009a70 con 0x7fc11c0c59d0 2023-10-21T18:28:21.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.689+0000 7fc1127fc640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 0x7fc11c151810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c3c0 tx=0x7fc10400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:21.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.691+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104005ce0 con 0x7fc11c0c59d0 2023-10-21T18:28:21.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.691+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c151030 con 0x7fc11c0c59d0 2023-10-21T18:28:21.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.691+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c14b600 con 0x7fc11c0c59d0 2023-10-21T18:28:21.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.692+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc11c15b390 con 0x7fc11c0c59d0 2023-10-21T18:28:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.711+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104005e40 con 0x7fc11c0c59d0 2023-10-21T18:28:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.711+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104007270 con 0x7fc11c0c59d0 2023-10-21T18:28:21.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.713+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc104007490 con 0x7fc11c0c59d0 2023-10-21T18:28:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.715+0000 7fc113fff640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc0fc06aea0 0x7fc0fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.715+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc104054ac0 con 0x7fc11c0c59d0 2023-10-21T18:28:21.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.715+0000 7fc11affd640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc0fc06aea0 0x7fc0fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.715+0000 7fc113fff640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fc0fc073100 0x7fc0fc075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.715+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0fc075c10 con 0x7fc0fc073100 2023-10-21T18:28:21.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.716+0000 7fc11b7fe640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fc0fc073100 0x7fc0fc075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.716+0000 7fc11affd640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc0fc06aea0 0x7fc0fc06d360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009b40 tx=0x7fc10c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.716+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc104054c80 con 0x7fc11c0c59d0 2023-10-21T18:28:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.717+0000 7fc11b7fe640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fc0fc073100 0x7fc0fc075540 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.718+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== osd.1 v2:172.21.15.12:6812/2520400743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc0fc075c10 con 0x7fc0fc073100 2023-10-21T18:28:21.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.739+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 --> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc11c067210 con 0x7fc0fc073100 2023-10-21T18:28:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.740+0000 7fc113fff640 1 -- 172.21.15.12:0/1107295451 <== osd.1 v2:172.21.15.12:6812/2520400743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc11c067210 con 0x7fc0fc073100 2023-10-21T18:28:21.743 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:21.743 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:21.743 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fc0fc073100 msgr2=0x7fc0fc075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.12:6812/2520400743,v1:172.21.15.12:6814/2520400743] conn(0x7fc0fc073100 0x7fc0fc075540 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc0fc06aea0 msgr2=0x7fc0fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc0fc06aea0 0x7fc0fc06d360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009b40 tx=0x7fc10c009190 comp rx=0 tx=0).stop 2023-10-21T18:28:21.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 msgr2=0x7fc11c151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:21.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 --2- 172.21.15.12:0/1107295451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc11c0c59d0 0x7fc11c151810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c3c0 tx=0x7fc10400c880 comp rx=0 tx=0).stop 2023-10-21T18:28:21.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc11b7fe640 1 -- 172.21.15.12:0/1107295451 reap_dead start 2023-10-21T18:28:21.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 shutdown_connections 2023-10-21T18:28:21.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.741+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 >> 172.21.15.12:0/1107295451 conn(0x7fc11c069de0 msgr2=0x7fc11c14dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:21.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.742+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 shutdown_connections 2023-10-21T18:28:21.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.742+0000 7fc1213e2640 1 -- 172.21.15.12:0/1107295451 wait complete. 2023-10-21T18:28:21.767 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-21T18:28:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.995+0000 7f35d9a51640 1 Processor -- start 2023-10-21T18:28:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.995+0000 7f35d9a51640 1 -- start start 2023-10-21T18:28:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.997+0000 7f35d9a51640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35d414f940 0x7f35d40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.997+0000 7f35d9a51640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40c3d50 con 0x7f35d40c1a00 2023-10-21T18:28:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.997+0000 7f35d9a51640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d4070a30 con 0x7f35d4071ed0 2023-10-21T18:28:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.997+0000 7f35d9a51640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d4071ab0 con 0x7f35d414f940 2023-10-21T18:28:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.997+0000 7f35d2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35d414f940 0x7f35d40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.998+0000 7f35d27fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f35d4071ed0 0x7f35d40c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:58172/0 (socket says 172.21.15.12:58172) 2023-10-21T18:28:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:21.998+0000 7f35d27fc640 1 -- 172.21.15.12:0/3297087524 learned_addr learned my addr 172.21.15.12:0/3297087524 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.000+0000 7f35d1ffb640 1 -- 172.21.15.12:0/3297087524 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101182373 0 0) 0x7f35d4070a30 con 0x7f35d4071ed0 2023-10-21T18:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.000+0000 7f35d1ffb640 1 -- 172.21.15.12:0/3297087524 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc005730 con 0x7f35d4071ed0 2023-10-21T18:28:22.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.002+0000 7f35d2ffd640 1 -- 172.21.15.12:0/3297087524 >> v1:172.21.15.99:6789/0 conn(0x7f35d4071ed0 legacy=0x7f35d40c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.002+0000 7f35d2ffd640 1 -- 172.21.15.12:0/3297087524 >> v1:172.21.15.12:6789/0 conn(0x7f35d40c1a00 legacy=0x7f35d406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.003+0000 7f35d2ffd640 1 -- 172.21.15.12:0/3297087524 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40c34b0 con 0x7f35d414f940 2023-10-21T18:28:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.011+0000 7f35d2ffd640 1 --2- 172.21.15.12:0/3297087524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d414f940 0x7f35d40704f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35c400a940 tx=0x7f35c402bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3799fd5bdf2b96e server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.014+0000 7f35d1ffb640 1 -- 172.21.15.12:0/3297087524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c402cac0 con 0x7f35d414f940 2023-10-21T18:28:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.017+0000 7f35d1ffb640 1 -- 172.21.15.12:0/3297087524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c402cc20 con 0x7f35d414f940 2023-10-21T18:28:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.017+0000 7f35d1ffb640 1 -- 172.21.15.12:0/3297087524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4034440 con 0x7f35d414f940 2023-10-21T18:28:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 -- 172.21.15.12:0/3297087524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d414f940 msgr2=0x7f35d40704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3297087524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d414f940 0x7f35d40704f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35c400a940 tx=0x7f35c402bd10 comp rx=0 tx=0).stop 2023-10-21T18:28:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 -- 172.21.15.12:0/3297087524 shutdown_connections 2023-10-21T18:28:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3297087524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d414f940 0x7f35d40704f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 -- 172.21.15.12:0/3297087524 >> 172.21.15.12:0/3297087524 conn(0x7f35d4069de0 msgr2=0x7f35d406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 -- 172.21.15.12:0/3297087524 shutdown_connections 2023-10-21T18:28:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.018+0000 7f35d9a51640 1 -- 172.21.15.12:0/3297087524 wait complete. 2023-10-21T18:28:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.020+0000 7f35d9a51640 1 Processor -- start 2023-10-21T18:28:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.020+0000 7f35d9a51640 1 -- start start 2023-10-21T18:28:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d4071ed0 0x7f35d4141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 0x7f35d4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4140ad0 con 0x7f35d4071ed0 2023-10-21T18:28:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41532d0 con 0x7f35d414f940 2023-10-21T18:28:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.021+0000 7f35d9a51640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41ee9b0 con 0x7f35d40c1a00 2023-10-21T18:28:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d27fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 0x7f35d4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d4071ed0 0x7f35d4141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44330/0 (socket says 172.21.15.12:44330) 2023-10-21T18:28:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d27fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 0x7f35d4153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41274/0 (socket says 172.21.15.12:41274) 2023-10-21T18:28:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.022+0000 7f35d37fe640 1 -- 172.21.15.12:0/3091166259 learned_addr learned my addr 172.21.15.12:0/3091166259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.026+0000 7f35d37fe640 1 -- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 msgr2=0x7f35d4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.026+0000 7f35d37fe640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 0x7f35d4153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.026+0000 7f35d37fe640 1 -- 172.21.15.12:0/3091166259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d4071ed0 msgr2=0x7f35d4141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.026+0000 7f35d37fe640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d4071ed0 0x7f35d4141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.026+0000 7f35d37fe640 1 -- 172.21.15.12:0/3091166259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c400a5a0 con 0x7f35d414f940 2023-10-21T18:28:22.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.028+0000 7f35d37fe640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c760 tx=0x7f35cc00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.031+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc003b70 con 0x7f35d414f940 2023-10-21T18:28:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.032+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc003cf0 con 0x7f35d414f940 2023-10-21T18:28:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.032+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00aa90 con 0x7f35d414f940 2023-10-21T18:28:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.032+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d41eec30 con 0x7f35d414f940 2023-10-21T18:28:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.032+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d41ef1f0 con 0x7f35d414f940 2023-10-21T18:28:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.033+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d41534a0 con 0x7f35d414f940 2023-10-21T18:28:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.052+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35cc00abf0 con 0x7f35d414f940 2023-10-21T18:28:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.053+0000 7f35bbfff640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 0x7f35c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.054+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35cc089a50 con 0x7f35d414f940 2023-10-21T18:28:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.054+0000 7f35d2ffd640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 0x7f35c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.055+0000 7f35d2ffd640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 0x7f35c006d380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35c4036000 tx=0x7f35c4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.292+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35cc054c50 con 0x7f35d414f940 2023-10-21T18:28:22.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.506+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d40c3a70 con 0x7f35c006aec0 2023-10-21T18:28:22.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.508+0000 7f35bbfff640 1 -- 172.21.15.12:0/3091166259 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35c4004140 con 0x7f35c006aec0 2023-10-21T18:28:22.510 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2023-10-21T18:28:22.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 msgr2=0x7f35c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 0x7f35c006d380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35c4036000 tx=0x7f35c4030000 comp rx=0 tx=0).stop 2023-10-21T18:28:22.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 msgr2=0x7f35d4153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c760 tx=0x7f35cc00cc20 comp rx=0 tx=0).stop 2023-10-21T18:28:22.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 shutdown_connections 2023-10-21T18:28:22.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f35c006aec0 0x7f35c006d380 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d414f940 0x7f35d4153cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35d40c1a00 0x7f35d4153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 --2- 172.21.15.12:0/3091166259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d4071ed0 0x7f35d4141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 >> 172.21.15.12:0/3091166259 conn(0x7f35d4069de0 msgr2=0x7f35d406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 shutdown_connections 2023-10-21T18:28:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.511+0000 7f35d9a51640 1 -- 172.21.15.12:0/3091166259 wait complete. 2023-10-21T18:28:22.534 INFO:tasks.ceph:Scrubbing osd.2 2023-10-21T18:28:22.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.764+0000 7f9ebcc90640 1 Processor -- start 2023-10-21T18:28:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.764+0000 7f9ebcc90640 1 -- start start 2023-10-21T18:28:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9ebcc90640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9eb814fe80 0x7f9eb80c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9ebcc90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9ebcc90640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb8150260 con 0x7f9eb8069fd0 2023-10-21T18:28:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9ebcc90640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80c6370 con 0x7f9eb814fe80 2023-10-21T18:28:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9ebcc90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8155b80 con 0x7f9eb8159170 2023-10-21T18:28:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.766+0000 7f9eb77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9eb814fe80 0x7f9eb80c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.767+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41290/0 (socket says 172.21.15.12:41290) 2023-10-21T18:28:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.767+0000 7f9eb6ffd640 1 -- 172.21.15.12:0/4056358908 learned_addr learned my addr 172.21.15.12:0/4056358908 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.769+0000 7f9eb6ffd640 1 -- 172.21.15.12:0/4056358908 >> v2:172.21.15.99:3300/0 conn(0x7f9eb814fe80 msgr2=0x7f9eb80c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.769+0000 7f9eb6ffd640 1 --2- 172.21.15.12:0/4056358908 >> v2:172.21.15.99:3300/0 conn(0x7f9eb814fe80 0x7f9eb80c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.769+0000 7f9eb6ffd640 1 -- 172.21.15.12:0/4056358908 >> v1:172.21.15.99:6789/0 conn(0x7f9eb8069fd0 legacy=0x7f9eb80c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.769+0000 7f9eb6ffd640 1 -- 172.21.15.12:0/4056358908 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80c5ad0 con 0x7f9eb8159170 2023-10-21T18:28:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.771+0000 7f9eb6ffd640 1 --2- 172.21.15.12:0/4056358908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009870 tx=0x7f9ea002dc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9ee7e52a99d9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.775+0000 7f9eb67fc640 1 -- 172.21.15.12:0/4056358908 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea002e9d0 con 0x7f9eb8159170 2023-10-21T18:28:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.775+0000 7f9eb67fc640 1 -- 172.21.15.12:0/4056358908 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea002eb30 con 0x7f9eb8159170 2023-10-21T18:28:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.775+0000 7f9eb67fc640 1 -- 172.21.15.12:0/4056358908 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0036440 con 0x7f9eb8159170 2023-10-21T18:28:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 -- 172.21.15.12:0/4056358908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 msgr2=0x7f9eb8156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/4056358908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009870 tx=0x7f9ea002dc20 comp rx=0 tx=0).stop 2023-10-21T18:28:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 -- 172.21.15.12:0/4056358908 shutdown_connections 2023-10-21T18:28:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/4056358908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb8159170 0x7f9eb8156590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/4056358908 >> v2:172.21.15.99:3300/0 conn(0x7f9eb814fe80 0x7f9eb80c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 -- 172.21.15.12:0/4056358908 >> 172.21.15.12:0/4056358908 conn(0x7f9eb8065ab0 msgr2=0x7f9eb8065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.776+0000 7f9ebcc90640 1 -- 172.21.15.12:0/4056358908 shutdown_connections 2023-10-21T18:28:22.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.777+0000 7f9ebcc90640 1 -- 172.21.15.12:0/4056358908 wait complete. 2023-10-21T18:28:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.779+0000 7f9ebcc90640 1 Processor -- start 2023-10-21T18:28:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.779+0000 7f9ebcc90640 1 -- start start 2023-10-21T18:28:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 0x7f9eb81f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb814fe80 0x7f9eb814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9eb8159170 0x7f9eb8150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8150470 con 0x7f9eb8159170 2023-10-21T18:28:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80c14f0 con 0x7f9eb8069fd0 2023-10-21T18:28:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.781+0000 7f9ebcc90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81f30f0 con 0x7f9eb814fe80 2023-10-21T18:28:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.782+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 0x7f9eb81f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.782+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb814fe80 0x7f9eb814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.782+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 0x7f9eb81f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:44352/0 (socket says 172.21.15.12:44352) 2023-10-21T18:28:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.782+0000 7f9eb77fe640 1 -- 172.21.15.12:0/657934450 learned_addr learned my addr 172.21.15.12:0/657934450 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.782+0000 7f9eb7fff640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9eb8159170 0x7f9eb8150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.785+0000 7f9eb77fe640 1 -- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb814fe80 msgr2=0x7f9eb814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.785+0000 7f9eb77fe640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9eb814fe80 0x7f9eb814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.785+0000 7f9eb77fe640 1 -- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9eb8159170 msgr2=0x7f9eb8150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.785+0000 7f9eb77fe640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9eb8159170 0x7f9eb8150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.785+0000 7f9eb77fe640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00094d0 con 0x7f9eb8069fd0 2023-10-21T18:28:22.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.788+0000 7f9eb77fe640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 0x7f9eb81f2bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800efc0 tx=0x7f9ea800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.791+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8014480 con 0x7f9eb8069fd0 2023-10-21T18:28:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.791+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800f040 con 0x7f9eb8069fd0 2023-10-21T18:28:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.791+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8014800 con 0x7f9eb8069fd0 2023-10-21T18:28:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.791+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb80c27c0 con 0x7f9eb8069fd0 2023-10-21T18:28:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.792+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb8158530 con 0x7f9eb8069fd0 2023-10-21T18:28:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.793+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9eb80c6090 con 0x7f9eb8069fd0 2023-10-21T18:28:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.812+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ea8014960 con 0x7f9eb8069fd0 2023-10-21T18:28:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.813+0000 7f9eaffff640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9e9806aec0 0x7f9e9806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.814+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ea808a670 con 0x7f9eb8069fd0 2023-10-21T18:28:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.814+0000 7f9eb6ffd640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9e9806aec0 0x7f9e9806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.814+0000 7f9eaffff640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f9e98073120 0x7f9e98075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.814+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e98075c30 con 0x7f9e98073120 2023-10-21T18:28:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.814+0000 7f9eb7fff640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f9e98073120 0x7f9e98075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.815+0000 7f9eb6ffd640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9e9806aec0 0x7f9e9806d380 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0038000 tx=0x7f9ea0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.815+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea8055870 con 0x7f9eb8069fd0 2023-10-21T18:28:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.815+0000 7f9eb7fff640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f9e98073120 0x7f9e98075560 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.817+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== osd.2 v2:172.21.15.12:6808/369793798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9e98075c30 con 0x7f9e98073120 2023-10-21T18:28:22.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.833+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 --> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9eb80c5db0 con 0x7f9e98073120 2023-10-21T18:28:22.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.834+0000 7f9eaffff640 1 -- 172.21.15.12:0/657934450 <== osd.2 v2:172.21.15.12:6808/369793798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9eb0001420 con 0x7f9e98073120 2023-10-21T18:28:22.836 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:22.836 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:22.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.834+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f9e98073120 msgr2=0x7f9e98075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.834+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.12:6808/369793798,v1:172.21.15.12:6809/369793798] conn(0x7f9e98073120 0x7f9e98075560 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9e9806aec0 msgr2=0x7f9e9806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f9e9806aec0 0x7f9e9806d380 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0038000 tx=0x7f9ea0032000 comp rx=0 tx=0).stop 2023-10-21T18:28:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 msgr2=0x7f9eb81f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 --2- 172.21.15.12:0/657934450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9eb8069fd0 0x7f9eb81f2bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800efc0 tx=0x7f9ea800c490 comp rx=0 tx=0).stop 2023-10-21T18:28:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9eb7fff640 1 -- 172.21.15.12:0/657934450 reap_dead start 2023-10-21T18:28:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 shutdown_connections 2023-10-21T18:28:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 >> 172.21.15.12:0/657934450 conn(0x7f9eb8065ab0 msgr2=0x7f9eb814f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 shutdown_connections 2023-10-21T18:28:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:22.835+0000 7f9ebcc90640 1 -- 172.21.15.12:0/657934450 wait complete. 2023-10-21T18:28:22.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-21T18:28:23.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.092+0000 7f5ea53a5640 1 Processor -- start 2023-10-21T18:28:23.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.093+0000 7f5ea53a5640 1 -- start start 2023-10-21T18:28:23.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.094+0000 7f5ea53a5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ea01534b0 0x7f5ea015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.094+0000 7f5ea53a5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ea015d340 0x7f5ea00ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.095+0000 7f5ea53a5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea006e520 con 0x7f5ea006fd50 2023-10-21T18:28:23.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.095+0000 7f5ea53a5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00c1f90 con 0x7f5ea01534b0 2023-10-21T18:28:23.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.095+0000 7f5ea53a5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea01595e0 con 0x7f5ea015d340 2023-10-21T18:28:23.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.095+0000 7f5e9f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ea015d340 0x7f5ea00ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.096+0000 7f5e9f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ea015d340 0x7f5ea00ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41540/0 (socket says 172.21.15.12:41540) 2023-10-21T18:28:23.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.096+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1533557150 learned_addr learned my addr 172.21.15.12:0/1533557150 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:23.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.096+0000 7f5e9ffff640 1 --2- 172.21.15.12:0/1533557150 >> v2:172.21.15.12:3300/0 conn(0x7f5ea01534b0 0x7f5ea015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.098+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1533557150 >> v2:172.21.15.12:3300/0 conn(0x7f5ea01534b0 msgr2=0x7f5ea015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.098+0000 7f5e9f7fe640 1 --2- 172.21.15.12:0/1533557150 >> v2:172.21.15.12:3300/0 conn(0x7f5ea01534b0 0x7f5ea015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.098+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1533557150 >> v1:172.21.15.12:6789/0 conn(0x7f5ea006fd50 legacy=0x7f5ea00c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.098+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1533557150 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea01598c0 con 0x7f5ea015d340 2023-10-21T18:28:23.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.100+0000 7f5e9f7fe640 1 --2- 172.21.15.12:0/1533557150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea015d340 0x7f5ea00ca7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ea006e030 tx=0x7f5e9402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5941fb7b90c4465a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.103+0000 7f5e9effd640 1 -- 172.21.15.12:0/1533557150 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9402f850 con 0x7f5ea015d340 2023-10-21T18:28:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.104+0000 7f5e9effd640 1 -- 172.21.15.12:0/1533557150 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9402f9b0 con 0x7f5ea015d340 2023-10-21T18:28:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.104+0000 7f5e9effd640 1 -- 172.21.15.12:0/1533557150 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9402fd40 con 0x7f5ea015d340 2023-10-21T18:28:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.104+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1533557150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea015d340 msgr2=0x7f5ea00ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.104+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1533557150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea015d340 0x7f5ea00ca7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ea006e030 tx=0x7f5e9402ba30 comp rx=0 tx=0).stop 2023-10-21T18:28:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1533557150 shutdown_connections 2023-10-21T18:28:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1533557150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea015d340 0x7f5ea00ca7c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1533557150 >> v2:172.21.15.12:3300/0 conn(0x7f5ea01534b0 0x7f5ea015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1533557150 >> 172.21.15.12:0/1533557150 conn(0x7f5ea006bac0 msgr2=0x7f5ea006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1533557150 shutdown_connections 2023-10-21T18:28:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.105+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1533557150 wait complete. 2023-10-21T18:28:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.106+0000 7f5ea53a5640 1 Processor -- start 2023-10-21T18:28:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.107+0000 7f5ea53a5640 1 -- start start 2023-10-21T18:28:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 0x7f5ea00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 0x7f5ea01416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea015d340 0x7f5ea0143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00c40b0 con 0x7f5ea015d340 2023-10-21T18:28:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0150350 con 0x7f5ea006fd50 2023-10-21T18:28:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5ea53a5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00c4920 con 0x7f5ea01534b0 2023-10-21T18:28:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.108+0000 7f5e9ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 0x7f5ea00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.109+0000 7f5e9f7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 0x7f5ea01416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.109+0000 7f5ea4ba4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea015d340 0x7f5ea0143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.109+0000 7f5e9ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 0x7f5ea00c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41546/0 (socket says 172.21.15.12:41546) 2023-10-21T18:28:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.109+0000 7f5e9ffff640 1 -- 172.21.15.12:0/1973615333 learned_addr learned my addr 172.21.15.12:0/1973615333 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:23.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.112+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 msgr2=0x7f5ea00c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.112+0000 7f5e9f7fe640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 0x7f5ea00c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.112+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1973615333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea015d340 msgr2=0x7f5ea0143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.112+0000 7f5e9f7fe640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea015d340 0x7f5ea0143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.112+0000 7f5e9f7fe640 1 -- 172.21.15.12:0/1973615333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e940094d0 con 0x7f5ea01534b0 2023-10-21T18:28:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.115+0000 7f5e9f7fe640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 0x7f5ea01416a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e94033000 tx=0x7f5e940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.118+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9403b040 con 0x7f5ea01534b0 2023-10-21T18:28:23.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.118+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94037c60 con 0x7f5ea01534b0 2023-10-21T18:28:23.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.118+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94042480 con 0x7f5ea01534b0 2023-10-21T18:28:23.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.119+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea00c2870 con 0x7f5ea01534b0 2023-10-21T18:28:23.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.119+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea00c8cd0 con 0x7f5ea01534b0 2023-10-21T18:28:23.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.120+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea013ff90 con 0x7f5ea01534b0 2023-10-21T18:28:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.140+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e94042600 con 0x7f5ea01534b0 2023-10-21T18:28:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.142+0000 7f5e9cff9640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 0x7f5e8c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.143+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5e9407bcb0 con 0x7f5ea01534b0 2023-10-21T18:28:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.142+0000 7f5e9ffff640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 0x7f5e8c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.144+0000 7f5e9ffff640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 0x7f5e8c06d380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009a40 tx=0x7f5e9000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.376+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e94077ff0 con 0x7f5ea01534b0 2023-10-21T18:28:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.592+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea0159e80 con 0x7f5e8c06aec0 2023-10-21T18:28:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.592+0000 7f5e9cff9640 1 -- 172.21.15.12:0/1973615333 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e9000f040 con 0x7f5e8c06aec0 2023-10-21T18:28:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2023-10-21T18:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 msgr2=0x7f5e8c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 0x7f5e8c06d380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009a40 tx=0x7f5e9000b040 comp rx=0 tx=0).stop 2023-10-21T18:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 msgr2=0x7f5ea01416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 0x7f5ea01416a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e94033000 tx=0x7f5e940046c0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 shutdown_connections 2023-10-21T18:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5e8c06aec0 0x7f5e8c06d380 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea015d340 0x7f5ea0143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea01534b0 0x7f5ea01416a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 --2- 172.21.15.12:0/1973615333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea006fd50 0x7f5ea00c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 >> 172.21.15.12:0/1973615333 conn(0x7f5ea006bac0 msgr2=0x7f5ea006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.595+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 shutdown_connections 2023-10-21T18:28:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.596+0000 7f5ea53a5640 1 -- 172.21.15.12:0/1973615333 wait complete. 2023-10-21T18:28:23.616 INFO:tasks.ceph:Scrubbing osd.3 2023-10-21T18:28:23.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:23.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.837+0000 7fa7df5dc640 1 Processor -- start 2023-10-21T18:28:23.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.837+0000 7fa7df5dc640 1 -- start start 2023-10-21T18:28:23.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.838+0000 7fa7df5dc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7d80c59d0 0x7fa7d8150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.839+0000 7fa7df5dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80c23f0 con 0x7fa7d80c55f0 2023-10-21T18:28:23.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.839+0000 7fa7df5dc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d8156fa0 con 0x7fa7d815a590 2023-10-21T18:28:23.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.839+0000 7fa7df5dc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d815aaf0 con 0x7fa7d80c59d0 2023-10-21T18:28:23.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.839+0000 7fa7ddb79640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa7d815a590 0x7fa7d80c7020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:32938/0 (socket says 172.21.15.12:32938) 2023-10-21T18:28:23.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.839+0000 7fa7ddb79640 1 -- 172.21.15.12:0/438344522 learned_addr learned my addr 172.21.15.12:0/438344522 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:23.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.840+0000 7fa7dcb77640 1 --2- 172.21.15.12:0/438344522 >> v2:172.21.15.12:3300/0 conn(0x7fa7d80c59d0 0x7fa7d8150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.841+0000 7fa7cffff640 1 -- 172.21.15.12:0/438344522 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575454940 0 0) 0x7fa7d8156fa0 con 0x7fa7d815a590 2023-10-21T18:28:23.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.841+0000 7fa7cffff640 1 -- 172.21.15.12:0/438344522 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c4003520 con 0x7fa7d815a590 2023-10-21T18:28:23.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.844+0000 7fa7dcb77640 1 -- 172.21.15.12:0/438344522 >> v1:172.21.15.99:6789/0 conn(0x7fa7d815a590 legacy=0x7fa7d80c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.844+0000 7fa7dcb77640 1 -- 172.21.15.12:0/438344522 >> v1:172.21.15.12:6789/0 conn(0x7fa7d80c55f0 legacy=0x7fa7d8157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.844+0000 7fa7dcb77640 1 -- 172.21.15.12:0/438344522 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d815add0 con 0x7fa7d80c59d0 2023-10-21T18:28:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.850+0000 7fa7dcb77640 1 --2- 172.21.15.12:0/438344522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c59d0 0x7fa7d8150de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097a0 tx=0x7fa7c802b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e528e8db2cff1d80 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.857+0000 7fa7cffff640 1 -- 172.21.15.12:0/438344522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c802f800 con 0x7fa7d80c59d0 2023-10-21T18:28:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.857+0000 7fa7cffff640 1 -- 172.21.15.12:0/438344522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c802f960 con 0x7fa7d80c59d0 2023-10-21T18:28:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.857+0000 7fa7cffff640 1 -- 172.21.15.12:0/438344522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c802fcf0 con 0x7fa7d80c59d0 2023-10-21T18:28:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.858+0000 7fa7df5dc640 1 -- 172.21.15.12:0/438344522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c59d0 msgr2=0x7fa7d8150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.858+0000 7fa7df5dc640 1 --2- 172.21.15.12:0/438344522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c59d0 0x7fa7d8150de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097a0 tx=0x7fa7c802b9e0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.858+0000 7fa7df5dc640 1 -- 172.21.15.12:0/438344522 shutdown_connections 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.858+0000 7fa7df5dc640 1 --2- 172.21.15.12:0/438344522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c59d0 0x7fa7d8150de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.858+0000 7fa7df5dc640 1 -- 172.21.15.12:0/438344522 >> 172.21.15.12:0/438344522 conn(0x7fa7d8069de0 msgr2=0x7fa7d806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.859+0000 7fa7df5dc640 1 -- 172.21.15.12:0/438344522 shutdown_connections 2023-10-21T18:28:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.859+0000 7fa7df5dc640 1 -- 172.21.15.12:0/438344522 wait complete. 2023-10-21T18:28:23.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.861+0000 7fa7df5dc640 1 Processor -- start 2023-10-21T18:28:23.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.861+0000 7fa7df5dc640 1 -- start start 2023-10-21T18:28:23.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c55f0 0x7fa7d8147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7d80c59d0 0x7fa7d814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 0x7fa7d814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d814abe0 con 0x7fa7d80c55f0 2023-10-21T18:28:23.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81ed520 con 0x7fa7d815a590 2023-10-21T18:28:23.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.862+0000 7fa7df5dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81e3000 con 0x7fa7d80c59d0 2023-10-21T18:28:23.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.864+0000 7fa7ddb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 0x7fa7d814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.864+0000 7fa7dcb77640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7d80c59d0 0x7fa7d814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.864+0000 7fa7dd378640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c55f0 0x7fa7d8147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.864+0000 7fa7ddb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 0x7fa7d814cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41552/0 (socket says 172.21.15.12:41552) 2023-10-21T18:28:23.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.864+0000 7fa7ddb79640 1 -- 172.21.15.12:0/573436521 learned_addr learned my addr 172.21.15.12:0/573436521 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7ddb79640 1 -- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7d80c59d0 msgr2=0x7fa7d814c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7ddb79640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7d80c59d0 0x7fa7d814c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7ddb79640 1 -- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c55f0 msgr2=0x7fa7d8147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7ddb79640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7d80c55f0 0x7fa7d8147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7ddb79640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009400 con 0x7fa7d815a590 2023-10-21T18:28:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.867+0000 7fa7dcb77640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7d80c59d0 0x7fa7d814c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.870+0000 7fa7ddb79640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 0x7fa7d814cd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c9c0 tx=0x7fa7d000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.873+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000ab70 con 0x7fa7d815a590 2023-10-21T18:28:23.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.874+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000acd0 con 0x7fa7d815a590 2023-10-21T18:28:23.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.874+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0012600 con 0x7fa7d815a590 2023-10-21T18:28:23.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.874+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d814d980 con 0x7fa7d815a590 2023-10-21T18:28:23.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.874+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d814a8b0 con 0x7fa7d815a590 2023-10-21T18:28:23.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.875+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7d815b390 con 0x7fa7d815a590 2023-10-21T18:28:23.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.895+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7d0007070 con 0x7fa7d815a590 2023-10-21T18:28:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.896+0000 7fa7cdffb640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa7bc06aef0 0x7fa7bc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.897+0000 7fa7dd378640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa7bc06aef0 0x7fa7bc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.897+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa7d0058980 con 0x7fa7d815a590 2023-10-21T18:28:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.897+0000 7fa7cdffb640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7fa7bc073150 0x7fa7bc075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.897+0000 7fa7dd378640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa7bc06aef0 0x7fa7bc06d3b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4001780 tx=0x7fa7d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.897+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7bc075c60 con 0x7fa7bc073150 2023-10-21T18:28:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.898+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d0001ab0 con 0x7fa7d815a590 2023-10-21T18:28:23.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.898+0000 7fa7dcb77640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7fa7bc073150 0x7fa7bc075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:23.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.899+0000 7fa7dcb77640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7fa7bc073150 0x7fa7bc075590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:23.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.900+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== osd.3 v2:172.21.15.12:6822/514838318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa7bc075c60 con 0x7fa7bc073150 2023-10-21T18:28:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.920+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 --> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa7d815b0b0 con 0x7fa7bc073150 2023-10-21T18:28:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.920+0000 7fa7cdffb640 1 -- 172.21.15.12:0/573436521 <== osd.3 v2:172.21.15.12:6822/514838318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa7c802f720 con 0x7fa7bc073150 2023-10-21T18:28:23.923 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:23.923 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:23.923 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7fa7bc073150 msgr2=0x7fa7bc075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.12:6822/514838318,v1:172.21.15.12:6824/514838318] conn(0x7fa7bc073150 0x7fa7bc075590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa7bc06aef0 msgr2=0x7fa7bc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa7bc06aef0 0x7fa7bc06d3b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4001780 tx=0x7fa7d4009040 comp rx=0 tx=0).stop 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 msgr2=0x7fa7d814cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 --2- 172.21.15.12:0/573436521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7d815a590 0x7fa7d814cd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c9c0 tx=0x7fa7d000ce80 comp rx=0 tx=0).stop 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7ddb79640 1 -- 172.21.15.12:0/573436521 reap_dead start 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 shutdown_connections 2023-10-21T18:28:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.921+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 >> 172.21.15.12:0/573436521 conn(0x7fa7d8069de0 msgr2=0x7fa7d814fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:23.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.922+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 shutdown_connections 2023-10-21T18:28:23.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:23.922+0000 7fa7df5dc640 1 -- 172.21.15.12:0/573436521 wait complete. 2023-10-21T18:28:23.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-21T18:28:24.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.186+0000 7f8251b0c640 1 Processor -- start 2023-10-21T18:28:24.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.186+0000 7f8251b0c640 1 -- start start 2023-10-21T18:28:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.188+0000 7f8251b0c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.188+0000 7f8251b0c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824c071510 0x7f824c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.188+0000 7f8251b0c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c15a450 con 0x7f824c0c1f40 2023-10-21T18:28:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.188+0000 7f8251b0c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0c2350 con 0x7f824c071510 2023-10-21T18:28:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.188+0000 7f8251b0c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c156050 con 0x7f824c1500d0 2023-10-21T18:28:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.189+0000 7f8243fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824c071510 0x7f824c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.189+0000 7f824b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.189+0000 7f8243fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824c071510 0x7f824c0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41564/0 (socket says 172.21.15.12:41564) 2023-10-21T18:28:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.189+0000 7f8243fff640 1 -- 172.21.15.12:0/4246867703 learned_addr learned my addr 172.21.15.12:0/4246867703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.191+0000 7f8243fff640 1 -- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 msgr2=0x7f824c06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.191+0000 7f8243fff640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c06fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.191+0000 7f8243fff640 1 -- 172.21.15.12:0/4246867703 >> v1:172.21.15.12:6789/0 conn(0x7f824c0c1f40 legacy=0x7f824c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.191+0000 7f8243fff640 1 -- 172.21.15.12:0/4246867703 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c159eb0 con 0x7f824c071510 2023-10-21T18:28:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.191+0000 7f824b7fe640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c06fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.194+0000 7f8243fff640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c1a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402dc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba19c2f0fa3c1e server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.197+0000 7f824affd640 1 -- 172.21.15.12:0/4246867703 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823402e9d0 con 0x7f824c071510 2023-10-21T18:28:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.198+0000 7f824affd640 1 -- 172.21.15.12:0/4246867703 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823402eb30 con 0x7f824c071510 2023-10-21T18:28:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.198+0000 7f824affd640 1 -- 172.21.15.12:0/4246867703 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234036440 con 0x7f824c071510 2023-10-21T18:28:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.198+0000 7f8251b0c640 1 -- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 msgr2=0x7f824c0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.198+0000 7f8251b0c640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c1a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402dc20 comp rx=0 tx=0).stop 2023-10-21T18:28:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 -- 172.21.15.12:0/4246867703 shutdown_connections 2023-10-21T18:28:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c1a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 --2- 172.21.15.12:0/4246867703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c06fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 -- 172.21.15.12:0/4246867703 >> 172.21.15.12:0/4246867703 conn(0x7f824c069de0 msgr2=0x7f824c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 -- 172.21.15.12:0/4246867703 shutdown_connections 2023-10-21T18:28:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.199+0000 7f8251b0c640 1 -- 172.21.15.12:0/4246867703 wait complete. 2023-10-21T18:28:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.201+0000 7f8251b0c640 1 Processor -- start 2023-10-21T18:28:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.201+0000 7f8251b0c640 1 -- start start 2023-10-21T18:28:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f824c0c1f40 0x7f824c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c14c8b0 con 0x7f824c0c1f40 2023-10-21T18:28:24.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0c93f0 con 0x7f824c071510 2023-10-21T18:28:24.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.202+0000 7f8251b0c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0c83e0 con 0x7f824c1500d0 2023-10-21T18:28:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f8243fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f824c0c1f40 0x7f824c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f824b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f824bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f824b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41572/0 (socket says 172.21.15.12:41572) 2023-10-21T18:28:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f824bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54932/0 (socket says 172.21.15.12:54932) 2023-10-21T18:28:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.203+0000 7f824b7fe640 1 -- 172.21.15.12:0/2175729042 learned_addr learned my addr 172.21.15.12:0/2175729042 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.206+0000 7f824bfff640 1 -- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 msgr2=0x7f824c0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.206+0000 7f824bfff640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.206+0000 7f824bfff640 1 -- 172.21.15.12:0/2175729042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f824c0c1f40 msgr2=0x7f824c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.206+0000 7f824bfff640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f824c0c1f40 0x7f824c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.206+0000 7f824bfff640 1 -- 172.21.15.12:0/2175729042 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c009400 con 0x7f824c1500d0 2023-10-21T18:28:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.208+0000 7f824bfff640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f824400c700 tx=0x7f824400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.212+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244003b70 con 0x7f824c1500d0 2023-10-21T18:28:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.212+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244003cd0 con 0x7f824c1500d0 2023-10-21T18:28:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.212+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244005310 con 0x7f824c1500d0 2023-10-21T18:28:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.212+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340094d0 con 0x7f824c1500d0 2023-10-21T18:28:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.212+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c0c8f60 con 0x7f824c1500d0 2023-10-21T18:28:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.214+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c0c90f0 con 0x7f824c1500d0 2023-10-21T18:28:24.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.232+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8244005470 con 0x7f824c1500d0 2023-10-21T18:28:24.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.234+0000 7f8248ff9640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 0x7f822c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.234+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8244089a80 con 0x7f824c1500d0 2023-10-21T18:28:24.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.234+0000 7f824b7fe640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 0x7f822c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.235+0000 7f824b7fe640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 0x7f822c06d380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f823c009dd0 tx=0x7f823c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.473+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8244054bf0 con 0x7f824c1500d0 2023-10-21T18:28:24.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.684+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f824c15a170 con 0x7f822c06aec0 2023-10-21T18:28:24.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.684+0000 7f8248ff9640 1 -- 172.21.15.12:0/2175729042 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f823c009a20 con 0x7f822c06aec0 2023-10-21T18:28:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2023-10-21T18:28:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 msgr2=0x7f822c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 0x7f822c06d380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f823c009dd0 tx=0x7f823c009190 comp rx=0 tx=0).stop 2023-10-21T18:28:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 msgr2=0x7f824c0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f824400c700 tx=0x7f824400cbc0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 shutdown_connections 2023-10-21T18:28:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f822c06aec0 0x7f822c06d380 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f824c1500d0 0x7f824c0c9b90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.687+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f824c0c1f40 0x7f824c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.688+0000 7f8251b0c640 1 --2- 172.21.15.12:0/2175729042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824c071510 0x7f824c0c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.688+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 >> 172.21.15.12:0/2175729042 conn(0x7f824c069de0 msgr2=0x7f824c073200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.688+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 shutdown_connections 2023-10-21T18:28:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.688+0000 7f8251b0c640 1 -- 172.21.15.12:0/2175729042 wait complete. 2023-10-21T18:28:24.710 INFO:tasks.ceph:Scrubbing osd.4 2023-10-21T18:28:24.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.921+0000 7f540b7d5640 1 Processor -- start 2023-10-21T18:28:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.921+0000 7f540b7d5640 1 -- start start 2023-10-21T18:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.923+0000 7f540b7d5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5404157720 0x7f54040c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.923+0000 7f540b7d5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5404160f80 0x7f5404161390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.923+0000 7f540b7d5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5404157b00 con 0x7f5404070780 2023-10-21T18:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.923+0000 7f540b7d5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54040c1e50 con 0x7f5404157720 2023-10-21T18:28:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.923+0000 7f540b7d5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540415d7a0 con 0x7f5404160f80 2023-10-21T18:28:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.924+0000 7f5409d72640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5404160f80 0x7f5404161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.924+0000 7f5409571640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5404157720 0x7f54040c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.924+0000 7f5409d72640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5404160f80 0x7f5404161390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41584/0 (socket says 172.21.15.12:41584) 2023-10-21T18:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.924+0000 7f5409d72640 1 -- 172.21.15.12:0/1663094862 learned_addr learned my addr 172.21.15.12:0/1663094862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.926+0000 7f5409d72640 1 -- 172.21.15.12:0/1663094862 >> v2:172.21.15.12:3300/0 conn(0x7f5404157720 msgr2=0x7f54040c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.926+0000 7f5409d72640 1 --2- 172.21.15.12:0/1663094862 >> v2:172.21.15.12:3300/0 conn(0x7f5404157720 0x7f54040c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.926+0000 7f5409d72640 1 -- 172.21.15.12:0/1663094862 >> v1:172.21.15.12:6789/0 conn(0x7f5404070780 legacy=0x7f54040c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.926+0000 7f5409d72640 1 -- 172.21.15.12:0/1663094862 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540415da60 con 0x7f5404160f80 2023-10-21T18:28:24.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.929+0000 7f5409d72640 1 --2- 172.21.15.12:0/1663094862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404160f80 0x7f5404161390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f540415b1f0 tx=0x7f53fc02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a55077e876a15978 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.933+0000 7f53fbfff640 1 -- 172.21.15.12:0/1663094862 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc02cb20 con 0x7f5404160f80 2023-10-21T18:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.933+0000 7f53fbfff640 1 -- 172.21.15.12:0/1663094862 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc02cc80 con 0x7f5404160f80 2023-10-21T18:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.933+0000 7f53fbfff640 1 -- 172.21.15.12:0/1663094862 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0343f0 con 0x7f5404160f80 2023-10-21T18:28:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 -- 172.21.15.12:0/1663094862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404160f80 msgr2=0x7f5404161390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1663094862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404160f80 0x7f5404161390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f540415b1f0 tx=0x7f53fc02bf80 comp rx=0 tx=0).stop 2023-10-21T18:28:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 -- 172.21.15.12:0/1663094862 shutdown_connections 2023-10-21T18:28:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1663094862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404160f80 0x7f5404161390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1663094862 >> v2:172.21.15.12:3300/0 conn(0x7f5404157720 0x7f54040c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 -- 172.21.15.12:0/1663094862 >> 172.21.15.12:0/1663094862 conn(0x7f5404069de0 msgr2=0x7f540406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 -- 172.21.15.12:0/1663094862 shutdown_connections 2023-10-21T18:28:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.934+0000 7f540b7d5640 1 -- 172.21.15.12:0/1663094862 wait complete. 2023-10-21T18:28:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.936+0000 7f540b7d5640 1 Processor -- start 2023-10-21T18:28:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.937+0000 7f540b7d5640 1 -- start start 2023-10-21T18:28:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5404070780 0x7f54041f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 0x7f540415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5404160f80 0x7f54041528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041540a0 con 0x7f5404070780 2023-10-21T18:28:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041f3760 con 0x7f5404157720 2023-10-21T18:28:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.938+0000 7f540b7d5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540415d500 con 0x7f5404160f80 2023-10-21T18:28:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.939+0000 7f5408d70640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 0x7f540415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.939+0000 7f5409d72640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5404160f80 0x7f54041528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.939+0000 7f5409571640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5404070780 0x7f54041f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.939+0000 7f5408d70640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 0x7f540415fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41596/0 (socket says 172.21.15.12:41596) 2023-10-21T18:28:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.939+0000 7f5408d70640 1 -- 172.21.15.12:0/1553428441 learned_addr learned my addr 172.21.15.12:0/1553428441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.942+0000 7f5408d70640 1 -- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5404160f80 msgr2=0x7f54041528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.942+0000 7f5408d70640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5404160f80 0x7f54041528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.942+0000 7f5408d70640 1 -- 172.21.15.12:0/1553428441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5404070780 msgr2=0x7f54041f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.942+0000 7f5408d70640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5404070780 0x7f54041f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.942+0000 7f5408d70640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009b30 con 0x7f5404157720 2023-10-21T18:28:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.945+0000 7f5408d70640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 0x7f540415fcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c530 tx=0x7f53f400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.948+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40052d0 con 0x7f5404157720 2023-10-21T18:28:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.948+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4005430 con 0x7f5404157720 2023-10-21T18:28:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.948+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4012850 con 0x7f5404157720 2023-10-21T18:28:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.948+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5404151b60 con 0x7f5404157720 2023-10-21T18:28:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.949+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5404151e00 con 0x7f5404157720 2023-10-21T18:28:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.950+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f540415e020 con 0x7f5404157720 2023-10-21T18:28:24.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.969+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53f40129b0 con 0x7f5404157720 2023-10-21T18:28:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.970+0000 7f53f9ffb640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f53e806aec0 0x7f53e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.970+0000 7f5409571640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f53e806aec0 0x7f53e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.970+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f53f4058870 con 0x7f5404157720 2023-10-21T18:28:24.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.971+0000 7f53f9ffb640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f53e8073120 0x7f53e8075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.971+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53e8075c30 con 0x7f53e8073120 2023-10-21T18:28:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.971+0000 7f5409571640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f53e806aec0 0x7f53e806d380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5400009b40 tx=0x7f5400009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.971+0000 7f5409d72640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f53e8073120 0x7f53e8075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.972+0000 7f5409d72640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f53e8073120 0x7f53e8075560 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.972+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53f40011c0 con 0x7f5404157720 2023-10-21T18:28:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.973+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== osd.4 v2:172.21.15.99:6810/585893738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f53e8075c30 con 0x7f53e8073120 2023-10-21T18:28:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.989+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 --> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f540415dd40 con 0x7f53e8073120 2023-10-21T18:28:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f53f9ffb640 1 -- 172.21.15.12:0/1553428441 <== osd.4 v2:172.21.15.99:6810/585893738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f53fc02cb10 con 0x7f53e8073120 2023-10-21T18:28:24.993 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:24.994 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:24.994 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f53e8073120 msgr2=0x7f53e8075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6810/585893738,v1:172.21.15.99:6811/585893738] conn(0x7f53e8073120 0x7f53e8075560 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f53e806aec0 msgr2=0x7f53e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f53e806aec0 0x7f53e806d380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5400009b40 tx=0x7f5400009190 comp rx=0 tx=0).stop 2023-10-21T18:28:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 msgr2=0x7f540415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.990+0000 7f540b7d5640 1 --2- 172.21.15.12:0/1553428441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5404157720 0x7f540415fcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c530 tx=0x7f53f400c9f0 comp rx=0 tx=0).stop 2023-10-21T18:28:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.991+0000 7f5409d72640 1 -- 172.21.15.12:0/1553428441 reap_dead start 2023-10-21T18:28:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.991+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 shutdown_connections 2023-10-21T18:28:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.991+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 >> 172.21.15.12:0/1553428441 conn(0x7f5404069de0 msgr2=0x7f54040716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.991+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 shutdown_connections 2023-10-21T18:28:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:24.991+0000 7f540b7d5640 1 -- 172.21.15.12:0/1553428441 wait complete. 2023-10-21T18:28:25.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-21T18:28:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.243+0000 7fc28952e640 1 Processor -- start 2023-10-21T18:28:25.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.244+0000 7fc28952e640 1 -- start start 2023-10-21T18:28:25.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.245+0000 7fc28952e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc2840c9830 0x7fc284159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:25.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.246+0000 7fc28952e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28415d050 con 0x7fc28414fa60 2023-10-21T18:28:25.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.246+0000 7fc28952e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840ca180 con 0x7fc2840cb1e0 2023-10-21T18:28:25.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.246+0000 7fc28952e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc284159fc0 con 0x7fc2840c9830 2023-10-21T18:28:25.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.247+0000 7fc283fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc28414fa60 0x7fc2840b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37742/0 (socket says 172.21.15.12:37742) 2023-10-21T18:28:25.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.247+0000 7fc283fff640 1 -- 172.21.15.12:0/3991566939 learned_addr learned my addr 172.21.15.12:0/3991566939 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:25.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.248+0000 7fc2837fe640 1 --2- 172.21.15.12:0/3991566939 >> v2:172.21.15.12:3300/0 conn(0x7fc2840c9830 0x7fc284159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:25.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.251+0000 7fc282ffd640 1 -- 172.21.15.12:0/3991566939 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919839659 0 0) 0x7fc28415d050 con 0x7fc28414fa60 2023-10-21T18:28:25.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.251+0000 7fc282ffd640 1 -- 172.21.15.12:0/3991566939 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc270003520 con 0x7fc28414fa60 2023-10-21T18:28:25.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.254+0000 7fc2837fe640 1 -- 172.21.15.12:0/3991566939 >> v1:172.21.15.99:6789/0 conn(0x7fc2840cb1e0 legacy=0x7fc284163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:25.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.254+0000 7fc2837fe640 1 -- 172.21.15.12:0/3991566939 >> v1:172.21.15.12:6789/0 conn(0x7fc28414fa60 legacy=0x7fc2840b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.254+0000 7fc2837fe640 1 -- 172.21.15.12:0/3991566939 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840c9ec0 con 0x7fc2840c9830 2023-10-21T18:28:25.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.263+0000 7fc2837fe640 1 --2- 172.21.15.12:0/3991566939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2840c9830 0x7fc284159a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d90 tx=0x7fc26c02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c09ed64cf59bd05 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:25.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.273+0000 7fc282ffd640 1 -- 172.21.15.12:0/3991566939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c02cb40 con 0x7fc2840c9830 2023-10-21T18:28:25.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.314+0000 7fc282ffd640 1 -- 172.21.15.12:0/3991566939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c02cca0 con 0x7fc2840c9830 2023-10-21T18:28:25.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.315+0000 7fc28952e640 1 -- 172.21.15.12:0/3991566939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2840c9830 msgr2=0x7fc284159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.315+0000 7fc28952e640 1 --2- 172.21.15.12:0/3991566939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2840c9830 0x7fc284159a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d90 tx=0x7fc26c02bd90 comp rx=0 tx=0).stop 2023-10-21T18:28:25.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.316+0000 7fc28952e640 1 -- 172.21.15.12:0/3991566939 shutdown_connections 2023-10-21T18:28:25.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.316+0000 7fc28952e640 1 --2- 172.21.15.12:0/3991566939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2840c9830 0x7fc284159a80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.316+0000 7fc28952e640 1 -- 172.21.15.12:0/3991566939 >> 172.21.15.12:0/3991566939 conn(0x7fc2840716f0 msgr2=0x7fc28406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:25.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.316+0000 7fc28952e640 1 -- 172.21.15.12:0/3991566939 shutdown_connections 2023-10-21T18:28:25.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.316+0000 7fc28952e640 1 -- 172.21.15.12:0/3991566939 wait complete. 2023-10-21T18:28:25.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.318+0000 7fc28952e640 1 Processor -- start 2023-10-21T18:28:25.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.319+0000 7fc28952e640 1 -- start start 2023-10-21T18:28:25.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 0x7fc28415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:25.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 0x7fc284152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:25.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:25.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841f23a0 con 0x7fc28414fa60 2023-10-21T18:28:25.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284150980 con 0x7fc2840cb1e0 2023-10-21T18:28:25.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.320+0000 7fc28952e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841f28b0 con 0x7fc28414a3e0 2023-10-21T18:28:25.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.321+0000 7fc288d2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:25.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.321+0000 7fc283fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 0x7fc28415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:25.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.321+0000 7fc2837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 0x7fc284152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:25.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.321+0000 7fc288d2d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54944/0 (socket says 172.21.15.12:54944) 2023-10-21T18:28:25.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.321+0000 7fc288d2d640 1 -- 172.21.15.12:0/966548718 learned_addr learned my addr 172.21.15.12:0/966548718 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:25.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc283fff640 1 -- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 msgr2=0x7fc28414a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc283fff640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc283fff640 1 -- 172.21.15.12:0/966548718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 msgr2=0x7fc284152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc283fff640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 0x7fc284152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc283fff640 1 -- 172.21.15.12:0/966548718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009a70 con 0x7fc2840cb1e0 2023-10-21T18:28:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc2837fe640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 0x7fc284152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.326+0000 7fc288d2d640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.329+0000 7fc283fff640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 0x7fc28415b690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c3c0 tx=0x7fc274001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:25.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.333+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274005ce0 con 0x7fc2840cb1e0 2023-10-21T18:28:25.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.333+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274005e40 con 0x7fc2840cb1e0 2023-10-21T18:28:25.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.333+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740072d0 con 0x7fc2840cb1e0 2023-10-21T18:28:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.333+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28414add0 con 0x7fc2840cb1e0 2023-10-21T18:28:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.333+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc284150510 con 0x7fc2840cb1e0 2023-10-21T18:28:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.335+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284067560 con 0x7fc2840cb1e0 2023-10-21T18:28:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.354+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc274007430 con 0x7fc2840cb1e0 2023-10-21T18:28:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.355+0000 7fc280ff9640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 0x7fc26406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.355+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc274054500 con 0x7fc2840cb1e0 2023-10-21T18:28:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.356+0000 7fc2837fe640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 0x7fc26406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.357+0000 7fc2837fe640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 0x7fc26406d3b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc26c036000 tx=0x7fc26c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:25.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.593+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc274054130 con 0x7fc2840cb1e0 2023-10-21T18:28:25.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.812+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2840c9ca0 con 0x7fc26406aef0 2023-10-21T18:28:25.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.813+0000 7fc280ff9640 1 -- 172.21.15.12:0/966548718 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc26c043070 con 0x7fc26406aef0 2023-10-21T18:28:25.815 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2023-10-21T18:28:25.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 msgr2=0x7fc26406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 0x7fc26406d3b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc26c036000 tx=0x7fc26c030000 comp rx=0 tx=0).stop 2023-10-21T18:28:25.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 msgr2=0x7fc28415b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 0x7fc28415b690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c3c0 tx=0x7fc274001e70 comp rx=0 tx=0).stop 2023-10-21T18:28:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 shutdown_connections 2023-10-21T18:28:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc26406aef0 0x7fc26406d3b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc28414a3e0 0x7fc28414a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28414fa60 0x7fc284152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 --2- 172.21.15.12:0/966548718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840cb1e0 0x7fc28415b690 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:25.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 >> 172.21.15.12:0/966548718 conn(0x7fc2840716f0 msgr2=0x7fc28414ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:25.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 shutdown_connections 2023-10-21T18:28:25.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:25.816+0000 7fc28952e640 1 -- 172.21.15.12:0/966548718 wait complete. 2023-10-21T18:28:25.841 INFO:tasks.ceph:Scrubbing osd.5 2023-10-21T18:28:25.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:26.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.070+0000 7feaeb59e640 1 Processor -- start 2023-10-21T18:28:26.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.070+0000 7feaeb59e640 1 -- start start 2023-10-21T18:28:26.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.071+0000 7feaeb59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feaec0c6ff0 0x7feaec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.071+0000 7feaeb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec06b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.071+0000 7feaeb59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0aedd0 con 0x7feaec0ae9f0 2023-10-21T18:28:26.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.071+0000 7feaeb59e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec15d580 con 0x7feaec0c6ff0 2023-10-21T18:28:26.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.071+0000 7feaeb59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec153860 con 0x7feaec0c7dc0 2023-10-21T18:28:26.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.072+0000 7feaead9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.072+0000 7feaea59c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feaec0ae9f0 0x7feaec06e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:32962/0 (socket says 172.21.15.12:32962) 2023-10-21T18:28:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.072+0000 7feaea59c640 1 -- 172.21.15.12:0/663120434 learned_addr learned my addr 172.21.15.12:0/663120434 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.073+0000 7feae9d9b640 1 --2- 172.21.15.12:0/663120434 >> v2:172.21.15.12:3300/0 conn(0x7feaec0c6ff0 0x7feaec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feae959a640 1 -- 172.21.15.12:0/663120434 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625271747 0 0) 0x7feaec0aedd0 con 0x7feaec0ae9f0 2023-10-21T18:28:26.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feae959a640 1 -- 172.21.15.12:0/663120434 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead8003520 con 0x7feaec0ae9f0 2023-10-21T18:28:26.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feaead9d640 1 -- 172.21.15.12:0/663120434 >> v2:172.21.15.12:3300/0 conn(0x7feaec0c6ff0 msgr2=0x7feaec15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:26.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feaead9d640 1 --2- 172.21.15.12:0/663120434 >> v2:172.21.15.12:3300/0 conn(0x7feaec0c6ff0 0x7feaec15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feaead9d640 1 -- 172.21.15.12:0/663120434 >> v1:172.21.15.99:6789/0 conn(0x7feaec0ae9f0 legacy=0x7feaec06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.075+0000 7feaead9d640 1 -- 172.21.15.12:0/663120434 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec06af90 con 0x7feaec0c7dc0 2023-10-21T18:28:26.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.077+0000 7feaead9d640 1 --2- 172.21.15.12:0/663120434 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec06b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae40097a0 tx=0x7feae402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462fe7c74d75231d server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.081+0000 7feae959a640 1 -- 172.21.15.12:0/663120434 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4030610 con 0x7feaec0c7dc0 2023-10-21T18:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.081+0000 7feae959a640 1 -- 172.21.15.12:0/663120434 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4030770 con 0x7feaec0c7dc0 2023-10-21T18:28:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.081+0000 7feae959a640 1 -- 172.21.15.12:0/663120434 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4030b00 con 0x7feaec0c7dc0 2023-10-21T18:28:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 -- 172.21.15.12:0/663120434 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 msgr2=0x7feaec06b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 --2- 172.21.15.12:0/663120434 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec06b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae40097a0 tx=0x7feae402b960 comp rx=0 tx=0).stop 2023-10-21T18:28:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 -- 172.21.15.12:0/663120434 shutdown_connections 2023-10-21T18:28:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 --2- 172.21.15.12:0/663120434 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec06b550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 --2- 172.21.15.12:0/663120434 >> v2:172.21.15.12:3300/0 conn(0x7feaec0c6ff0 0x7feaec15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 -- 172.21.15.12:0/663120434 >> 172.21.15.12:0/663120434 conn(0x7feaec06f960 msgr2=0x7feaec06fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 -- 172.21.15.12:0/663120434 shutdown_connections 2023-10-21T18:28:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.082+0000 7feaeb59e640 1 -- 172.21.15.12:0/663120434 wait complete. 2023-10-21T18:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.084+0000 7feaeb59e640 1 Processor -- start 2023-10-21T18:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.084+0000 7feaeb59e640 1 -- start start 2023-10-21T18:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaec0ae9f0 0x7feaec154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaec0c6ff0 0x7feaec154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec14d210 con 0x7feaec0c6ff0 2023-10-21T18:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec14e070 con 0x7feaec0ae9f0 2023-10-21T18:28:26.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.085+0000 7feaeb59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec14d460 con 0x7feaec0c7dc0 2023-10-21T18:28:26.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.086+0000 7feae9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaec0c6ff0 0x7feaec154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.086+0000 7feaea59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaec0ae9f0 0x7feaec154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.086+0000 7feaead9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.086+0000 7feaea59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaec0ae9f0 0x7feaec154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41610/0 (socket says 172.21.15.12:41610) 2023-10-21T18:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.086+0000 7feaea59c640 1 -- 172.21.15.12:0/2976911352 learned_addr learned my addr 172.21.15.12:0/2976911352 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:26.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.090+0000 7feae9d9b640 1 -- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 msgr2=0x7feaec14eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.090+0000 7feae9d9b640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaec0c7dc0 0x7feaec14eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.090+0000 7feae9d9b640 1 -- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaec0ae9f0 msgr2=0x7feaec154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.090+0000 7feae9d9b640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaec0ae9f0 0x7feaec154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.090+0000 7feae9d9b640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009400 con 0x7feaec0c6ff0 2023-10-21T18:28:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.095+0000 7feae9d9b640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaec0c6ff0 0x7feaec154aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fead400e870 tx=0x7fead400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.100+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400ee60 con 0x7feaec0c6ff0 2023-10-21T18:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.100+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead400c940 con 0x7feaec0c6ff0 2023-10-21T18:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.100+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400ccf0 con 0x7feaec0c6ff0 2023-10-21T18:28:26.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.100+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec14d740 con 0x7feaec0c6ff0 2023-10-21T18:28:26.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.100+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec14dd00 con 0x7feaec0c6ff0 2023-10-21T18:28:26.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.102+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feaec06dfd0 con 0x7feaec0c6ff0 2023-10-21T18:28:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.126+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fead4013470 con 0x7feaec0c6ff0 2023-10-21T18:28:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.127+0000 7feae2ffd640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7feacc06aec0 0x7feacc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.128+0000 7feaea59c640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7feacc06aec0 0x7feacc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.129+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fead4058770 con 0x7feaec0c6ff0 2023-10-21T18:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.129+0000 7feaea59c640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7feacc06aec0 0x7feacc06d380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feadc001560 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.129+0000 7feae2ffd640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7feacc073120 0x7feacc075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.129+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feacc075c30 con 0x7feacc073120 2023-10-21T18:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.130+0000 7feaead9d640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7feacc073120 0x7feacc075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.131+0000 7feaead9d640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7feacc073120 0x7feacc075560 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.132+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== osd.5 v2:172.21.15.99:6818/3348201712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7feacc075c30 con 0x7feacc073120 2023-10-21T18:28:26.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.143+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead4054ab0 con 0x7feaec0c6ff0 2023-10-21T18:28:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.149+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 --> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feaec06b270 con 0x7feacc073120 2023-10-21T18:28:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.150+0000 7feae2ffd640 1 -- 172.21.15.12:0/2976911352 <== osd.5 v2:172.21.15.99:6818/3348201712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7feae403f040 con 0x7feacc073120 2023-10-21T18:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.150+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7feacc073120 msgr2=0x7feacc075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.150+0000 7feaeb59e640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6818/3348201712,v1:172.21.15.99:6819/3348201712] conn(0x7feacc073120 0x7feacc075560 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7feacc06aec0 msgr2=0x7feacc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7feacc06aec0 0x7feacc06d380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feadc001560 tx=0x7feadc009040 comp rx=0 tx=0).stop 2023-10-21T18:28:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaec0c6ff0 msgr2=0x7feaec154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 --2- 172.21.15.12:0/2976911352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaec0c6ff0 0x7feaec154aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fead400e870 tx=0x7fead400ed30 comp rx=0 tx=0).stop 2023-10-21T18:28:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaead9d640 1 -- 172.21.15.12:0/2976911352 reap_dead start 2023-10-21T18:28:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 shutdown_connections 2023-10-21T18:28:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 >> 172.21.15.12:0/2976911352 conn(0x7feaec06f960 msgr2=0x7feaec0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 shutdown_connections 2023-10-21T18:28:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.151+0000 7feaeb59e640 1 -- 172.21.15.12:0/2976911352 wait complete. 2023-10-21T18:28:26.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-21T18:28:26.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.400+0000 7f2020dd7640 1 Processor -- start 2023-10-21T18:28:26.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.401+0000 7f2020dd7640 1 -- start start 2023-10-21T18:28:26.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.402+0000 7f2020dd7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.402+0000 7f2020dd7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f201c0c3fc0 0x7f201c15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.402+0000 7f2020dd7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c15cac0 con 0x7f201c0c3a50 2023-10-21T18:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.403+0000 7f2020dd7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c15c570 con 0x7f201c0c3fc0 2023-10-21T18:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.403+0000 7f2020dd7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1594c0 con 0x7f201c153200 2023-10-21T18:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.403+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.403+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54966/0 (socket says 172.21.15.12:54966) 2023-10-21T18:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.403+0000 7f201b7fe640 1 -- 172.21.15.12:0/1630024483 learned_addr learned my addr 172.21.15.12:0/1630024483 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.404+0000 7f201affd640 1 --2- 172.21.15.12:0/1630024483 >> v2:172.21.15.12:3300/0 conn(0x7f201c0c3fc0 0x7f201c15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.405+0000 7f201b7fe640 1 -- 172.21.15.12:0/1630024483 >> v2:172.21.15.12:3300/0 conn(0x7f201c0c3fc0 msgr2=0x7f201c15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.405+0000 7f201b7fe640 1 --2- 172.21.15.12:0/1630024483 >> v2:172.21.15.12:3300/0 conn(0x7f201c0c3fc0 0x7f201c15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.405+0000 7f201b7fe640 1 -- 172.21.15.12:0/1630024483 >> v1:172.21.15.12:6789/0 conn(0x7f201c0c3a50 legacy=0x7f201c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.405+0000 7f201b7fe640 1 -- 172.21.15.12:0/1630024483 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c15d490 con 0x7f201c153200 2023-10-21T18:28:26.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.408+0000 7f201b7fe640 1 --2- 172.21.15.12:0/1630024483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f200c0098a0 tx=0x7f200c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e32ed832a4407ad server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.411+0000 7f201a7fc640 1 -- 172.21.15.12:0/1630024483 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c02f830 con 0x7f201c153200 2023-10-21T18:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.412+0000 7f201a7fc640 1 -- 172.21.15.12:0/1630024483 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c02f990 con 0x7f201c153200 2023-10-21T18:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.412+0000 7f201a7fc640 1 -- 172.21.15.12:0/1630024483 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c02fd20 con 0x7f201c153200 2023-10-21T18:28:26.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 -- 172.21.15.12:0/1630024483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 msgr2=0x7f201c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 --2- 172.21.15.12:0/1630024483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f200c0098a0 tx=0x7f200c02ba10 comp rx=0 tx=0).stop 2023-10-21T18:28:26.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 -- 172.21.15.12:0/1630024483 shutdown_connections 2023-10-21T18:28:26.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 --2- 172.21.15.12:0/1630024483 >> v2:172.21.15.12:3300/0 conn(0x7f201c0c3fc0 0x7f201c15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 --2- 172.21.15.12:0/1630024483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c153200 0x7f201c158f80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 -- 172.21.15.12:0/1630024483 >> 172.21.15.12:0/1630024483 conn(0x7f201c071510 msgr2=0x7f201c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:26.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 -- 172.21.15.12:0/1630024483 shutdown_connections 2023-10-21T18:28:26.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.413+0000 7f2020dd7640 1 -- 172.21.15.12:0/1630024483 wait complete. 2023-10-21T18:28:26.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.415+0000 7f2020dd7640 1 Processor -- start 2023-10-21T18:28:26.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.416+0000 7f2020dd7640 1 -- start start 2023-10-21T18:28:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c0c3fc0 0x7f201c1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 0x7f201c149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0b3b20 con 0x7f201c153200 2023-10-21T18:28:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1f26a0 con 0x7f201c0c3fc0 2023-10-21T18:28:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.417+0000 7f2020dd7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c14cec0 con 0x7f201c0c3a50 2023-10-21T18:28:26.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.418+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.418+0000 7f201affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c0c3fc0 0x7f201c1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.418+0000 7f201bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 0x7f201c149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.418+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54982/0 (socket says 172.21.15.12:54982) 2023-10-21T18:28:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.418+0000 7f201b7fe640 1 -- 172.21.15.12:0/3999816202 learned_addr learned my addr 172.21.15.12:0/3999816202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201bfff640 1 -- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 msgr2=0x7f201c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201bfff640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201bfff640 1 -- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c0c3fc0 msgr2=0x7f201c1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201bfff640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c0c3fc0 0x7f201c1f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:26.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201bfff640 1 -- 172.21.15.12:0/3999816202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0094d0 con 0x7f201c153200 2023-10-21T18:28:26.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.423+0000 7f201b7fe640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:28:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.426+0000 7f201bfff640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 0x7f201c149f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f201400c340 tx=0x7f201400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.433+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140052d0 con 0x7f201c153200 2023-10-21T18:28:26.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.433+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014005430 con 0x7f201c153200 2023-10-21T18:28:26.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.433+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014003830 con 0x7f201c153200 2023-10-21T18:28:26.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.434+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c0c8a80 con 0x7f201c153200 2023-10-21T18:28:26.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.434+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c0b3140 con 0x7f201c153200 2023-10-21T18:28:26.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.435+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c067560 con 0x7f201c153200 2023-10-21T18:28:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.467+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2014003990 con 0x7f201c153200 2023-10-21T18:28:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.469+0000 7f2013fff640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 0x7f1ffc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.470+0000 7f201b7fe640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 0x7f1ffc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:26.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.471+0000 7f201b7fe640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 0x7f1ffc06d3b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f200c0098a0 tx=0x7f200c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:26.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.473+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2014057dd0 con 0x7f201c153200 2023-10-21T18:28:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:26.811+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2014054110 con 0x7f201c153200 2023-10-21T18:28:27.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.025+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f201c159a30 con 0x7f1ffc06aef0 2023-10-21T18:28:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.026+0000 7f2013fff640 1 -- 172.21.15.12:0/3999816202 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f200c042440 con 0x7f1ffc06aef0 2023-10-21T18:28:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2023-10-21T18:28:27.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 msgr2=0x7f1ffc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 0x7f1ffc06d3b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f200c0098a0 tx=0x7f200c008030 comp rx=0 tx=0).stop 2023-10-21T18:28:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 msgr2=0x7f201c149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 0x7f201c149f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f201400c340 tx=0x7f201400c800 comp rx=0 tx=0).stop 2023-10-21T18:28:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 shutdown_connections 2023-10-21T18:28:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1ffc06aef0 0x7f1ffc06d3b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f201c153200 0x7f201c149f70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c0c3fc0 0x7f201c1f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 --2- 172.21.15.12:0/3999816202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c0c3a50 0x7f201c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 >> 172.21.15.12:0/3999816202 conn(0x7f201c071510 msgr2=0x7f201c0cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:27.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 shutdown_connections 2023-10-21T18:28:27.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.029+0000 7f2020dd7640 1 -- 172.21.15.12:0/3999816202 wait complete. 2023-10-21T18:28:27.049 INFO:tasks.ceph:Scrubbing osd.6 2023-10-21T18:28:27.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:27.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.277+0000 7f287c8cf640 1 Processor -- start 2023-10-21T18:28:27.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.277+0000 7f287c8cf640 1 -- start start 2023-10-21T18:28:27.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.279+0000 7f287c8cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 0x7f287806af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.279+0000 7f287c8cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287815d450 con 0x7f28780ca4f0 2023-10-21T18:28:27.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.279+0000 7f287c8cf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780ca930 con 0x7f2878153750 2023-10-21T18:28:27.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.279+0000 7f287c8cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28780b43c0 con 0x7f287806aa70 2023-10-21T18:28:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.280+0000 7f287659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2878153750 0x7f28780b1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:32968/0 (socket says 172.21.15.12:32968) 2023-10-21T18:28:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.280+0000 7f287659c640 1 -- 172.21.15.12:0/930593595 learned_addr learned my addr 172.21.15.12:0/930593595 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.280+0000 7f2876d9d640 1 --2- 172.21.15.12:0/930593595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 0x7f287806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.282+0000 7f2875d9b640 1 -- 172.21.15.12:0/930593595 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677524207 0 0) 0x7f28780ca930 con 0x7f2878153750 2023-10-21T18:28:27.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.282+0000 7f2875d9b640 1 -- 172.21.15.12:0/930593595 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2864003520 con 0x7f2878153750 2023-10-21T18:28:27.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.282+0000 7f2876d9d640 1 -- 172.21.15.12:0/930593595 >> v1:172.21.15.99:6789/0 conn(0x7f2878153750 legacy=0x7f28780b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.282+0000 7f2876d9d640 1 -- 172.21.15.12:0/930593595 >> v1:172.21.15.12:6789/0 conn(0x7f28780ca4f0 legacy=0x7f28780c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.282+0000 7f2876d9d640 1 -- 172.21.15.12:0/930593595 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287806b440 con 0x7f287806aa70 2023-10-21T18:28:27.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.285+0000 7f2876d9d640 1 --2- 172.21.15.12:0/930593595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 0x7f287806af00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2870009dc0 tx=0x7f287002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6455d3796c07bb23 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.289+0000 7f2875d9b640 1 -- 172.21.15.12:0/930593595 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287002cd50 con 0x7f287806aa70 2023-10-21T18:28:27.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.289+0000 7f2875d9b640 1 -- 172.21.15.12:0/930593595 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870034440 con 0x7f287806aa70 2023-10-21T18:28:27.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.289+0000 7f2875d9b640 1 -- 172.21.15.12:0/930593595 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700347d0 con 0x7f287806aa70 2023-10-21T18:28:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.289+0000 7f287c8cf640 1 -- 172.21.15.12:0/930593595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 msgr2=0x7f287806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.289+0000 7f287c8cf640 1 --2- 172.21.15.12:0/930593595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 0x7f287806af00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2870009dc0 tx=0x7f287002bfa0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.290+0000 7f287c8cf640 1 -- 172.21.15.12:0/930593595 shutdown_connections 2023-10-21T18:28:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.290+0000 7f287c8cf640 1 --2- 172.21.15.12:0/930593595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f287806aa70 0x7f287806af00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.290+0000 7f287c8cf640 1 -- 172.21.15.12:0/930593595 >> 172.21.15.12:0/930593595 conn(0x7f2878065ab0 msgr2=0x7f2878065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.290+0000 7f287c8cf640 1 -- 172.21.15.12:0/930593595 shutdown_connections 2023-10-21T18:28:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.290+0000 7f287c8cf640 1 -- 172.21.15.12:0/930593595 wait complete. 2023-10-21T18:28:27.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.292+0000 7f287c8cf640 1 Processor -- start 2023-10-21T18:28:27.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.292+0000 7f287c8cf640 1 -- start start 2023-10-21T18:28:27.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287806aa70 0x7f2878159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 0x7f28781521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2878153750 0x7f287814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878158e80 con 0x7f2878153750 2023-10-21T18:28:27.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878148990 con 0x7f287806aa70 2023-10-21T18:28:27.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.293+0000 7f287c8cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28781486b0 con 0x7f28780ca4f0 2023-10-21T18:28:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.294+0000 7f287659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287806aa70 0x7f2878159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.294+0000 7f286ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 0x7f28781521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.295+0000 7f286ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 0x7f28781521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:54992/0 (socket says 172.21.15.12:54992) 2023-10-21T18:28:27.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.295+0000 7f286ffff640 1 -- 172.21.15.12:0/2920019575 learned_addr learned my addr 172.21.15.12:0/2920019575 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:27.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.295+0000 7f2876d9d640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2878153750 0x7f287814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.298+0000 7f286ffff640 1 -- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287806aa70 msgr2=0x7f2878159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.298+0000 7f286ffff640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287806aa70 0x7f2878159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.298+0000 7f286ffff640 1 -- 172.21.15.12:0/2920019575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2878153750 msgr2=0x7f287814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.298+0000 7f286ffff640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2878153750 0x7f287814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.298+0000 7f286ffff640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870009a70 con 0x7f28780ca4f0 2023-10-21T18:28:27.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.300+0000 7f286ffff640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 0x7f28781521a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f286000c480 tx=0x7f286000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.304+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600052d0 con 0x7f28780ca4f0 2023-10-21T18:28:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.304+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860005430 con 0x7f28780ca4f0 2023-10-21T18:28:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.304+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28781ef490 con 0x7f28780ca4f0 2023-10-21T18:28:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.304+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860012870 con 0x7f28780ca4f0 2023-10-21T18:28:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.304+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781577e0 con 0x7f28780ca4f0 2023-10-21T18:28:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.305+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f287815cb20 con 0x7f28780ca4f0 2023-10-21T18:28:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.325+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f28600129d0 con 0x7f28780ca4f0 2023-10-21T18:28:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.326+0000 7f286effd640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f285806aec0 0x7f285806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.327+0000 7f287659c640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f285806aec0 0x7f285806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f287659c640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f285806aec0 0x7f285806d380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28680011e0 tx=0x7f2868007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2860058890 con 0x7f28780ca4f0 2023-10-21T18:28:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f286effd640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f2858073120 0x7f2858075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2858075c30 con 0x7f2858073120 2023-10-21T18:28:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2860054bd0 con 0x7f28780ca4f0 2023-10-21T18:28:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.328+0000 7f2876d9d640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f2858073120 0x7f2858075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.329+0000 7f2876d9d640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f2858073120 0x7f2858075560 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.330+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== osd.6 v2:172.21.15.99:6826/2547717838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2858075c30 con 0x7f2858073120 2023-10-21T18:28:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.347+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 --> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f287815c840 con 0x7f2858073120 2023-10-21T18:28:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.348+0000 7f286effd640 1 -- 172.21.15.12:0/2920019575 <== osd.6 v2:172.21.15.99:6826/2547717838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f28700345b0 con 0x7f2858073120 2023-10-21T18:28:27.351 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:27.351 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:27.352 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f2858073120 msgr2=0x7f2858075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6826/2547717838,v1:172.21.15.99:6827/2547717838] conn(0x7f2858073120 0x7f2858075560 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f285806aec0 msgr2=0x7f285806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f285806aec0 0x7f285806d380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28680011e0 tx=0x7f2868007d30 comp rx=0 tx=0).stop 2023-10-21T18:28:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 msgr2=0x7f28781521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 --2- 172.21.15.12:0/2920019575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28780ca4f0 0x7f28781521a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f286000c480 tx=0x7f286000c940 comp rx=0 tx=0).stop 2023-10-21T18:28:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f2876d9d640 1 -- 172.21.15.12:0/2920019575 reap_dead start 2023-10-21T18:28:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 shutdown_connections 2023-10-21T18:28:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 >> 172.21.15.12:0/2920019575 conn(0x7f2878065ab0 msgr2=0x7f28780cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 shutdown_connections 2023-10-21T18:28:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.349+0000 7f287c8cf640 1 -- 172.21.15.12:0/2920019575 wait complete. 2023-10-21T18:28:27.378 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-21T18:28:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.599+0000 7f25696f2640 1 Processor -- start 2023-10-21T18:28:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.599+0000 7f25696f2640 1 -- start start 2023-10-21T18:28:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.601+0000 7f25696f2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2564070780 0x7f25640c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.601+0000 7f25696f2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2564157b00 con 0x7f2564157720 2023-10-21T18:28:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.601+0000 7f25696f2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256415d7a0 con 0x7f25640c7550 2023-10-21T18:28:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.601+0000 7f25696f2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640c7960 con 0x7f2564070780 2023-10-21T18:28:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.602+0000 7f25637fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f25640c7550 0x7f2564160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:32982/0 (socket says 172.21.15.12:32982) 2023-10-21T18:28:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.602+0000 7f25637fe640 1 -- 172.21.15.12:0/4271268727 learned_addr learned my addr 172.21.15.12:0/4271268727 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.602+0000 7f255bfff640 1 --2- 172.21.15.12:0/4271268727 >> v2:172.21.15.12:3300/0 conn(0x7f2564070780 0x7f25640c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.604+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551377276 0 0) 0x7f256415d7a0 con 0x7f25640c7550 2023-10-21T18:28:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.605+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2550003520 con 0x7f25640c7550 2023-10-21T18:28:27.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.607+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309754639 0 0) 0x7f2564157b00 con 0x7f2564157720 2023-10-21T18:28:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.607+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256415d7a0 con 0x7f2564157720 2023-10-21T18:28:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.608+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336838356 0 0) 0x7f2550003520 con 0x7f25640c7550 2023-10-21T18:28:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.608+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 >> v2:172.21.15.12:3300/0 conn(0x7f2564070780 msgr2=0x7f25640c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.608+0000 7f25627fc640 1 --2- 172.21.15.12:0/4271268727 >> v2:172.21.15.12:3300/0 conn(0x7f2564070780 0x7f25640c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.608+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 >> v1:172.21.15.12:6789/0 conn(0x7f2564157720 legacy=0x7f25640c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.608+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256415da60 con 0x7f25640c7550 2023-10-21T18:28:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7f255c0019f0 con 0x7f25640c7550 2023-10-21T18:28:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 >> v1:172.21.15.99:6789/0 conn(0x7f25640c7550 legacy=0x7f2564160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 0x7f2550003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25500047c0 0x7f2550004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2550005180 0x7f255000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640c7960 con 0x7f2550005180 2023-10-21T18:28:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255000c000 con 0x7f25500047c0 2023-10-21T18:28:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.609+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255000c1c0 con 0x7f2550003b00 2023-10-21T18:28:27.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.610+0000 7f2562ffd640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 0x7f2550003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.611+0000 7f255bfff640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25500047c0 0x7f2550004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f2562ffd640 1 -- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25500047c0 msgr2=0x7f2550004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f2562ffd640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25500047c0 0x7f2550004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f2562ffd640 1 -- 172.21.15.12:0/4271268727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2550005180 msgr2=0x7f255000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f2562ffd640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2550005180 0x7f255000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f2562ffd640 1 -- 172.21.15.12:0/4271268727 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256415da60 con 0x7f2550003b00 2023-10-21T18:28:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.613+0000 7f25637fe640 1 -- 172.21.15.12:0/4271268727 reap_dead start 2023-10-21T18:28:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.616+0000 7f2562ffd640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 0x7f2550003f00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25540018b0 tx=0x7f25500057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e2d7f576187438 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.619+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540052d0 con 0x7f2550003b00 2023-10-21T18:28:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.619+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554005430 con 0x7f2550003b00 2023-10-21T18:28:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.619+0000 7f25627fc640 1 -- 172.21.15.12:0/4271268727 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554003830 con 0x7f2550003b00 2023-10-21T18:28:27.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.620+0000 7f25696f2640 1 -- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 msgr2=0x7f2550003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.620+0000 7f25696f2640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 0x7f2550003f00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25540018b0 tx=0x7f25500057f0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.621+0000 7f25696f2640 1 -- 172.21.15.12:0/4271268727 shutdown_connections 2023-10-21T18:28:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.621+0000 7f25696f2640 1 --2- 172.21.15.12:0/4271268727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2550003b00 0x7f2550003f00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.621+0000 7f25696f2640 1 -- 172.21.15.12:0/4271268727 >> 172.21.15.12:0/4271268727 conn(0x7f2564069de0 msgr2=0x7f256406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.621+0000 7f25696f2640 1 -- 172.21.15.12:0/4271268727 shutdown_connections 2023-10-21T18:28:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.621+0000 7f25696f2640 1 -- 172.21.15.12:0/4271268727 wait complete. 2023-10-21T18:28:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.623+0000 7f25696f2640 1 Processor -- start 2023-10-21T18:28:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.623+0000 7f25696f2640 1 -- start start 2023-10-21T18:28:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f256415d310 0x7f25640c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25640c4010 0x7f256406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256415af20 con 0x7f25640c4010 2023-10-21T18:28:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256414c4e0 con 0x7f2550003b00 2023-10-21T18:28:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.624+0000 7f25696f2640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256415a940 con 0x7f256415d310 2023-10-21T18:28:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.625+0000 7f25637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25640c4010 0x7f256406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.625+0000 7f2562ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.625+0000 7f255bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f256415d310 0x7f25640c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.625+0000 7f2562ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41652/0 (socket says 172.21.15.12:41652) 2023-10-21T18:28:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.625+0000 7f2562ffd640 1 -- 172.21.15.12:0/2914494290 learned_addr learned my addr 172.21.15.12:0/2914494290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:27.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.629+0000 7f2562ffd640 1 -- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f256415d310 msgr2=0x7f25640c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.629+0000 7f2562ffd640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f256415d310 0x7f25640c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.629+0000 7f2562ffd640 1 -- 172.21.15.12:0/2914494290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25640c4010 msgr2=0x7f256406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.629+0000 7f2562ffd640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25640c4010 0x7f256406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.629+0000 7f2562ffd640 1 -- 172.21.15.12:0/2914494290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640c4490 con 0x7f2550003b00 2023-10-21T18:28:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.632+0000 7f2562ffd640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2554035040 tx=0x7f25540012f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.635+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554007230 con 0x7f2550003b00 2023-10-21T18:28:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.635+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540073b0 con 0x7f2550003b00 2023-10-21T18:28:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.635+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540067d0 con 0x7f2550003b00 2023-10-21T18:28:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.635+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2564156830 con 0x7f2550003b00 2023-10-21T18:28:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.635+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256415abb0 con 0x7f2550003b00 2023-10-21T18:28:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.636+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256415ad40 con 0x7f2550003b00 2023-10-21T18:28:27.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.656+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2554006930 con 0x7f2550003b00 2023-10-21T18:28:27.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.657+0000 7f255b7fe640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 0x7f254406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.658+0000 7f255bfff640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 0x7f254406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.658+0000 7f255bfff640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 0x7f254406d380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25640c6dc0 tx=0x7f254c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.885+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f255407a3a0 con 0x7f2550003b00 2023-10-21T18:28:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:27.895+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25540766e0 con 0x7f2550003b00 2023-10-21T18:28:28.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.111+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f256415e020 con 0x7f254406aec0 2023-10-21T18:28:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.111+0000 7f255b7fe640 1 -- 172.21.15.12:0/2914494290 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f254c019070 con 0x7f254406aec0 2023-10-21T18:28:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2023-10-21T18:28:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 msgr2=0x7f254406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 0x7f254406d380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25640c6dc0 tx=0x7f254c009190 comp rx=0 tx=0).stop 2023-10-21T18:28:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 msgr2=0x7f2564155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2554035040 tx=0x7f25540012f0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 shutdown_connections 2023-10-21T18:28:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f254406aec0 0x7f254406d380 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25640c4010 0x7f256406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f256415d310 0x7f25640c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 --2- 172.21.15.12:0/2914494290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2550003b00 0x7f2564155910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 >> 172.21.15.12:0/2914494290 conn(0x7f2564069de0 msgr2=0x7f2564071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 shutdown_connections 2023-10-21T18:28:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.114+0000 7f25696f2640 1 -- 172.21.15.12:0/2914494290 wait complete. 2023-10-21T18:28:28.137 INFO:tasks.ceph:Scrubbing osd.7 2023-10-21T18:28:28.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-21T18:28:28.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.366+0000 7fd588b1d640 1 Processor -- start 2023-10-21T18:28:28.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.366+0000 7fd588b1d640 1 -- start start 2023-10-21T18:28:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd588b1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 0x7fd58406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd588b1d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58415a450 con 0x7fd584071510 2023-10-21T18:28:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd588b1d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd584156050 con 0x7fd5841500d0 2023-10-21T18:28:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd588b1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd584159eb0 con 0x7fd584156c40 2023-10-21T18:28:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd58259c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd5841500d0 0x7fd5840c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:32998/0 (socket says 172.21.15.12:32998) 2023-10-21T18:28:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd582d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 0x7fd58406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.368+0000 7fd58259c640 1 -- 172.21.15.12:0/4038755328 learned_addr learned my addr 172.21.15.12:0/4038755328 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:28:28.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.371+0000 7fd58159a640 1 -- 172.21.15.12:0/4038755328 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456446980 0 0) 0x7fd584156050 con 0x7fd5841500d0 2023-10-21T18:28:28.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.371+0000 7fd58159a640 1 -- 172.21.15.12:0/4038755328 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd56c003520 con 0x7fd5841500d0 2023-10-21T18:28:28.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.371+0000 7fd582d9d640 1 -- 172.21.15.12:0/4038755328 >> v1:172.21.15.99:6789/0 conn(0x7fd5841500d0 legacy=0x7fd5840c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.371+0000 7fd582d9d640 1 -- 172.21.15.12:0/4038755328 >> v1:172.21.15.12:6789/0 conn(0x7fd584071510 legacy=0x7fd584156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.371+0000 7fd582d9d640 1 -- 172.21.15.12:0/4038755328 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840721c0 con 0x7fd584156c40 2023-10-21T18:28:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.374+0000 7fd582d9d640 1 --2- 172.21.15.12:0/4038755328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 0x7fd58406fd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009dc0 tx=0x7fd57c02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca742a47773a2f53 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.377+0000 7fd58159a640 1 -- 172.21.15.12:0/4038755328 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c02ccc0 con 0x7fd584156c40 2023-10-21T18:28:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.377+0000 7fd58159a640 1 -- 172.21.15.12:0/4038755328 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c02ce20 con 0x7fd584156c40 2023-10-21T18:28:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.377+0000 7fd58159a640 1 -- 172.21.15.12:0/4038755328 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c034660 con 0x7fd584156c40 2023-10-21T18:28:28.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 -- 172.21.15.12:0/4038755328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 msgr2=0x7fd58406fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 --2- 172.21.15.12:0/4038755328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 0x7fd58406fd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009dc0 tx=0x7fd57c02bf10 comp rx=0 tx=0).stop 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 -- 172.21.15.12:0/4038755328 shutdown_connections 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 --2- 172.21.15.12:0/4038755328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584156c40 0x7fd58406fd70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 -- 172.21.15.12:0/4038755328 >> 172.21.15.12:0/4038755328 conn(0x7fd584069de0 msgr2=0x7fd58406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 -- 172.21.15.12:0/4038755328 shutdown_connections 2023-10-21T18:28:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.378+0000 7fd588b1d640 1 -- 172.21.15.12:0/4038755328 wait complete. 2023-10-21T18:28:28.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.380+0000 7fd588b1d640 1 Processor -- start 2023-10-21T18:28:28.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.380+0000 7fd588b1d640 1 -- start start 2023-10-21T18:28:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 0x7fd5841628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5841500d0 0x7fd584133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584156c40 0x7fd5841344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd584137450 con 0x7fd5841500d0 2023-10-21T18:28:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841f2a40 con 0x7fd584156c40 2023-10-21T18:28:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.381+0000 7fd588b1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841f25b0 con 0x7fd584071510 2023-10-21T18:28:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.382+0000 7fd58259c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 0x7fd5841628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.382+0000 7fd582d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584156c40 0x7fd5841344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.382+0000 7fd581d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5841500d0 0x7fd584133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.382+0000 7fd58259c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 0x7fd5841628c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55034/0 (socket says 172.21.15.12:55034) 2023-10-21T18:28:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.382+0000 7fd58259c640 1 -- 172.21.15.12:0/2046269986 learned_addr learned my addr 172.21.15.12:0/2046269986 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.385+0000 7fd58259c640 1 -- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584156c40 msgr2=0x7fd5841344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.385+0000 7fd58259c640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584156c40 0x7fd5841344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.385+0000 7fd58259c640 1 -- 172.21.15.12:0/2046269986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5841500d0 msgr2=0x7fd584133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.385+0000 7fd58259c640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5841500d0 0x7fd584133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.385+0000 7fd58259c640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009a70 con 0x7fd584071510 2023-10-21T18:28:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.388+0000 7fd58259c640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 0x7fd5841628c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd57400c530 tx=0x7fd57400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.391+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574005ce0 con 0x7fd584071510 2023-10-21T18:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.391+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574005e40 con 0x7fd584071510 2023-10-21T18:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.391+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740072b0 con 0x7fd584071510 2023-10-21T18:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.391+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd584137170 con 0x7fd584071510 2023-10-21T18:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.392+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5841f1f60 con 0x7fd584071510 2023-10-21T18:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.393+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd584071c00 con 0x7fd584071510 2023-10-21T18:28:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.413+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd574007410 con 0x7fd584071510 2023-10-21T18:28:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.414+0000 7fd572ffd640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd56406aef0 0x7fd56406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.414+0000 7fd581d9b640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd56406aef0 0x7fd56406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.415+0000 7fd581d9b640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd56406aef0 0x7fd56406d3b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5840c2600 tx=0x7fd578009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.416+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd574058100 con 0x7fd584071510 2023-10-21T18:28:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.416+0000 7fd572ffd640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7fd564073150 0x7fd564075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.416+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd564075c60 con 0x7fd564073150 2023-10-21T18:28:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.417+0000 7fd582d9d640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7fd564073150 0x7fd564075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.417+0000 7fd582d9d640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7fd564073150 0x7fd564075590 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.418+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== osd.7 v2:172.21.15.99:6802/2053185906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd564075c60 con 0x7fd564073150 2023-10-21T18:28:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.419+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd574054440 con 0x7fd584071510 2023-10-21T18:28:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.439+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 --> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd58415a170 con 0x7fd564073150 2023-10-21T18:28:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.440+0000 7fd572ffd640 1 -- 172.21.15.12:0/2046269986 <== osd.7 v2:172.21.15.99:6802/2053185906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd57c02cac0 con 0x7fd564073150 2023-10-21T18:28:28.442 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-21T18:28:28.443 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-21T18:28:28.443 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-21T18:28:28.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7fd564073150 msgr2=0x7fd564075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6802/2053185906,v1:172.21.15.99:6803/2053185906] conn(0x7fd564073150 0x7fd564075590 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd56406aef0 msgr2=0x7fd56406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fd56406aef0 0x7fd56406d3b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5840c2600 tx=0x7fd578009040 comp rx=0 tx=0).stop 2023-10-21T18:28:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 msgr2=0x7fd5841628c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 --2- 172.21.15.12:0/2046269986 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584071510 0x7fd5841628c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd57400c530 tx=0x7fd57400c9f0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd582d9d640 1 -- 172.21.15.12:0/2046269986 reap_dead start 2023-10-21T18:28:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 shutdown_connections 2023-10-21T18:28:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 >> 172.21.15.12:0/2046269986 conn(0x7fd584069de0 msgr2=0x7fd5840c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 shutdown_connections 2023-10-21T18:28:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.441+0000 7fd588b1d640 1 -- 172.21.15.12:0/2046269986 wait complete. 2023-10-21T18:28:28.464 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-21T18:28:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.690+0000 7f6ef70d4640 1 Processor -- start 2023-10-21T18:28:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.691+0000 7f6ef70d4640 1 -- start start 2023-10-21T18:28:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ef0071510 0x7f6ef00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6ef00c1f40 0x7f6ef0156530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00c2350 con 0x7f6ef00c1f40 2023-10-21T18:28:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef015a450 con 0x7f6ef0071510 2023-10-21T18:28:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.692+0000 7f6ef70d4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0156050 con 0x7f6ef01500d0 2023-10-21T18:28:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.693+0000 7f6ef4e70640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.693+0000 7f6eeffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ef0071510 0x7f6ef00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.693+0000 7f6ef5671640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6ef00c1f40 0x7f6ef0156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.694+0000 7f6eeffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ef0071510 0x7f6ef00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41666/0 (socket says 172.21.15.12:41666) 2023-10-21T18:28:28.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.694+0000 7f6eeffff640 1 -- 172.21.15.12:0/1404282003 learned_addr learned my addr 172.21.15.12:0/1404282003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:28.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.694+0000 7f6ef4e70640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55042/0 (socket says 172.21.15.12:55042) 2023-10-21T18:28:28.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.696+0000 7f6eeffff640 1 -- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 msgr2=0x7f6ef006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.696+0000 7f6eeffff640 1 --2- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.696+0000 7f6eeffff640 1 -- 172.21.15.12:0/1404282003 >> v2:172.21.15.12:3300/0 conn(0x7f6ef00c1f40 msgr2=0x7f6ef0156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.696+0000 7f6eeffff640 1 --2- 172.21.15.12:0/1404282003 >> v2:172.21.15.12:3300/0 conn(0x7f6ef00c1f40 0x7f6ef0156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.697+0000 7f6eeffff640 1 -- 172.21.15.12:0/1404282003 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0159eb0 con 0x7f6ef0071510 2023-10-21T18:28:28.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.699+0000 7f6eeffff640 1 --2- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef0071510 0x7f6ef00c1a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ef006adb0 tx=0x7f6ee002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6613a767909589d server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.702+0000 7f6eef7fe640 1 -- 172.21.15.12:0/1404282003 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0030860 con 0x7f6ef0071510 2023-10-21T18:28:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6eef7fe640 1 -- 172.21.15.12:0/1404282003 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00309c0 con 0x7f6ef0071510 2023-10-21T18:28:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6eef7fe640 1 -- 172.21.15.12:0/1404282003 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0030d50 con 0x7f6ef0071510 2023-10-21T18:28:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef0071510 msgr2=0x7f6ef00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef0071510 0x7f6ef00c1a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ef006adb0 tx=0x7f6ee002b9a0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1404282003 shutdown_connections 2023-10-21T18:28:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1404282003 >> v2:172.21.15.12:3300/0 conn(0x7f6ef00c1f40 0x7f6ef0156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef0071510 0x7f6ef00c1a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1404282003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1404282003 >> 172.21.15.12:0/1404282003 conn(0x7f6ef0069de0 msgr2=0x7f6ef006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1404282003 shutdown_connections 2023-10-21T18:28:28.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.703+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1404282003 wait complete. 2023-10-21T18:28:28.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.705+0000 7f6ef70d4640 1 Processor -- start 2023-10-21T18:28:28.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.705+0000 7f6ef70d4640 1 -- start start 2023-10-21T18:28:28.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 0x7f6ef01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 0x7f6ef0158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c8500 con 0x7f6ef0071510 2023-10-21T18:28:28.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01538e0 con 0x7f6ef00c1f40 2023-10-21T18:28:28.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.706+0000 7f6ef70d4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c8710 con 0x7f6ef01500d0 2023-10-21T18:28:28.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6ef5671640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 0x7f6ef0158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6ef4e70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 0x7f6ef01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 0x7f6ef0158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:41670/0 (socket says 172.21.15.12:41670) 2023-10-21T18:28:28.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6ef5671640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef01590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55050/0 (socket says 172.21.15.12:55050) 2023-10-21T18:28:28.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.707+0000 7f6eeffff640 1 -- 172.21.15.12:0/1660967795 learned_addr learned my addr 172.21.15.12:0/1660967795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:28.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.711+0000 7f6ef4e70640 1 -- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 msgr2=0x7f6ef01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.711+0000 7f6ef4e70640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.711+0000 7f6ef4e70640 1 -- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 msgr2=0x7f6ef0158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.711+0000 7f6ef4e70640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 0x7f6ef0158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.711+0000 7f6ef4e70640 1 -- 172.21.15.12:0/1660967795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094d0 con 0x7f6ef0071510 2023-10-21T18:28:28.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.714+0000 7f6ef4e70640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 0x7f6ef01515a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400e850 tx=0x7f6ee400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.718+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40095b0 con 0x7f6ef0071510 2023-10-21T18:28:28.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.718+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400c940 con 0x7f6ef0071510 2023-10-21T18:28:28.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.718+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef014bf70 con 0x7f6ef0071510 2023-10-21T18:28:28.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.718+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400ccd0 con 0x7f6ef0071510 2023-10-21T18:28:28.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.718+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef0151ae0 con 0x7f6ef0071510 2023-10-21T18:28:28.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.719+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef014bdd0 con 0x7f6ef0071510 2023-10-21T18:28:28.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.742+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ee4013470 con 0x7f6ef0071510 2023-10-21T18:28:28.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.743+0000 7f6eed7fa640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 0x7f6edc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:28.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.744+0000 7f6eeffff640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 0x7f6edc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:28.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:28.744+0000 7f6eeffff640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 0x7f6edc06d3b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00c6530 tx=0x7f6ee0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:28.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:28:28.783 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:28:29.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.074+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6ee400ce30 con 0x7f6ef0071510 2023-10-21T18:28:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.075+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ee4054ef0 con 0x7f6ef0071510 2023-10-21T18:28:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.292+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef015a170 con 0x7f6edc06aef0 2023-10-21T18:28:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.293+0000 7f6eed7fa640 1 -- 172.21.15.12:0/1660967795 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ee0030bb0 con 0x7f6edc06aef0 2023-10-21T18:28:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2023-10-21T18:28:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 msgr2=0x7f6edc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 0x7f6edc06d3b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00c6530 tx=0x7f6ee0008030 comp rx=0 tx=0).stop 2023-10-21T18:28:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 msgr2=0x7f6ef01515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 0x7f6ef01515a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400e850 tx=0x7f6ee400ed10 comp rx=0 tx=0).stop 2023-10-21T18:28:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 shutdown_connections 2023-10-21T18:28:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f6edc06aef0 0x7f6edc06d3b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ef01500d0 0x7f6ef01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ef00c1f40 0x7f6ef0158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 --2- 172.21.15.12:0/1660967795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ef0071510 0x7f6ef01515a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 >> 172.21.15.12:0/1660967795 conn(0x7f6ef0069de0 msgr2=0x7f6ef006fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 shutdown_connections 2023-10-21T18:28:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.296+0000 7f6ef70d4640 1 -- 172.21.15.12:0/1660967795 wait complete. 2023-10-21T18:28:29.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:28:29.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.530+0000 7f5d53b41640 1 Processor -- start 2023-10-21T18:28:29.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.530+0000 7f5d53b41640 1 -- start start 2023-10-21T18:28:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.532+0000 7f5d53b41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.532+0000 7f5d53b41640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5d4c157cc0 0x7f5d4c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.532+0000 7f5d53b41640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0c23f0 con 0x7f5d4c0c59d0 2023-10-21T18:28:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.532+0000 7f5d53b41640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c156fa0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.532+0000 7f5d53b41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15aaf0 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.533+0000 7f5d518dd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.533+0000 7f5d518dd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55060/0 (socket says 172.21.15.12:55060) 2023-10-21T18:28:29.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.533+0000 7f5d518dd640 1 -- 172.21.15.12:0/1407946421 learned_addr learned my addr 172.21.15.12:0/1407946421 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:29.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.533+0000 7f5d510dc640 1 --2- 172.21.15.12:0/1407946421 >> v2:172.21.15.12:3300/0 conn(0x7f5d4c157cc0 0x7f5d4c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.535+0000 7f5d518dd640 1 -- 172.21.15.12:0/1407946421 >> v2:172.21.15.12:3300/0 conn(0x7f5d4c157cc0 msgr2=0x7f5d4c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:29.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.535+0000 7f5d518dd640 1 --2- 172.21.15.12:0/1407946421 >> v2:172.21.15.12:3300/0 conn(0x7f5d4c157cc0 0x7f5d4c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.535+0000 7f5d518dd640 1 -- 172.21.15.12:0/1407946421 >> v1:172.21.15.12:6789/0 conn(0x7f5d4c0c59d0 legacy=0x7f5d4c0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:29.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.535+0000 7f5d518dd640 1 -- 172.21.15.12:0/1407946421 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c15add0 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.537+0000 7f5d518dd640 1 --2- 172.21.15.12:0/1407946421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009870 tx=0x7f5d4802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f94680112343e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.540+0000 7f5d508db640 1 -- 172.21.15.12:0/1407946421 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48030840 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.540+0000 7f5d508db640 1 -- 172.21.15.12:0/1407946421 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d480309a0 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.540+0000 7f5d508db640 1 -- 172.21.15.12:0/1407946421 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48030d30 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.541+0000 7f5d53b41640 1 -- 172.21.15.12:0/1407946421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 msgr2=0x7f5d4c157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.541+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1407946421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009870 tx=0x7f5d4802b980 comp rx=0 tx=0).stop 2023-10-21T18:28:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 -- 172.21.15.12:0/1407946421 shutdown_connections 2023-10-21T18:28:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1407946421 >> v2:172.21.15.12:3300/0 conn(0x7f5d4c157cc0 0x7f5d4c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1407946421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c0c55f0 0x7f5d4c157780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 -- 172.21.15.12:0/1407946421 >> 172.21.15.12:0/1407946421 conn(0x7f5d4c069de0 msgr2=0x7f5d4c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 -- 172.21.15.12:0/1407946421 shutdown_connections 2023-10-21T18:28:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.542+0000 7f5d53b41640 1 -- 172.21.15.12:0/1407946421 wait complete. 2023-10-21T18:28:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.544+0000 7f5d53b41640 1 Processor -- start 2023-10-21T18:28:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.545+0000 7f5d53b41640 1 -- start start 2023-10-21T18:28:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d4c0c55f0 0x7f5d4c1453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c0c59d0 0x7f5d4c1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c143130 con 0x7f5d4c0c59d0 2023-10-21T18:28:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1f2b40 con 0x7f5d4c0c55f0 2023-10-21T18:28:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.546+0000 7f5d53b41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c152d50 con 0x7f5d4c157cc0 2023-10-21T18:28:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.547+0000 7f5d520de640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.547+0000 7f5d518dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d4c0c55f0 0x7f5d4c1453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.547+0000 7f5d520de640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:55076/0 (socket says 172.21.15.12:55076) 2023-10-21T18:28:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.547+0000 7f5d510dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c0c59d0 0x7f5d4c1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.547+0000 7f5d520de640 1 -- 172.21.15.12:0/1062090419 learned_addr learned my addr 172.21.15.12:0/1062090419 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:29.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.550+0000 7f5d520de640 1 -- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d4c0c55f0 msgr2=0x7f5d4c1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:29.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.550+0000 7f5d520de640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d4c0c55f0 0x7f5d4c1453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.550+0000 7f5d520de640 1 -- 172.21.15.12:0/1062090419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c0c59d0 msgr2=0x7f5d4c1eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:29.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.550+0000 7f5d520de640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c0c59d0 0x7f5d4c1eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:29.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.550+0000 7f5d520de640 1 -- 172.21.15.12:0/1062090419 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480094d0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.552+0000 7f5d520de640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c780 tx=0x7f5d4400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:29.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.556+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400a840 con 0x7f5d4c157cc0 2023-10-21T18:28:29.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.556+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400a9c0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.556+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400adb0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.556+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c1f2fd0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.556+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c1f2210 con 0x7f5d4c157cc0 2023-10-21T18:28:29.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.557+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c1f2cf0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.575+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d44012420 con 0x7f5d4c157cc0 2023-10-21T18:28:29.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.576+0000 7f5d427fc640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 0x7f5d3006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:29.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.576+0000 7f5d518dd640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 0x7f5d3006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:29.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.577+0000 7f5d518dd640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 0x7f5d3006d3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5d48036000 tx=0x7f5d48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:29.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.800+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5d44058be0 con 0x7f5d4c157cc0 2023-10-21T18:28:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:29.811+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d44054f20 con 0x7f5d4c157cc0 2023-10-21T18:28:30.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.029+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d4c15b390 con 0x7f5d3006aef0 2023-10-21T18:28:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.037+0000 7f5d427fc640 1 -- 172.21.15.12:0/1062090419 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287341 (secure 0 0 0) 0x7f5d48030640 con 0x7f5d3006aef0 2023-10-21T18:28:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:30.044 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:28:30.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 msgr2=0x7f5d3006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:30.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 0x7f5d3006d3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5d48036000 tx=0x7f5d48008030 comp rx=0 tx=0).stop 2023-10-21T18:28:30.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 msgr2=0x7f5d4c141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c780 tx=0x7f5d4400cc40 comp rx=0 tx=0).stop 2023-10-21T18:28:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 shutdown_connections 2023-10-21T18:28:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f5d3006aef0 0x7f5d3006d3b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4c157cc0 0x7f5d4c141df0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c0c59d0 0x7f5d4c1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 --2- 172.21.15.12:0/1062090419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d4c0c55f0 0x7f5d4c1453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 >> 172.21.15.12:0/1062090419 conn(0x7f5d4c069de0 msgr2=0x7f5d4c1557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 shutdown_connections 2023-10-21T18:28:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:30.044+0000 7f5d53b41640 1 -- 172.21.15.12:0/1062090419 wait complete. 2023-10-21T18:28:30.066 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3662,"stamp":"2023-10-21T18:28:29.136756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216929668,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48793,"num_write_kb":4575230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50293,"ondisk_log_size":50293,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":945872,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754028848,"statfs":{"total":773094113280,"available":772125540352,"internally_reserved":0,"allocated":435961856,"data_stored":434594192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":532532794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":880,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002367"},"pg_stats":[{"pgid":"3.3f","version":"25'409","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.421041+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T18:28:21.421041+0000","last_peered":"2023-10-21T18:28:21.421041+0000","last_clean":"2023-10-21T18:28:21.421041+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:28:21.421041+0000","last_undegraded":"2023-10-21T18:28:21.421041+0000","last_fullsized":"2023-10-21T18:28:21.421041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'423","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464865+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T18:28:22.464865+0000","last_peered":"2023-10-21T18:28:22.464865+0000","last_clean":"2023-10-21T18:28:22.464865+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:28:22.464865+0000","last_undegraded":"2023-10-21T18:28:22.464865+0000","last_fullsized":"2023-10-21T18:28:22.464865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'376","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464851+0000","last_change":"2023-10-21T16:27:31.871485+0000","last_active":"2023-10-21T18:28:22.464851+0000","last_peered":"2023-10-21T18:28:22.464851+0000","last_clean":"2023-10-21T18:28:22.464851+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:28:22.464851+0000","last_undegraded":"2023-10-21T18:28:22.464851+0000","last_fullsized":"2023-10-21T18:28:22.464851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'405","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.768118+0000","last_change":"2023-10-21T16:27:31.873252+0000","last_active":"2023-10-21T18:28:15.768118+0000","last_peered":"2023-10-21T18:28:15.768118+0000","last_clean":"2023-10-21T18:28:15.768118+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:28:15.768118+0000","last_undegraded":"2023-10-21T18:28:15.768118+0000","last_fullsized":"2023-10-21T18:28:15.768118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.779222+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:28:15.779222+0000","last_peered":"2023-10-21T18:28:15.779222+0000","last_clean":"2023-10-21T18:28:15.779222+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:28:15.779222+0000","last_undegraded":"2023-10-21T18:28:15.779222+0000","last_fullsized":"2023-10-21T18:28:15.779222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:21:43.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'388","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.766958+0000","last_change":"2023-10-21T16:27:31.872809+0000","last_active":"2023-10-21T18:28:15.766958+0000","last_peered":"2023-10-21T18:28:15.766958+0000","last_clean":"2023-10-21T18:28:15.766958+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:28:15.766958+0000","last_undegraded":"2023-10-21T18:28:15.766958+0000","last_fullsized":"2023-10-21T18:28:15.766958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'407","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.802181+0000","last_change":"2023-10-21T16:27:31.923451+0000","last_active":"2023-10-21T18:28:15.802181+0000","last_peered":"2023-10-21T18:28:15.802181+0000","last_clean":"2023-10-21T18:28:15.802181+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:28:15.802181+0000","last_undegraded":"2023-10-21T18:28:15.802181+0000","last_fullsized":"2023-10-21T18:28:15.802181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'384","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.877192+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:28:15.877192+0000","last_peered":"2023-10-21T18:28:15.877192+0000","last_clean":"2023-10-21T18:28:15.877192+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:28:15.877192+0000","last_undegraded":"2023-10-21T18:28:15.877192+0000","last_fullsized":"2023-10-21T18:28:15.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'428","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.897962+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T18:28:15.897962+0000","last_peered":"2023-10-21T18:28:15.897962+0000","last_clean":"2023-10-21T18:28:15.897962+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:28:15.897962+0000","last_undegraded":"2023-10-21T18:28:15.897962+0000","last_fullsized":"2023-10-21T18:28:15.897962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420961+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T18:28:21.420961+0000","last_peered":"2023-10-21T18:28:21.420961+0000","last_clean":"2023-10-21T18:28:21.420961+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:28:21.420961+0000","last_undegraded":"2023-10-21T18:28:21.420961+0000","last_fullsized":"2023-10-21T18:28:21.420961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'366","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420937+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T18:28:21.420937+0000","last_peered":"2023-10-21T18:28:21.420937+0000","last_clean":"2023-10-21T18:28:21.420937+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:28:21.420937+0000","last_undegraded":"2023-10-21T18:28:21.420937+0000","last_fullsized":"2023-10-21T18:28:21.420937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'373","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420834+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T18:28:21.420834+0000","last_peered":"2023-10-21T18:28:21.420834+0000","last_clean":"2023-10-21T18:28:21.420834+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:28:21.420834+0000","last_undegraded":"2023-10-21T18:28:21.420834+0000","last_fullsized":"2023-10-21T18:28:21.420834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'411","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.856099+0000","last_change":"2023-10-21T16:27:31.925853+0000","last_active":"2023-10-21T18:28:15.856099+0000","last_peered":"2023-10-21T18:28:15.856099+0000","last_clean":"2023-10-21T18:28:15.856099+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:28:15.856099+0000","last_undegraded":"2023-10-21T18:28:15.856099+0000","last_fullsized":"2023-10-21T18:28:15.856099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:53:26.834810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'409","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.837142+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T18:28:15.837142+0000","last_peered":"2023-10-21T18:28:15.837142+0000","last_clean":"2023-10-21T18:28:15.837142+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:28:15.837142+0000","last_undegraded":"2023-10-21T18:28:15.837142+0000","last_fullsized":"2023-10-21T18:28:15.837142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:08:07.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'429","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.876599+0000","last_change":"2023-10-21T16:27:31.927105+0000","last_active":"2023-10-21T18:28:15.876599+0000","last_peered":"2023-10-21T18:28:15.876599+0000","last_clean":"2023-10-21T18:28:15.876599+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:28:15.876599+0000","last_undegraded":"2023-10-21T18:28:15.876599+0000","last_fullsized":"2023-10-21T18:28:15.876599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'427","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958272+0000","last_change":"2023-10-21T16:27:31.911382+0000","last_active":"2023-10-21T18:28:15.958272+0000","last_peered":"2023-10-21T18:28:15.958272+0000","last_clean":"2023-10-21T18:28:15.958272+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:28:15.958272+0000","last_undegraded":"2023-10-21T18:28:15.958272+0000","last_fullsized":"2023-10-21T18:28:15.958272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:01:15.545255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'462","reported_seq":564,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.957780+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:28:15.957780+0000","last_peered":"2023-10-21T18:28:15.957780+0000","last_clean":"2023-10-21T18:28:15.957780+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:28:15.957780+0000","last_undegraded":"2023-10-21T18:28:15.957780+0000","last_fullsized":"2023-10-21T18:28:15.957780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:41.673911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.771246+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T18:28:15.771246+0000","last_peered":"2023-10-21T18:28:15.771246+0000","last_clean":"2023-10-21T18:28:15.771246+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:15.771246+0000","last_undegraded":"2023-10-21T18:28:15.771246+0000","last_fullsized":"2023-10-21T18:28:15.771246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:22:01.028810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'404","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958487+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:28:15.958487+0000","last_peered":"2023-10-21T18:28:15.958487+0000","last_clean":"2023-10-21T18:28:15.958487+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:28:15.958487+0000","last_undegraded":"2023-10-21T18:28:15.958487+0000","last_fullsized":"2023-10-21T18:28:15.958487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:42:46.939142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.811291+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T18:28:15.811291+0000","last_peered":"2023-10-21T18:28:15.811291+0000","last_clean":"2023-10-21T18:28:15.811291+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:28:15.811291+0000","last_undegraded":"2023-10-21T18:28:15.811291+0000","last_fullsized":"2023-10-21T18:28:15.811291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'400","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.803245+0000","last_change":"2023-10-21T16:27:31.875309+0000","last_active":"2023-10-21T18:28:15.803245+0000","last_peered":"2023-10-21T18:28:15.803245+0000","last_clean":"2023-10-21T18:28:15.803245+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:28:15.803245+0000","last_undegraded":"2023-10-21T18:28:15.803245+0000","last_fullsized":"2023-10-21T18:28:15.803245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'449","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.896739+0000","last_change":"2023-10-21T16:27:31.926594+0000","last_active":"2023-10-21T18:28:15.896739+0000","last_peered":"2023-10-21T18:28:15.896739+0000","last_clean":"2023-10-21T18:28:15.896739+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:28:15.896739+0000","last_undegraded":"2023-10-21T18:28:15.896739+0000","last_fullsized":"2023-10-21T18:28:15.896739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'395","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.873128+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T18:28:15.873128+0000","last_peered":"2023-10-21T18:28:15.873128+0000","last_clean":"2023-10-21T18:28:15.873128+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:28:15.873128+0000","last_undegraded":"2023-10-21T18:28:15.873128+0000","last_fullsized":"2023-10-21T18:28:15.873128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'412","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959771+0000","last_change":"2023-10-21T16:27:31.907310+0000","last_active":"2023-10-21T18:28:15.959771+0000","last_peered":"2023-10-21T18:28:15.959771+0000","last_clean":"2023-10-21T18:28:15.959771+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:15.959771+0000","last_undegraded":"2023-10-21T18:28:15.959771+0000","last_fullsized":"2023-10-21T18:28:15.959771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:00:22.858719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'408","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.873033+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:28:15.873033+0000","last_peered":"2023-10-21T18:28:15.873033+0000","last_clean":"2023-10-21T18:28:15.873033+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:28:15.873033+0000","last_undegraded":"2023-10-21T18:28:15.873033+0000","last_fullsized":"2023-10-21T18:28:15.873033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'487","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.773756+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T18:28:15.773756+0000","last_peered":"2023-10-21T18:28:15.773756+0000","last_clean":"2023-10-21T18:28:15.773756+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:28:15.773756+0000","last_undegraded":"2023-10-21T18:28:15.773756+0000","last_fullsized":"2023-10-21T18:28:15.773756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'417","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.802331+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T18:28:15.802331+0000","last_peered":"2023-10-21T18:28:15.802331+0000","last_clean":"2023-10-21T18:28:15.802331+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:28:15.802331+0000","last_undegraded":"2023-10-21T18:28:15.802331+0000","last_fullsized":"2023-10-21T18:28:15.802331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:24:53.604625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'406","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.811207+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T18:28:15.811207+0000","last_peered":"2023-10-21T18:28:15.811207+0000","last_clean":"2023-10-21T18:28:15.811207+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:28:15.811207+0000","last_undegraded":"2023-10-21T18:28:15.811207+0000","last_fullsized":"2023-10-21T18:28:15.811207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:56.581722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'398","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.871628+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T18:28:15.871628+0000","last_peered":"2023-10-21T18:28:15.871628+0000","last_clean":"2023-10-21T18:28:15.871628+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:28:15.871628+0000","last_undegraded":"2023-10-21T18:28:15.871628+0000","last_fullsized":"2023-10-21T18:28:15.871628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'469","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960165+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:28:15.960165+0000","last_peered":"2023-10-21T18:28:15.960165+0000","last_clean":"2023-10-21T18:28:15.960165+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:28:15.960165+0000","last_undegraded":"2023-10-21T18:28:15.960165+0000","last_fullsized":"2023-10-21T18:28:15.960165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:07:45.446124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":552,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.783178+0000","last_change":"2023-10-21T16:27:31.911894+0000","last_active":"2023-10-21T18:28:15.783178+0000","last_peered":"2023-10-21T18:28:15.783178+0000","last_clean":"2023-10-21T18:28:15.783178+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:15.783178+0000","last_undegraded":"2023-10-21T18:28:15.783178+0000","last_fullsized":"2023-10-21T18:28:15.783178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:48:05.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'423","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:23.594327+0000","last_change":"2023-10-21T16:27:31.890835+0000","last_active":"2023-10-21T18:28:23.594327+0000","last_peered":"2023-10-21T18:28:23.594327+0000","last_clean":"2023-10-21T18:28:23.594327+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:28:23.594327+0000","last_undegraded":"2023-10-21T18:28:23.594327+0000","last_fullsized":"2023-10-21T18:28:23.594327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'417","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.896289+0000","last_change":"2023-10-21T16:27:31.913738+0000","last_active":"2023-10-21T18:28:15.896289+0000","last_peered":"2023-10-21T18:28:15.896289+0000","last_clean":"2023-10-21T18:28:15.896289+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:28:15.896289+0000","last_undegraded":"2023-10-21T18:28:15.896289+0000","last_fullsized":"2023-10-21T18:28:15.896289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'222","reported_seq":285,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:32.459520+0000","last_change":"2023-10-21T16:27:30.319050+0000","last_active":"2023-10-21T18:27:32.459520+0000","last_peered":"2023-10-21T18:27:32.459520+0000","last_clean":"2023-10-21T18:27:32.459520+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:27:32.459520+0000","last_undegraded":"2023-10-21T18:27:32.459520+0000","last_fullsized":"2023-10-21T18:27:32.459520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'378","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.802878+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T18:28:15.802878+0000","last_peered":"2023-10-21T18:28:15.802878+0000","last_clean":"2023-10-21T18:28:15.802878+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:28:15.802878+0000","last_undegraded":"2023-10-21T18:28:15.802878+0000","last_fullsized":"2023-10-21T18:28:15.802878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1317","reported_seq":1379,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.451979+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T18:27:29.451979+0000","last_peered":"2023-10-21T18:27:29.451979+0000","last_clean":"2023-10-21T18:27:29.451979+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:27:29.451979+0000","last_undegraded":"2023-10-21T18:27:29.451979+0000","last_fullsized":"2023-10-21T18:27:29.451979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:05:42.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'775","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:27.483016+0000","last_change":"2023-10-21T16:27:30.333322+0000","last_active":"2023-10-21T18:26:27.483016+0000","last_peered":"2023-10-21T18:26:27.483016+0000","last_clean":"2023-10-21T18:26:27.483016+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:26:27.483016+0000","last_undegraded":"2023-10-21T18:26:27.483016+0000","last_fullsized":"2023-10-21T18:26:27.483016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:40:26.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'464","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464799+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:22.464799+0000","last_peered":"2023-10-21T18:28:22.464799+0000","last_clean":"2023-10-21T18:28:22.464799+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:22.464799+0000","last_undegraded":"2023-10-21T18:28:22.464799+0000","last_fullsized":"2023-10-21T18:28:22.464799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'904","reported_seq":968,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:09.189694+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T18:26:09.189694+0000","last_peered":"2023-10-21T18:26:09.189694+0000","last_clean":"2023-10-21T18:26:09.189694+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:26:09.189694+0000","last_undegraded":"2023-10-21T18:26:09.189694+0000","last_fullsized":"2023-10-21T18:26:09.189694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:25:55.303368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'415","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.808653+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T18:28:15.808653+0000","last_peered":"2023-10-21T18:28:15.808653+0000","last_clean":"2023-10-21T18:28:15.808653+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:28:15.808653+0000","last_undegraded":"2023-10-21T18:28:15.808653+0000","last_fullsized":"2023-10-21T18:28:15.808653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:19.444823+0000","last_change":"2023-10-21T16:27:30.326169+0000","last_active":"2023-10-21T18:28:19.444823+0000","last_peered":"2023-10-21T18:28:19.444823+0000","last_clean":"2023-10-21T18:28:19.444823+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:28:19.444823+0000","last_undegraded":"2023-10-21T18:28:19.444823+0000","last_fullsized":"2023-10-21T18:28:19.444823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'419","reported_seq":494,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:23.594309+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T18:28:23.594309+0000","last_peered":"2023-10-21T18:28:23.594309+0000","last_clean":"2023-10-21T18:28:23.594309+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:28:23.594309+0000","last_undegraded":"2023-10-21T18:28:23.594309+0000","last_fullsized":"2023-10-21T18:28:23.594309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1387","reported_seq":1452,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:19.513232+0000","last_change":"2023-10-21T16:27:30.337445+0000","last_active":"2023-10-21T18:28:19.513232+0000","last_peered":"2023-10-21T18:28:19.513232+0000","last_clean":"2023-10-21T18:28:19.513232+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:19.513232+0000","last_undegraded":"2023-10-21T18:28:19.513232+0000","last_fullsized":"2023-10-21T18:28:19.513232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13548657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1323,"num_write_kb":13905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'410","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464902+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:28:22.464902+0000","last_peered":"2023-10-21T18:28:22.464902+0000","last_clean":"2023-10-21T18:28:22.464902+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:28:22.464902+0000","last_undegraded":"2023-10-21T18:28:22.464902+0000","last_fullsized":"2023-10-21T18:28:22.464902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1993","reported_seq":2057,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.205682+0000","last_change":"2023-10-21T16:27:30.321243+0000","last_active":"2023-10-21T18:28:15.205682+0000","last_peered":"2023-10-21T18:28:15.205682+0000","last_clean":"2023-10-21T18:28:15.205682+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:15.205682+0000","last_undegraded":"2023-10-21T18:28:15.205682+0000","last_fullsized":"2023-10-21T18:28:15.205682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:00:48.871238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959599+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:28:15.959599+0000","last_peered":"2023-10-21T18:28:15.959599+0000","last_clean":"2023-10-21T18:28:15.959599+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:28:15.959599+0000","last_undegraded":"2023-10-21T18:28:15.959599+0000","last_fullsized":"2023-10-21T18:28:15.959599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:28:18.776299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1719","reported_seq":1785,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:11.571325+0000","last_change":"2023-10-21T16:27:30.335299+0000","last_active":"2023-10-21T18:28:11.571325+0000","last_peered":"2023-10-21T18:28:11.571325+0000","last_clean":"2023-10-21T18:28:11.571325+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:28:11.571325+0000","last_undegraded":"2023-10-21T18:28:11.571325+0000","last_fullsized":"2023-10-21T18:28:11.571325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'402","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420810+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T18:28:21.420810+0000","last_peered":"2023-10-21T18:28:21.420810+0000","last_clean":"2023-10-21T18:28:21.420810+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:28:21.420810+0000","last_undegraded":"2023-10-21T18:28:21.420810+0000","last_fullsized":"2023-10-21T18:28:21.420810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'322","reported_seq":387,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.534971+0000","last_change":"2023-10-21T16:27:30.333744+0000","last_active":"2023-10-21T18:26:31.534971+0000","last_peered":"2023-10-21T18:26:31.534971+0000","last_clean":"2023-10-21T18:26:31.534971+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:26:31.534971+0000","last_undegraded":"2023-10-21T18:26:31.534971+0000","last_fullsized":"2023-10-21T18:26:31.534971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:19.618501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'385","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.856713+0000","last_change":"2023-10-21T16:27:31.914973+0000","last_active":"2023-10-21T18:28:15.856713+0000","last_peered":"2023-10-21T18:28:15.856713+0000","last_clean":"2023-10-21T18:28:15.856713+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:28:15.856713+0000","last_undegraded":"2023-10-21T18:28:15.856713+0000","last_fullsized":"2023-10-21T18:28:15.856713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:09:07.945558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.568467+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:10.568467+0000","last_peered":"2023-10-21T18:28:10.568467+0000","last_clean":"2023-10-21T18:28:10.568467+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:10.568467+0000","last_undegraded":"2023-10-21T18:28:10.568467+0000","last_fullsized":"2023-10-21T18:28:10.568467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:30:58.012653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'428","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958572+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:15.958572+0000","last_peered":"2023-10-21T18:28:15.958572+0000","last_clean":"2023-10-21T18:28:15.958572+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:15.958572+0000","last_undegraded":"2023-10-21T18:28:15.958572+0000","last_fullsized":"2023-10-21T18:28:15.958572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T16:29:49.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:29.672128+0000","last_change":"2023-10-21T16:27:30.345963+0000","last_active":"2023-10-21T18:26:29.672128+0000","last_peered":"2023-10-21T18:26:29.672128+0000","last_clean":"2023-10-21T18:26:29.672128+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:26:29.672128+0000","last_undegraded":"2023-10-21T18:26:29.672128+0000","last_fullsized":"2023-10-21T18:26:29.672128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'429","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.895777+0000","last_change":"2023-10-21T16:27:31.914207+0000","last_active":"2023-10-21T18:28:15.895777+0000","last_peered":"2023-10-21T18:28:15.895777+0000","last_clean":"2023-10-21T18:28:15.895777+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:28:15.895777+0000","last_undegraded":"2023-10-21T18:28:15.895777+0000","last_fullsized":"2023-10-21T18:28:15.895777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'813","reported_seq":879,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.558612+0000","last_change":"2023-10-21T16:27:30.326951+0000","last_active":"2023-10-21T18:28:10.558612+0000","last_peered":"2023-10-21T18:28:10.558612+0000","last_clean":"2023-10-21T18:28:10.558612+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:28:10.558612+0000","last_undegraded":"2023-10-21T18:28:10.558612+0000","last_fullsized":"2023-10-21T18:28:10.558612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'488","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960616+0000","last_change":"2023-10-21T16:27:31.911203+0000","last_active":"2023-10-21T18:28:15.960616+0000","last_peered":"2023-10-21T18:28:15.960616+0000","last_clean":"2023-10-21T18:28:15.960616+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:28:15.960616+0000","last_undegraded":"2023-10-21T18:28:15.960616+0000","last_fullsized":"2023-10-21T18:28:15.960616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:37:04.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'736","reported_seq":804,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:04.678717+0000","last_change":"2023-10-21T16:27:30.342314+0000","last_active":"2023-10-21T18:27:04.678717+0000","last_peered":"2023-10-21T18:27:04.678717+0000","last_clean":"2023-10-21T18:27:04.678717+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:27:04.678717+0000","last_undegraded":"2023-10-21T18:27:04.678717+0000","last_fullsized":"2023-10-21T18:27:04.678717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'366","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.775068+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T18:28:15.775068+0000","last_peered":"2023-10-21T18:28:15.775068+0000","last_clean":"2023-10-21T18:28:15.775068+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:28:15.775068+0000","last_undegraded":"2023-10-21T18:28:15.775068+0000","last_fullsized":"2023-10-21T18:28:15.775068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'780","reported_seq":848,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:42.400685+0000","last_change":"2023-10-21T16:27:30.321422+0000","last_active":"2023-10-21T18:27:42.400685+0000","last_peered":"2023-10-21T18:27:42.400685+0000","last_clean":"2023-10-21T18:27:42.400685+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:27:42.400685+0000","last_undegraded":"2023-10-21T18:27:42.400685+0000","last_fullsized":"2023-10-21T18:27:42.400685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'358","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.811549+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T18:28:15.811549+0000","last_peered":"2023-10-21T18:28:15.811549+0000","last_clean":"2023-10-21T18:28:15.811549+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:28:15.811549+0000","last_undegraded":"2023-10-21T18:28:15.811549+0000","last_fullsized":"2023-10-21T18:28:15.811549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'243","reported_seq":311,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:37.575200+0000","last_change":"2023-10-21T16:27:30.320058+0000","last_active":"2023-10-21T18:27:37.575200+0000","last_peered":"2023-10-21T18:27:37.575200+0000","last_clean":"2023-10-21T18:27:37.575200+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:27:37.575200+0000","last_undegraded":"2023-10-21T18:27:37.575200+0000","last_fullsized":"2023-10-21T18:27:37.575200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'442","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.794198+0000","last_change":"2023-10-21T16:27:57.700525+0000","last_active":"2023-10-21T18:28:15.794198+0000","last_peered":"2023-10-21T18:28:15.794198+0000","last_clean":"2023-10-21T18:28:15.794198+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:28:15.794198+0000","last_undegraded":"2023-10-21T18:28:15.794198+0000","last_fullsized":"2023-10-21T18:28:15.794198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'366","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:48.737322+0000","last_change":"2023-10-21T16:27:30.333335+0000","last_active":"2023-10-21T18:27:48.737322+0000","last_peered":"2023-10-21T18:27:48.737322+0000","last_clean":"2023-10-21T18:27:48.737322+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:27:48.737322+0000","last_undegraded":"2023-10-21T18:27:48.737322+0000","last_fullsized":"2023-10-21T18:27:48.737322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:19:14.517244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'400","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958619+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:28:15.958619+0000","last_peered":"2023-10-21T18:28:15.958619+0000","last_clean":"2023-10-21T18:28:15.958619+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:28:15.958619+0000","last_undegraded":"2023-10-21T18:28:15.958619+0000","last_fullsized":"2023-10-21T18:28:15.958619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:41:02.296452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":228,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:34.437349+0000","last_change":"2023-10-21T16:27:11.160173+0000","last_active":"2023-10-21T18:27:34.437349+0000","last_peered":"2023-10-21T18:27:34.437349+0000","last_clean":"2023-10-21T18:27:34.437349+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:27:34.437349+0000","last_undegraded":"2023-10-21T18:27:34.437349+0000","last_fullsized":"2023-10-21T18:27:34.437349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:09.379566+0000","last_clean_scrub_stamp":"2023-10-21T16:27:09.379566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'328","reported_seq":400,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:54.432229+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T18:27:54.432229+0000","last_peered":"2023-10-21T18:27:54.432229+0000","last_clean":"2023-10-21T18:27:54.432229+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:27:54.432229+0000","last_undegraded":"2023-10-21T18:27:54.432229+0000","last_fullsized":"2023-10-21T18:27:54.432229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:04:42.060520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'406","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.462452+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T18:28:22.462452+0000","last_peered":"2023-10-21T18:28:22.462452+0000","last_clean":"2023-10-21T18:28:22.462452+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:28:22.462452+0000","last_undegraded":"2023-10-21T18:28:22.462452+0000","last_fullsized":"2023-10-21T18:28:22.462452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'723","reported_seq":797,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:27.299845+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T18:27:27.299845+0000","last_peered":"2023-10-21T18:27:27.299845+0000","last_clean":"2023-10-21T18:27:27.299845+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:27:27.299845+0000","last_undegraded":"2023-10-21T18:27:27.299845+0000","last_fullsized":"2023-10-21T18:27:27.299845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:09.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'417","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.857461+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T18:28:15.857461+0000","last_peered":"2023-10-21T18:28:15.857461+0000","last_clean":"2023-10-21T18:28:15.857461+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:15.857461+0000","last_undegraded":"2023-10-21T18:28:15.857461+0000","last_fullsized":"2023-10-21T18:28:15.857461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:54:28.437871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3009,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.189486+0000","last_change":"2023-10-21T16:27:30.321906+0000","last_active":"2023-10-21T18:28:15.189486+0000","last_peered":"2023-10-21T18:28:15.189486+0000","last_clean":"2023-10-21T18:28:15.189486+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:15.189486+0000","last_undegraded":"2023-10-21T18:28:15.189486+0000","last_fullsized":"2023-10-21T18:28:15.189486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:00.001454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'381","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.868510+0000","last_change":"2023-10-21T16:27:31.896469+0000","last_active":"2023-10-21T18:28:15.868510+0000","last_peered":"2023-10-21T18:28:15.868510+0000","last_clean":"2023-10-21T18:28:15.868510+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:15.868510+0000","last_undegraded":"2023-10-21T18:28:15.868510+0000","last_fullsized":"2023-10-21T18:28:15.868510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'392","reported_seq":464,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:25.847788+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T18:26:25.847788+0000","last_peered":"2023-10-21T18:26:25.847788+0000","last_clean":"2023-10-21T18:26:25.847788+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:26:25.847788+0000","last_undegraded":"2023-10-21T18:26:25.847788+0000","last_fullsized":"2023-10-21T18:26:25.847788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:03:40.198812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'392","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420711+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T18:28:21.420711+0000","last_peered":"2023-10-21T18:28:21.420711+0000","last_clean":"2023-10-21T18:28:21.420711+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:28:21.420711+0000","last_undegraded":"2023-10-21T18:28:21.420711+0000","last_fullsized":"2023-10-21T18:28:21.420711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'411","reported_seq":484,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464840+0000","last_change":"2023-10-21T16:27:30.318972+0000","last_active":"2023-10-21T18:28:22.464840+0000","last_peered":"2023-10-21T18:28:22.464840+0000","last_clean":"2023-10-21T18:28:22.464840+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:28:22.464840+0000","last_undegraded":"2023-10-21T18:28:22.464840+0000","last_fullsized":"2023-10-21T18:28:22.464840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'410","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.771048+0000","last_change":"2023-10-21T16:27:31.891092+0000","last_active":"2023-10-21T18:28:15.771048+0000","last_peered":"2023-10-21T18:28:15.771048+0000","last_clean":"2023-10-21T18:28:15.771048+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:28:15.771048+0000","last_undegraded":"2023-10-21T18:28:15.771048+0000","last_fullsized":"2023-10-21T18:28:15.771048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":659,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:10.237903+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:27:10.237903+0000","last_peered":"2023-10-21T18:27:10.237903+0000","last_clean":"2023-10-21T18:27:10.237903+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:27:10.237903+0000","last_undegraded":"2023-10-21T18:27:10.237903+0000","last_fullsized":"2023-10-21T18:27:10.237903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:46:22.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'377","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.858779+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T18:28:15.858779+0000","last_peered":"2023-10-21T18:28:15.858779+0000","last_clean":"2023-10-21T18:28:15.858779+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:28:15.858779+0000","last_undegraded":"2023-10-21T18:28:15.858779+0000","last_fullsized":"2023-10-21T18:28:15.858779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:44:10.608034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1346","reported_seq":1416,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:16.496427+0000","last_change":"2023-10-21T16:27:30.322943+0000","last_active":"2023-10-21T18:28:16.496427+0000","last_peered":"2023-10-21T18:28:16.496427+0000","last_clean":"2023-10-21T18:28:16.496427+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:16.496427+0000","last_undegraded":"2023-10-21T18:28:16.496427+0000","last_fullsized":"2023-10-21T18:28:16.496427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3534,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'364","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.799711+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T18:28:15.799711+0000","last_peered":"2023-10-21T18:28:15.799711+0000","last_clean":"2023-10-21T18:28:15.799711+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:28:15.799711+0000","last_undegraded":"2023-10-21T18:28:15.799711+0000","last_fullsized":"2023-10-21T18:28:15.799711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'320","reported_seq":389,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:20.916635+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T18:27:20.916635+0000","last_peered":"2023-10-21T18:27:20.916635+0000","last_clean":"2023-10-21T18:27:20.916635+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:27:20.916635+0000","last_undegraded":"2023-10-21T18:27:20.916635+0000","last_fullsized":"2023-10-21T18:27:20.916635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:22.942183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'463","reported_seq":573,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.796046+0000","last_change":"2023-10-21T16:27:31.897050+0000","last_active":"2023-10-21T18:28:15.796046+0000","last_peered":"2023-10-21T18:28:15.796046+0000","last_clean":"2023-10-21T18:28:15.796046+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:28:15.796046+0000","last_undegraded":"2023-10-21T18:28:15.796046+0000","last_fullsized":"2023-10-21T18:28:15.796046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'261","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:15.614375+0000","last_change":"2023-10-21T16:27:30.331628+0000","last_active":"2023-10-21T18:27:15.614375+0000","last_peered":"2023-10-21T18:27:15.614375+0000","last_clean":"2023-10-21T18:27:15.614375+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:27:15.614375+0000","last_undegraded":"2023-10-21T18:27:15.614375+0000","last_fullsized":"2023-10-21T18:27:15.614375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'421","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958206+0000","last_change":"2023-10-21T16:27:31.909533+0000","last_active":"2023-10-21T18:28:15.958206+0000","last_peered":"2023-10-21T18:28:15.958206+0000","last_clean":"2023-10-21T18:28:15.958206+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:15.958206+0000","last_undegraded":"2023-10-21T18:28:15.958206+0000","last_fullsized":"2023-10-21T18:28:15.958206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:34:23.163213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'420","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:42.553355+0000","last_change":"2023-10-21T16:27:30.330919+0000","last_active":"2023-10-21T18:26:42.553355+0000","last_peered":"2023-10-21T18:26:42.553355+0000","last_clean":"2023-10-21T18:26:42.553355+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:26:42.553355+0000","last_undegraded":"2023-10-21T18:26:42.553355+0000","last_fullsized":"2023-10-21T18:26:42.553355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'402","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.796675+0000","last_change":"2023-10-21T16:27:31.897883+0000","last_active":"2023-10-21T18:28:15.796675+0000","last_peered":"2023-10-21T18:28:15.796675+0000","last_clean":"2023-10-21T18:28:15.796675+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:15.796675+0000","last_undegraded":"2023-10-21T18:28:15.796675+0000","last_fullsized":"2023-10-21T18:28:15.796675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1148","reported_seq":1217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:37.076924+0000","last_change":"2023-10-21T16:27:30.321458+0000","last_active":"2023-10-21T18:26:37.076924+0000","last_peered":"2023-10-21T18:26:37.076924+0000","last_clean":"2023-10-21T18:26:37.076924+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:26:37.076924+0000","last_undegraded":"2023-10-21T18:26:37.076924+0000","last_fullsized":"2023-10-21T18:26:37.076924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:40:12.302178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.776854+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T18:28:15.776854+0000","last_peered":"2023-10-21T18:28:15.776854+0000","last_clean":"2023-10-21T18:28:15.776854+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:15.776854+0000","last_undegraded":"2023-10-21T18:28:15.776854+0000","last_fullsized":"2023-10-21T18:28:15.776854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:50:07.797857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1137","reported_seq":1204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:31.168962+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T18:26:31.168962+0000","last_peered":"2023-10-21T18:26:31.168962+0000","last_clean":"2023-10-21T18:26:31.168962+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:26:31.168962+0000","last_undegraded":"2023-10-21T18:26:31.168962+0000","last_fullsized":"2023-10-21T18:26:31.168962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T17:39:44.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'449","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960134+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:28:15.960134+0000","last_peered":"2023-10-21T18:28:15.960134+0000","last_clean":"2023-10-21T18:28:15.960134+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:28:15.960134+0000","last_undegraded":"2023-10-21T18:28:15.960134+0000","last_fullsized":"2023-10-21T18:28:15.960134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:41:48.860476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'451","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959160+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:28:15.959160+0000","last_peered":"2023-10-21T18:28:15.959160+0000","last_clean":"2023-10-21T18:28:15.959160+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:28:15.959160+0000","last_undegraded":"2023-10-21T18:28:15.959160+0000","last_fullsized":"2023-10-21T18:28:15.959160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:55.938712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'765","reported_seq":828,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.503729+0000","last_change":"2023-10-21T16:27:30.337486+0000","last_active":"2023-10-21T18:27:29.503729+0000","last_peered":"2023-10-21T18:27:29.503729+0000","last_clean":"2023-10-21T18:27:29.503729+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:27:29.503729+0000","last_undegraded":"2023-10-21T18:27:29.503729+0000","last_fullsized":"2023-10-21T18:27:29.503729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'370","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.896736+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T18:28:15.896736+0000","last_peered":"2023-10-21T18:28:15.896736+0000","last_clean":"2023-10-21T18:28:15.896736+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:28:15.896736+0000","last_undegraded":"2023-10-21T18:28:15.896736+0000","last_fullsized":"2023-10-21T18:28:15.896736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1571","reported_seq":1634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:29.503784+0000","last_change":"2023-10-21T16:27:30.338680+0000","last_active":"2023-10-21T18:27:29.503784+0000","last_peered":"2023-10-21T18:27:29.503784+0000","last_clean":"2023-10-21T18:27:29.503784+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:27:29.503784+0000","last_undegraded":"2023-10-21T18:27:29.503784+0000","last_fullsized":"2023-10-21T18:27:29.503784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'358","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464892+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:28:22.464892+0000","last_peered":"2023-10-21T18:28:22.464892+0000","last_clean":"2023-10-21T18:28:22.464892+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:28:22.464892+0000","last_undegraded":"2023-10-21T18:28:22.464892+0000","last_fullsized":"2023-10-21T18:28:22.464892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'568","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:12.463842+0000","last_change":"2023-10-21T16:27:30.318994+0000","last_active":"2023-10-21T18:28:12.463842+0000","last_peered":"2023-10-21T18:28:12.463842+0000","last_clean":"2023-10-21T18:28:12.463842+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:28:12.463842+0000","last_undegraded":"2023-10-21T18:28:12.463842+0000","last_fullsized":"2023-10-21T18:28:12.463842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'382","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.872236+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T18:28:15.872236+0000","last_peered":"2023-10-21T18:28:15.872236+0000","last_clean":"2023-10-21T18:28:15.872236+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:28:15.872236+0000","last_undegraded":"2023-10-21T18:28:15.872236+0000","last_fullsized":"2023-10-21T18:28:15.872236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'607","reported_seq":680,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.462551+0000","last_change":"2023-10-21T16:27:30.343554+0000","last_active":"2023-10-21T18:28:22.462551+0000","last_peered":"2023-10-21T18:28:22.462551+0000","last_clean":"2023-10-21T18:28:22.462551+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:28:22.462551+0000","last_undegraded":"2023-10-21T18:28:22.462551+0000","last_fullsized":"2023-10-21T18:28:22.462551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26357,"ondisk_log_size":26357,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216339300,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24246,"num_write_kb":225038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432678600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23819,"ondisk_log_size":23819,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.093},"min":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.67000000000000004},"max":{"1min":1.704,"5min":1.704,"15min":2.2519999999999998},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.70399999999999996,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.871,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.111}]},{"osd":1,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2749999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7889999999999999,"5min":2.25,"15min":2.2610000000000001},"last":1.496},{"interface":"front","average":{"1min":1.298,"5min":1.3819999999999999,"15min":1.409},"min":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.69399999999999995},"max":{"1min":1.675,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":0.94199999999999995}]},{"osd":2,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.526,"15min":1.5209999999999999},"min":{"1min":0.85599999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0670000000000002,"5min":2.367,"15min":2.367},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.536,"15min":1.5700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8109999999999999,"5min":2.0449999999999999,"15min":2.6669999999999998},"last":1.153}]},{"osd":4,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.974,"15min":2.782},"last":0.998},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3300000000000001,"15min":1.375},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.319},"last":1.3759999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.431,"15min":1.482},"min":{"1min":0.874,"5min":0.874,"15min":0.70099999999999996},"max":{"1min":1.863,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":1.2},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.95799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.994,"5min":2.1760000000000002,"15min":2.423},"last":1.321}]},{"osd":6,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.49,"15min":1.512},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.9249999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.607,"15min":1.6359999999999999},"min":{"1min":1.008,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.044,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.8620000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.615,"15min":1.669},"min":{"1min":1.1579999999999999,"5min":1.01,"15min":0.999},"max":{"1min":2.1850000000000001,"5min":2.29,"15min":2.5859999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.6060000000000001,"15min":1.6439999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.2400000000000002,"5min":2.2429999999999999,"15min":3.0449999999999999},"last":1.7}]}]},{"osd":2,"up_from":16,"seq":68719478197,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.0449999999999999},"min":{"1min":0.72599999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.2509999999999999,"5min":1.7430000000000001,"15min":3.153},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2390000000000001,"15min":1.2250000000000001},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8460000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.4410000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.333,"15min":1.3620000000000001},"min":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.198,"5min":2.198,"15min":2.7480000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.4510000000000001,"15min":1.4299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.63400000000000001},"max":{"1min":1.9730000000000001,"5min":2.335,"15min":2.621},"last":1.625}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.379,"15min":1.3979999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55400000000000005},"max":{"1min":1.998,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.288},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5960000000000001,"15min":1.623},"min":{"1min":1.0640000000000001,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.101,"5min":2.3130000000000002,"15min":3.867},"last":1.3999999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3260000000000001,"15min":1.3600000000000001},"min":{"1min":0.96099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.889,"5min":2.048,"15min":2.895},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.363,"15min":1.3580000000000001},"min":{"1min":0.755,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8089999999999999,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.3360000000000001}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4570000000000001,"15min":1.4430000000000001},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9850000000000001,"5min":2.2320000000000002,"15min":2.524},"last":1.516},{"interface":"front","average":{"1min":1.282,"5min":1.3680000000000001,"15min":1.355},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.59899999999999998},"max":{"1min":1.706,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.466,"15min":1.4570000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.64400000000000002},"max":{"1min":1.847,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4630000000000001,"15min":1.52},"min":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84099999999999997},"max":{"1min":2.0099999999999998,"5min":2.2690000000000001,"15min":3.0259999999999998},"last":1.224}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6200000000000001,"15min":1.5940000000000001},"min":{"1min":0.79400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1040000000000001,"5min":2.2200000000000002,"15min":2.8029999999999999},"last":1.569},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.591,"15min":1.577},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.622},"max":{"1min":1.982,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.173}]}]},{"osd":1,"up_from":16,"seq":68719478197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51979688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.03,"15min":1.0629999999999999},"min":{"1min":0.71299999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.581,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":1.294},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2909999999999999,"15min":1.264},"min":{"1min":0.77600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9330000000000001,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1950000000000001,"15min":1.202},"min":{"1min":0.70099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8939999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4139999999999999,"15min":1.4199999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.69699999999999995},"max":{"1min":1.9450000000000001,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.718}]},{"osd":3,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.486,"15min":1.51},"min":{"1min":1.028,"5min":0.95199999999999996,"15min":0.77300000000000002},"max":{"1min":1.8540000000000001,"5min":2.1099999999999999,"15min":2.681},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.5329999999999999,"15min":1.5469999999999999},"min":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.929,"5min":2.1480000000000001,"15min":2.544},"last":1.377}]},{"osd":4,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3460000000000001,"15min":1.377},"min":{"1min":0.92600000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6890000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.88,"5min":0.84499999999999997,"15min":0.77200000000000002},"max":{"1min":1.6779999999999999,"5min":1.958,"15min":2.1600000000000001},"last":1.155}]},{"osd":5,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.482,"15min":1.4830000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8959999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.526},"min":{"1min":0.96299999999999997,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":1.8740000000000001,"5min":2.165,"15min":2.6850000000000001},"last":1.8340000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.54,"15min":1.5329999999999999},"min":{"1min":1.1419999999999999,"5min":0.91500000000000004,"15min":0.83499999999999996},"max":{"1min":1.97,"5min":2.173,"15min":2.5459999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6140000000000001,"15min":1.6220000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.78900000000000003},"max":{"1min":2.04,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.421}]},{"osd":7,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.669,"15min":1.6779999999999999},"min":{"1min":1.2809999999999999,"5min":1.085,"15min":1.0469999999999999},"max":{"1min":2,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.696,"15min":1.6970000000000001},"min":{"1min":1.2130000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.052,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.665}]}]},{"osd":0,"up_from":16,"seq":68719478198,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84943738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.115,"15min":1.0960000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8759999999999999,"5min":2.0150000000000001,"15min":2.04},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2370000000000001,"15min":1.2609999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.881,"5min":2.0539999999999998,"15min":2.161},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2470000000000001,"15min":1.296},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.60599999999999998},"max":{"1min":1.643,"5min":1.95,"15min":2.3820000000000001},"last":1.054},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3999999999999999,"15min":1.427},"min":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.992,"5min":2.1219999999999999,"15min":2.5550000000000002},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.462,"15min":1.4670000000000001},"min":{"1min":0.81100000000000005,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.2269999999999999,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":1.103},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.502,"15min":1.5149999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9670000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.264}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.345,"15min":1.367},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8089999999999999,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.006},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3260000000000001,"15min":1.337},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.1600000000000001},"last":1.145}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.377,"15min":1.4119999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.012,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.52,"15min":1.5329999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1669999999999998,"5min":2.597,"15min":2.7370000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.413,"15min":1.478},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.181,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.5329999999999999,"15min":1.556},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.2480000000000002,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6080000000000001,"15min":1.6739999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.5249999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.647,"15min":1.6879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3839999999999999,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":0.93700000000000006}]}]},{"osd":6,"up_from":15,"seq":64424510901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.41499999999999998},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.1419999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.47999999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0800000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.435},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":1.079,"5min":1.395,"15min":1.395},"last":0.56000000000000005}]},{"osd":2,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1080000000000001,"5min":1.232,"15min":1.5069999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48599999999999999},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":2.1840000000000002},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.321},"last":0.498},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"max":{"1min":1.1759999999999999,"5min":1.2969999999999999,"15min":1.327},"last":0.75}]},{"osd":4,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.82699999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.61199999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.314}]},{"osd":5,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.76200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.36099999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.59199999999999997,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.30199999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.72099999999999997,"15min":0.85699999999999998},"last":0.39400000000000002}]}]},{"osd":5,"up_from":15,"seq":64424510901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114532,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257308,"statfs":{"total":96636764160,"available":96519483392,"internally_reserved":0,"allocated":52654080,"data_stored":52476546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.05,"5min":1.2,"15min":1.212},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.75},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42399999999999999},"max":{"1min":1.101,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":1.105,"5min":1.2549999999999999,"15min":1.554},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0489999999999999,"15min":1.419},"last":0.628}]},{"osd":2,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.264,"15min":1.3069999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2250000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.59099999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.79900000000000004},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.518},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.51200000000000001,"5min":0.503,"15min":0.45400000000000001},"max":{"1min":1.115,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.67500000000000004},"last":0.33600000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.443},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.38600000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.35899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424510901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.1850000000000001,"15min":1.349},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.355},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.78400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.1830000000000001,"15min":1.429},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.499,"15min":0.42799999999999999},"max":{"1min":1.087,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.432},"max":{"1min":1.0680000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.76700000000000002},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.1719999999999999,"5min":1.24,"15min":1.349},"last":0.876}]},{"osd":3,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.121,"5min":1.2869999999999999,"15min":1.361},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0249999999999999,"5min":1.893,"15min":1.893},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.61699999999999999,"15min":0.68400000000000005},"last":0.378},{"interface":"front","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.625,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.59299999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.67700000000000005,"15min":0.77700000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.81499999999999995},"last":0.47799999999999998}]}]},{"osd":7,"up_from":14,"seq":60129543604,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.876},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86399999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.245},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.309}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35299999999999998}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.34399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51297463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:28:30.074 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.074 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.075 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.075 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.075 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.075 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.076 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.076 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.076 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.077 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.077 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.077 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.077 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.078 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.078 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.078 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.079 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.079 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.079 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.079 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.080 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.080 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.080 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.081 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.081 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.081 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.081 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.082 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.082 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.082 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.083 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.083 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.083 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.083 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.084 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.084 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.084 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.085 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.085 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.085 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.085 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.086 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.086 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.086 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.087 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.087 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.087 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.087 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.088 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.088 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.088 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.089 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.089 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.089 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.089 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.090 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.090 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.090 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.090 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.091 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.091 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.091 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.092 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.092 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.092 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-21T16:27:09.379566+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=9, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.092 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.093 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.093 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.093 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.094 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.094 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.094 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.094 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.095 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.095 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.095 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.096 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.096 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.096 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.096 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.097 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.097 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.097 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.098 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.098 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.098 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.098 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.099 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.099 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.099 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.100 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.100 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.100 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.100 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.101 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.101 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.101 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:30.102 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-21T18:28:50.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:28:50.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.344+0000 7fcafd71d640 1 Processor -- start 2023-10-21T18:28:50.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.344+0000 7fcafd71d640 1 -- start start 2023-10-21T18:28:50.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaf81500d0 0x7fcaf806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcaf8071510 0x7fcaf80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8156530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf815a450 con 0x7fcaf8071510 2023-10-21T18:28:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf8156050 con 0x7fcaf81500d0 2023-10-21T18:28:50.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.346+0000 7fcafd71d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8159eb0 con 0x7fcaf80c1f40 2023-10-21T18:28:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.347+0000 7fcaf6ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaf81500d0 0x7fcaf806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.347+0000 7fcaf77fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.347+0000 7fcaf6ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaf81500d0 0x7fcaf806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:35256/0 (socket says 172.21.15.12:35256) 2023-10-21T18:28:50.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.347+0000 7fcaf6ffd640 1 -- 172.21.15.12:0/1892507309 learned_addr learned my addr 172.21.15.12:0/1892507309 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:50.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.349+0000 7fcaf6ffd640 1 -- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 msgr2=0x7fcaf8156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:50.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.349+0000 7fcaf6ffd640 1 --2- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.349+0000 7fcaf6ffd640 1 -- 172.21.15.12:0/1892507309 >> v2:172.21.15.12:3300/0 conn(0x7fcaf8071510 msgr2=0x7fcaf80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:28:50.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.349+0000 7fcaf6ffd640 1 --2- 172.21.15.12:0/1892507309 >> v2:172.21.15.12:3300/0 conn(0x7fcaf8071510 0x7fcaf80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.349+0000 7fcaf6ffd640 1 -- 172.21.15.12:0/1892507309 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80721c0 con 0x7fcaf81500d0 2023-10-21T18:28:50.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.351+0000 7fcaf6ffd640 1 --2- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf806fd70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaf806aea0 tx=0x7fcae802b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b577ce91c3593389 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:50.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.355+0000 7fcaf67fc640 1 -- 172.21.15.12:0/1892507309 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8030850 con 0x7fcaf81500d0 2023-10-21T18:28:50.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.355+0000 7fcaf67fc640 1 -- 172.21.15.12:0/1892507309 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae80309b0 con 0x7fcaf81500d0 2023-10-21T18:28:50.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.355+0000 7fcaf67fc640 1 -- 172.21.15.12:0/1892507309 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8030d40 con 0x7fcaf81500d0 2023-10-21T18:28:50.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 -- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 msgr2=0x7fcaf806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:50.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 --2- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf806fd70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaf806aea0 tx=0x7fcae802b990 comp rx=0 tx=0).stop 2023-10-21T18:28:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 -- 172.21.15.12:0/1892507309 shutdown_connections 2023-10-21T18:28:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 --2- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 --2- 172.21.15.12:0/1892507309 >> v2:172.21.15.12:3300/0 conn(0x7fcaf8071510 0x7fcaf80c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 --2- 172.21.15.12:0/1892507309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf806fd70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 -- 172.21.15.12:0/1892507309 >> 172.21.15.12:0/1892507309 conn(0x7fcaf8069de0 msgr2=0x7fcaf806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 -- 172.21.15.12:0/1892507309 shutdown_connections 2023-10-21T18:28:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.356+0000 7fcafd71d640 1 -- 172.21.15.12:0/1892507309 wait complete. 2023-10-21T18:28:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.358+0000 7fcafd71d640 1 Processor -- start 2023-10-21T18:28:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.358+0000 7fcafd71d640 1 -- start start 2023-10-21T18:28:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf8071510 0x7fcaf81ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf81ef8d0 con 0x7fcaf8071510 2023-10-21T18:28:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8149e70 con 0x7fcaf81500d0 2023-10-21T18:28:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.359+0000 7fcafd71d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf814aa00 con 0x7fcaf80c1f40 2023-10-21T18:28:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.360+0000 7fcaf77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.360+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.360+0000 7fcaf77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:35266/0 (socket says 172.21.15.12:35266) 2023-10-21T18:28:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.360+0000 7fcaf77fe640 1 -- 172.21.15.12:0/944395392 learned_addr learned my addr 172.21.15.12:0/944395392 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:28:50.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.363+0000 7fcaf77fe640 1 -- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 msgr2=0x7fcaf8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.363+0000 7fcaf77fe640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.364+0000 7fcaf77fe640 1 -- 172.21.15.12:0/944395392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf8071510 msgr2=0x7fcaf81ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.364+0000 7fcaf77fe640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf8071510 0x7fcaf81ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.364+0000 7fcaf77fe640 1 -- 172.21.15.12:0/944395392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80094d0 con 0x7fcaf81500d0 2023-10-21T18:28:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.366+0000 7fcaf77fe640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.369+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0009b10 con 0x7fcaf81500d0 2023-10-21T18:28:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.369+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf000f040 con 0x7fcaf81500d0 2023-10-21T18:28:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.369+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00146c0 con 0x7fcaf81500d0 2023-10-21T18:28:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.370+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf814acc0 con 0x7fcaf81500d0 2023-10-21T18:28:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.370+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf81585b0 con 0x7fcaf81500d0 2023-10-21T18:28:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.371+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf80619f0 con 0x7fcaf81500d0 2023-10-21T18:28:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.674+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcaf0014820 con 0x7fcaf81500d0 2023-10-21T18:28:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.677+0000 7fcaef7fe640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 0x7fcad806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:28:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.677+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcaf008a8a0 con 0x7fcaf81500d0 2023-10-21T18:28:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.678+0000 7fcaf6ffd640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 0x7fcad806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:28:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.679+0000 7fcaf6ffd640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 0x7fcad806d3b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcae8036000 tx=0x7fcae803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:28:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.685+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaf00558f0 con 0x7fcaf81500d0 2023-10-21T18:28:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.890+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcaf8071c00 con 0x7fcad806aef0 2023-10-21T18:28:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.899+0000 7fcaef7fe640 1 -- 172.21.15.12:0/944395392 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288806 (secure 0 0 0) 0x7fcae8030b20 con 0x7fcad806aef0 2023-10-21T18:28:50.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:28:50.907 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:28:50.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 msgr2=0x7fcad806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:50.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 0x7fcad806d3b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcae8036000 tx=0x7fcae803b040 comp rx=0 tx=0).stop 2023-10-21T18:28:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 msgr2=0x7fcaf80c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:28:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c490 comp rx=0 tx=0).stop 2023-10-21T18:28:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 shutdown_connections 2023-10-21T18:28:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fcad806aef0 0x7fcad806d3b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaf81500d0 0x7fcaf80c8ea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcaf80c1f40 0x7fcaf8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 --2- 172.21.15.12:0/944395392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf8071510 0x7fcaf81ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:28:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.905+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 >> 172.21.15.12:0/944395392 conn(0x7fcaf8069de0 msgr2=0x7fcaf806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:28:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.906+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 shutdown_connections 2023-10-21T18:28:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:28:50.906+0000 7fcafd71d640 1 -- 172.21.15.12:0/944395392 wait complete. 2023-10-21T18:28:50.928 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3672,"stamp":"2023-10-21T18:28:49.142152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216929668,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48793,"num_write_kb":4575230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50343,"ondisk_log_size":50343,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":945872,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754028848,"statfs":{"total":773094113280,"available":772125540352,"internally_reserved":0,"allocated":435961856,"data_stored":434594192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":532532794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003357"},"pg_stats":[{"pgid":"3.3f","version":"25'409","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.421041+0000","last_change":"2023-10-21T16:27:31.934268+0000","last_active":"2023-10-21T18:28:21.421041+0000","last_peered":"2023-10-21T18:28:21.421041+0000","last_clean":"2023-10-21T18:28:21.421041+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:28:21.421041+0000","last_undegraded":"2023-10-21T18:28:21.421041+0000","last_fullsized":"2023-10-21T18:28:21.421041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'423","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464865+0000","last_change":"2023-10-21T16:27:31.889313+0000","last_active":"2023-10-21T18:28:22.464865+0000","last_peered":"2023-10-21T18:28:22.464865+0000","last_clean":"2023-10-21T18:28:22.464865+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:28:22.464865+0000","last_undegraded":"2023-10-21T18:28:22.464865+0000","last_fullsized":"2023-10-21T18:28:22.464865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'376","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.660584+0000","last_change":"2023-10-21T18:28:46.660627+0000","last_active":"2023-10-21T18:28:46.660584+0000","last_peered":"2023-10-21T18:28:46.660584+0000","last_clean":"2023-10-21T18:28:46.660584+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:28:46.660584+0000","last_undegraded":"2023-10-21T18:28:46.660584+0000","last_fullsized":"2023-10-21T18:28:46.660584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'376","last_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_deep_scrub":"25'376","last_deep_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.660492+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:04:09.387985+0000","scrub_duration":0.0021392680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'405","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:31.943133+0000","last_change":"2023-10-21T18:28:31.943357+0000","last_active":"2023-10-21T18:28:31.943133+0000","last_peered":"2023-10-21T18:28:31.943133+0000","last_clean":"2023-10-21T18:28:31.943133+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:28:31.943133+0000","last_undegraded":"2023-10-21T18:28:31.943133+0000","last_fullsized":"2023-10-21T18:28:31.943133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_clean_scrub_stamp":"2023-10-21T18:28:31.942864+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:39.601766+0000","scrub_duration":0.0053496380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":508,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.780410+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:28:15.780410+0000","last_peered":"2023-10-21T18:28:15.780410+0000","last_clean":"2023-10-21T18:28:15.780410+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:28:15.780410+0000","last_undegraded":"2023-10-21T18:28:15.780410+0000","last_fullsized":"2023-10-21T18:28:15.780410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'388","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.874884+0000","last_change":"2023-10-21T18:28:29.874962+0000","last_active":"2023-10-21T18:28:29.874884+0000","last_peered":"2023-10-21T18:28:29.874884+0000","last_clean":"2023-10-21T18:28:29.874884+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:28:29.874884+0000","last_undegraded":"2023-10-21T18:28:29.874884+0000","last_fullsized":"2023-10-21T18:28:29.874884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'388","last_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_deep_scrub":"25'388","last_deep_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.874757+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:03:33.858731+0000","scrub_duration":0.0039421550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'407","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826595+0000","last_change":"2023-10-21T18:28:43.826713+0000","last_active":"2023-10-21T18:28:43.826595+0000","last_peered":"2023-10-21T18:28:43.826595+0000","last_clean":"2023-10-21T18:28:43.826595+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:28:43.826595+0000","last_undegraded":"2023-10-21T18:28:43.826595+0000","last_fullsized":"2023-10-21T18:28:43.826595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'407","last_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_deep_scrub":"25'407","last_deep_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826446+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:06:26.675534+0000","scrub_duration":0.0042928150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'384","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.877192+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:28:15.877192+0000","last_peered":"2023-10-21T18:28:15.877192+0000","last_clean":"2023-10-21T18:28:15.877192+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:28:15.877192+0000","last_undegraded":"2023-10-21T18:28:15.877192+0000","last_fullsized":"2023-10-21T18:28:15.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'428","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.509165+0000","last_change":"2023-10-21T16:27:31.915748+0000","last_active":"2023-10-21T18:28:22.509165+0000","last_peered":"2023-10-21T18:28:22.509165+0000","last_clean":"2023-10-21T18:28:22.509165+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:28:22.509165+0000","last_undegraded":"2023-10-21T18:28:22.509165+0000","last_fullsized":"2023-10-21T18:28:22.509165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420961+0000","last_change":"2023-10-21T16:27:31.930424+0000","last_active":"2023-10-21T18:28:21.420961+0000","last_peered":"2023-10-21T18:28:21.420961+0000","last_clean":"2023-10-21T18:28:21.420961+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:28:21.420961+0000","last_undegraded":"2023-10-21T18:28:21.420961+0000","last_fullsized":"2023-10-21T18:28:21.420961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'366","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420937+0000","last_change":"2023-10-21T16:27:31.932891+0000","last_active":"2023-10-21T18:28:21.420937+0000","last_peered":"2023-10-21T18:28:21.420937+0000","last_clean":"2023-10-21T18:28:21.420937+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:28:21.420937+0000","last_undegraded":"2023-10-21T18:28:21.420937+0000","last_fullsized":"2023-10-21T18:28:21.420937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'373","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420834+0000","last_change":"2023-10-21T16:27:31.933507+0000","last_active":"2023-10-21T18:28:21.420834+0000","last_peered":"2023-10-21T18:28:21.420834+0000","last_clean":"2023-10-21T18:28:21.420834+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:28:21.420834+0000","last_undegraded":"2023-10-21T18:28:21.420834+0000","last_fullsized":"2023-10-21T18:28:21.420834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'411","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826664+0000","last_change":"2023-10-21T18:28:43.826723+0000","last_active":"2023-10-21T18:28:43.826664+0000","last_peered":"2023-10-21T18:28:43.826664+0000","last_clean":"2023-10-21T18:28:43.826664+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:28:43.826664+0000","last_undegraded":"2023-10-21T18:28:43.826664+0000","last_fullsized":"2023-10-21T18:28:43.826664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826560+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:06.412002+0000","scrub_duration":0.0035619480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'409","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.857080+0000","last_change":"2023-10-21T16:27:31.896436+0000","last_active":"2023-10-21T18:28:15.857080+0000","last_peered":"2023-10-21T18:28:15.857080+0000","last_clean":"2023-10-21T18:28:15.857080+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:28:15.857080+0000","last_undegraded":"2023-10-21T18:28:15.857080+0000","last_fullsized":"2023-10-21T18:28:15.857080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'429","reported_seq":521,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.699349+0000","last_change":"2023-10-21T18:28:36.699387+0000","last_active":"2023-10-21T18:28:36.699349+0000","last_peered":"2023-10-21T18:28:36.699349+0000","last_clean":"2023-10-21T18:28:36.699349+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:28:36.699349+0000","last_undegraded":"2023-10-21T18:28:36.699349+0000","last_fullsized":"2023-10-21T18:28:36.699349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.699278+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:43.407211+0000","scrub_duration":0.0042182460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'427","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.578795+0000","last_change":"2023-10-21T18:28:35.578932+0000","last_active":"2023-10-21T18:28:35.578795+0000","last_peered":"2023-10-21T18:28:35.578795+0000","last_clean":"2023-10-21T18:28:35.578795+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:28:35.578795+0000","last_undegraded":"2023-10-21T18:28:35.578795+0000","last_fullsized":"2023-10-21T18:28:35.578795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.578584+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:31.224721+0000","scrub_duration":0.0053980649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'462","reported_seq":565,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.957860+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:28:15.957860+0000","last_peered":"2023-10-21T18:28:15.957860+0000","last_clean":"2023-10-21T18:28:15.957860+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:28:15.957860+0000","last_undegraded":"2023-10-21T18:28:15.957860+0000","last_fullsized":"2023-10-21T18:28:15.957860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.799378+0000","last_change":"2023-10-21T16:27:31.907912+0000","last_active":"2023-10-21T18:28:15.799378+0000","last_peered":"2023-10-21T18:28:15.799378+0000","last_clean":"2023-10-21T18:28:15.799378+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:15.799378+0000","last_undegraded":"2023-10-21T18:28:15.799378+0000","last_fullsized":"2023-10-21T18:28:15.799378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'404","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958557+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:28:15.958557+0000","last_peered":"2023-10-21T18:28:15.958557+0000","last_clean":"2023-10-21T18:28:15.958557+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:28:15.958557+0000","last_undegraded":"2023-10-21T18:28:15.958557+0000","last_fullsized":"2023-10-21T18:28:15.958557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.811291+0000","last_change":"2023-10-21T16:27:31.934260+0000","last_active":"2023-10-21T18:28:15.811291+0000","last_peered":"2023-10-21T18:28:15.811291+0000","last_clean":"2023-10-21T18:28:15.811291+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:28:15.811291+0000","last_undegraded":"2023-10-21T18:28:15.811291+0000","last_fullsized":"2023-10-21T18:28:15.811291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'400","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.966325+0000","last_change":"2023-10-21T18:28:42.966366+0000","last_active":"2023-10-21T18:28:42.966325+0000","last_peered":"2023-10-21T18:28:42.966325+0000","last_clean":"2023-10-21T18:28:42.966325+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:28:42.966325+0000","last_undegraded":"2023-10-21T18:28:42.966325+0000","last_fullsized":"2023-10-21T18:28:42.966325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'400","last_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_deep_scrub":"25'400","last_deep_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.966240+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:19.952458+0000","scrub_duration":0.0031400999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'449","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.941334+0000","last_change":"2023-10-21T18:28:36.941449+0000","last_active":"2023-10-21T18:28:36.941334+0000","last_peered":"2023-10-21T18:28:36.941334+0000","last_clean":"2023-10-21T18:28:36.941334+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:28:36.941334+0000","last_undegraded":"2023-10-21T18:28:36.941334+0000","last_fullsized":"2023-10-21T18:28:36.941334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.941104+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:44.600005+0000","scrub_duration":0.006421108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'395","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.873128+0000","last_change":"2023-10-21T16:27:31.719388+0000","last_active":"2023-10-21T18:28:15.873128+0000","last_peered":"2023-10-21T18:28:15.873128+0000","last_clean":"2023-10-21T18:28:15.873128+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:28:15.873128+0000","last_undegraded":"2023-10-21T18:28:15.873128+0000","last_fullsized":"2023-10-21T18:28:15.873128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'412","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.584281+0000","last_change":"2023-10-21T18:28:36.584402+0000","last_active":"2023-10-21T18:28:36.584281+0000","last_peered":"2023-10-21T18:28:36.584281+0000","last_clean":"2023-10-21T18:28:36.584281+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:36.584281+0000","last_undegraded":"2023-10-21T18:28:36.584281+0000","last_fullsized":"2023-10-21T18:28:36.584281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.584058+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:42:57.833730+0000","scrub_duration":0.0042012220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'408","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.873033+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:28:15.873033+0000","last_peered":"2023-10-21T18:28:15.873033+0000","last_clean":"2023-10-21T18:28:15.873033+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:28:15.873033+0000","last_undegraded":"2023-10-21T18:28:15.873033+0000","last_fullsized":"2023-10-21T18:28:15.873033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'487","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.773756+0000","last_change":"2023-10-21T16:27:31.913864+0000","last_active":"2023-10-21T18:28:15.773756+0000","last_peered":"2023-10-21T18:28:15.773756+0000","last_clean":"2023-10-21T18:28:15.773756+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:28:15.773756+0000","last_undegraded":"2023-10-21T18:28:15.773756+0000","last_fullsized":"2023-10-21T18:28:15.773756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'417","reported_seq":494,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.855226+0000","last_change":"2023-10-21T16:27:31.896958+0000","last_active":"2023-10-21T18:28:15.855226+0000","last_peered":"2023-10-21T18:28:15.855226+0000","last_clean":"2023-10-21T18:28:15.855226+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:28:15.855226+0000","last_undegraded":"2023-10-21T18:28:15.855226+0000","last_fullsized":"2023-10-21T18:28:15.855226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'406","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.857762+0000","last_change":"2023-10-21T16:27:31.928127+0000","last_active":"2023-10-21T18:28:15.857762+0000","last_peered":"2023-10-21T18:28:15.857762+0000","last_clean":"2023-10-21T18:28:15.857762+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:28:15.857762+0000","last_undegraded":"2023-10-21T18:28:15.857762+0000","last_fullsized":"2023-10-21T18:28:15.857762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'398","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.871628+0000","last_change":"2023-10-21T16:27:31.896571+0000","last_active":"2023-10-21T18:28:15.871628+0000","last_peered":"2023-10-21T18:28:15.871628+0000","last_clean":"2023-10-21T18:28:15.871628+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:28:15.871628+0000","last_undegraded":"2023-10-21T18:28:15.871628+0000","last_fullsized":"2023-10-21T18:28:15.871628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'469","reported_seq":564,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.465244+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:28:24.465244+0000","last_peered":"2023-10-21T18:28:24.465244+0000","last_clean":"2023-10-21T18:28:24.465244+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:28:24.465244+0000","last_undegraded":"2023-10-21T18:28:24.465244+0000","last_fullsized":"2023-10-21T18:28:24.465244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.523209+0000","last_change":"2023-10-21T18:28:42.523252+0000","last_active":"2023-10-21T18:28:42.523209+0000","last_peered":"2023-10-21T18:28:42.523209+0000","last_clean":"2023-10-21T18:28:42.523209+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:42.523209+0000","last_undegraded":"2023-10-21T18:28:42.523209+0000","last_fullsized":"2023-10-21T18:28:42.523209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'457","last_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_deep_scrub":"25'457","last_deep_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.523122+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:34.806713+0000","scrub_duration":0.003821732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'423","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.898803+0000","last_change":"2023-10-21T18:28:30.898913+0000","last_active":"2023-10-21T18:28:30.898803+0000","last_peered":"2023-10-21T18:28:30.898803+0000","last_clean":"2023-10-21T18:28:30.898803+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:28:30.898803+0000","last_undegraded":"2023-10-21T18:28:30.898803+0000","last_fullsized":"2023-10-21T18:28:30.898803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.898643+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:43:54.121212+0000","scrub_duration":0.004221242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'417","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.983813+0000","last_change":"2023-10-21T18:28:30.983860+0000","last_active":"2023-10-21T18:28:30.983813+0000","last_peered":"2023-10-21T18:28:30.983813+0000","last_clean":"2023-10-21T18:28:30.983813+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:28:30.983813+0000","last_undegraded":"2023-10-21T18:28:30.983813+0000","last_fullsized":"2023-10-21T18:28:30.983813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.983725+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:00:54.743691+0000","scrub_duration":0.0040209740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'223","reported_seq":294,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.693077+0000","last_change":"2023-10-21T18:28:35.693118+0000","last_active":"2023-10-21T18:28:35.693077+0000","last_peered":"2023-10-21T18:28:35.693077+0000","last_clean":"2023-10-21T18:28:35.693077+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:28:35.693077+0000","last_undegraded":"2023-10-21T18:28:35.693077+0000","last_fullsized":"2023-10-21T18:28:35.693077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'223","last_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_deep_scrub":"25'223","last_deep_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.693006+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:26.846010+0000","scrub_duration":0.011849706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'378","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.802878+0000","last_change":"2023-10-21T16:27:31.925766+0000","last_active":"2023-10-21T18:28:15.802878+0000","last_peered":"2023-10-21T18:28:15.802878+0000","last_clean":"2023-10-21T18:28:15.802878+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:28:15.802878+0000","last_undegraded":"2023-10-21T18:28:15.802878+0000","last_fullsized":"2023-10-21T18:28:15.802878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1317","reported_seq":1380,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:30.877678+0000","last_change":"2023-10-21T16:27:30.344287+0000","last_active":"2023-10-21T18:27:30.877678+0000","last_peered":"2023-10-21T18:27:30.877678+0000","last_clean":"2023-10-21T18:27:30.877678+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:27:30.877678+0000","last_undegraded":"2023-10-21T18:27:30.877678+0000","last_fullsized":"2023-10-21T18:27:30.877678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'776","reported_seq":848,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.858748+0000","last_change":"2023-10-21T18:28:36.858788+0000","last_active":"2023-10-21T18:28:36.858748+0000","last_peered":"2023-10-21T18:28:36.858748+0000","last_clean":"2023-10-21T18:28:36.858748+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:28:36.858748+0000","last_undegraded":"2023-10-21T18:28:36.858748+0000","last_fullsized":"2023-10-21T18:28:36.858748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'776","last_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_deep_scrub":"25'776","last_deep_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.858682+0000","objects_scrubbed":1,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:38.533026+0000","scrub_duration":0.035982591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'464","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464799+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:22.464799+0000","last_peered":"2023-10-21T18:28:22.464799+0000","last_clean":"2023-10-21T18:28:22.464799+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:22.464799+0000","last_undegraded":"2023-10-21T18:28:22.464799+0000","last_fullsized":"2023-10-21T18:28:22.464799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'904","reported_seq":969,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:19.463957+0000","last_change":"2023-10-21T16:27:30.341743+0000","last_active":"2023-10-21T18:28:19.463957+0000","last_peered":"2023-10-21T18:28:19.463957+0000","last_clean":"2023-10-21T18:28:19.463957+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:28:19.463957+0000","last_undegraded":"2023-10-21T18:28:19.463957+0000","last_fullsized":"2023-10-21T18:28:19.463957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'415","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.808653+0000","last_change":"2023-10-21T16:27:31.915710+0000","last_active":"2023-10-21T18:28:15.808653+0000","last_peered":"2023-10-21T18:28:15.808653+0000","last_clean":"2023-10-21T18:28:15.808653+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:28:15.808653+0000","last_undegraded":"2023-10-21T18:28:15.808653+0000","last_fullsized":"2023-10-21T18:28:15.808653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.944245+0000","last_change":"2023-10-21T18:28:28.944434+0000","last_active":"2023-10-21T18:28:28.944245+0000","last_peered":"2023-10-21T18:28:28.944245+0000","last_clean":"2023-10-21T18:28:28.944245+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:28:28.944245+0000","last_undegraded":"2023-10-21T18:28:28.944245+0000","last_fullsized":"2023-10-21T18:28:28.944245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.944008+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:47:21.203623+0000","scrub_duration":0.0041208629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'419","reported_seq":494,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:23.594309+0000","last_change":"2023-10-21T16:27:31.913512+0000","last_active":"2023-10-21T18:28:23.594309+0000","last_peered":"2023-10-21T18:28:23.594309+0000","last_clean":"2023-10-21T18:28:23.594309+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:28:23.594309+0000","last_undegraded":"2023-10-21T18:28:23.594309+0000","last_fullsized":"2023-10-21T18:28:23.594309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1390","reported_seq":1463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.894216+0000","last_change":"2023-10-21T18:28:36.894345+0000","last_active":"2023-10-21T18:28:36.894216+0000","last_peered":"2023-10-21T18:28:36.894216+0000","last_clean":"2023-10-21T18:28:36.894216+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:36.894216+0000","last_undegraded":"2023-10-21T18:28:36.894216+0000","last_fullsized":"2023-10-21T18:28:36.894216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1390","last_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_deep_scrub":"25'1390","last_deep_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.894015+0000","objects_scrubbed":4,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:10.544242+0000","scrub_duration":0.093137905000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13548657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1323,"num_write_kb":13905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'410","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464902+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:28:22.464902+0000","last_peered":"2023-10-21T18:28:22.464902+0000","last_clean":"2023-10-21T18:28:22.464902+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:28:22.464902+0000","last_undegraded":"2023-10-21T18:28:22.464902+0000","last_fullsized":"2023-10-21T18:28:22.464902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1996","reported_seq":2069,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.442457+0000","last_change":"2023-10-21T18:28:29.442502+0000","last_active":"2023-10-21T18:28:29.442457+0000","last_peered":"2023-10-21T18:28:29.442457+0000","last_clean":"2023-10-21T18:28:29.442457+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:29.442457+0000","last_undegraded":"2023-10-21T18:28:29.442457+0000","last_fullsized":"2023-10-21T18:28:29.442457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1996","last_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_deep_scrub":"25'1996","last_deep_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.442390+0000","objects_scrubbed":4,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:49.487666+0000","scrub_duration":0.022358660999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960471+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:28:15.960471+0000","last_peered":"2023-10-21T18:28:15.960471+0000","last_clean":"2023-10-21T18:28:15.960471+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:28:15.960471+0000","last_undegraded":"2023-10-21T18:28:15.960471+0000","last_fullsized":"2023-10-21T18:28:15.960471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1724","reported_seq":1798,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:25.859206+0000","last_change":"2023-10-21T18:28:25.859284+0000","last_active":"2023-10-21T18:28:25.859206+0000","last_peered":"2023-10-21T18:28:25.859206+0000","last_clean":"2023-10-21T18:28:25.859206+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:28:25.859206+0000","last_undegraded":"2023-10-21T18:28:25.859206+0000","last_fullsized":"2023-10-21T18:28:25.859206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1724","last_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_deep_scrub":"25'1724","last_deep_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:25.859118+0000","objects_scrubbed":6,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:33.368476+0000","scrub_duration":0.057169405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'402","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420810+0000","last_change":"2023-10-21T16:27:31.930267+0000","last_active":"2023-10-21T18:28:21.420810+0000","last_peered":"2023-10-21T18:28:21.420810+0000","last_clean":"2023-10-21T18:28:21.420810+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:28:21.420810+0000","last_undegraded":"2023-10-21T18:28:21.420810+0000","last_fullsized":"2023-10-21T18:28:21.420810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'326","reported_seq":400,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.607279+0000","last_change":"2023-10-21T18:28:37.607328+0000","last_active":"2023-10-21T18:28:37.607279+0000","last_peered":"2023-10-21T18:28:37.607279+0000","last_clean":"2023-10-21T18:28:37.607279+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:28:37.607279+0000","last_undegraded":"2023-10-21T18:28:37.607279+0000","last_fullsized":"2023-10-21T18:28:37.607279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'326","last_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_deep_scrub":"25'326","last_deep_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.607192+0000","objects_scrubbed":4,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:24:31.987420+0000","scrub_duration":0.043194149000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'385","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.850165+0000","last_change":"2023-10-21T18:28:39.850205+0000","last_active":"2023-10-21T18:28:39.850165+0000","last_peered":"2023-10-21T18:28:39.850165+0000","last_clean":"2023-10-21T18:28:39.850165+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:28:39.850165+0000","last_undegraded":"2023-10-21T18:28:39.850165+0000","last_fullsized":"2023-10-21T18:28:39.850165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'385","last_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_deep_scrub":"25'385","last_deep_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.850078+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:10.961936+0000","scrub_duration":0.0039236139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:10.569134+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:10.569134+0000","last_peered":"2023-10-21T18:28:10.569134+0000","last_clean":"2023-10-21T18:28:10.569134+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:10.569134+0000","last_undegraded":"2023-10-21T18:28:10.569134+0000","last_fullsized":"2023-10-21T18:28:10.569134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'428","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958676+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:15.958676+0000","last_peered":"2023-10-21T18:28:15.958676+0000","last_clean":"2023-10-21T18:28:15.958676+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:15.958676+0000","last_undegraded":"2023-10-21T18:28:15.958676+0000","last_fullsized":"2023-10-21T18:28:15.958676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:41.865995+0000","last_change":"2023-10-21T18:28:41.866112+0000","last_active":"2023-10-21T18:28:41.865995+0000","last_peered":"2023-10-21T18:28:41.865995+0000","last_clean":"2023-10-21T18:28:41.865995+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:28:41.865995+0000","last_undegraded":"2023-10-21T18:28:41.865995+0000","last_fullsized":"2023-10-21T18:28:41.865995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'45","last_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_deep_scrub":"25'45","last_deep_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_clean_scrub_stamp":"2023-10-21T18:28:41.865799+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:22.835970+0000","scrub_duration":0.0037365559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'429","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.000998+0000","last_change":"2023-10-21T18:28:44.001247+0000","last_active":"2023-10-21T18:28:44.000998+0000","last_peered":"2023-10-21T18:28:44.000998+0000","last_clean":"2023-10-21T18:28:44.000998+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:28:44.000998+0000","last_undegraded":"2023-10-21T18:28:44.000998+0000","last_fullsized":"2023-10-21T18:28:44.000998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.000789+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:21.675243+0000","scrub_duration":0.0042857920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'819","reported_seq":893,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.887960+0000","last_change":"2023-10-21T18:28:28.888008+0000","last_active":"2023-10-21T18:28:28.887960+0000","last_peered":"2023-10-21T18:28:28.887960+0000","last_clean":"2023-10-21T18:28:28.887960+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:28:28.887960+0000","last_undegraded":"2023-10-21T18:28:28.887960+0000","last_fullsized":"2023-10-21T18:28:28.887960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'819","last_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_deep_scrub":"25'819","last_deep_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.887893+0000","objects_scrubbed":6,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:30.562236+0000","scrub_duration":0.023693352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'488","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.598768+0000","last_change":"2023-10-21T18:28:34.598988+0000","last_active":"2023-10-21T18:28:34.598768+0000","last_peered":"2023-10-21T18:28:34.598768+0000","last_clean":"2023-10-21T18:28:34.598768+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:28:34.598768+0000","last_undegraded":"2023-10-21T18:28:34.598768+0000","last_fullsized":"2023-10-21T18:28:34.598768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'488","last_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_deep_scrub":"25'488","last_deep_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.598552+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:03:57.326046+0000","scrub_duration":0.005866652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'738","reported_seq":814,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:40.938993+0000","last_change":"2023-10-21T18:28:40.939120+0000","last_active":"2023-10-21T18:28:40.938993+0000","last_peered":"2023-10-21T18:28:40.938993+0000","last_clean":"2023-10-21T18:28:40.938993+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:28:40.938993+0000","last_undegraded":"2023-10-21T18:28:40.938993+0000","last_fullsized":"2023-10-21T18:28:40.938993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'738","last_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_deep_scrub":"25'738","last_deep_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:40.938810+0000","objects_scrubbed":2,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:39.906339+0000","scrub_duration":0.037421380999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'366","reported_seq":445,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.775068+0000","last_change":"2023-10-21T16:27:31.935423+0000","last_active":"2023-10-21T18:28:15.775068+0000","last_peered":"2023-10-21T18:28:15.775068+0000","last_clean":"2023-10-21T18:28:15.775068+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:28:15.775068+0000","last_undegraded":"2023-10-21T18:28:15.775068+0000","last_fullsized":"2023-10-21T18:28:15.775068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'782","reported_seq":858,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.969606+0000","last_change":"2023-10-21T18:28:36.969679+0000","last_active":"2023-10-21T18:28:36.969606+0000","last_peered":"2023-10-21T18:28:36.969606+0000","last_clean":"2023-10-21T18:28:36.969606+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:28:36.969606+0000","last_undegraded":"2023-10-21T18:28:36.969606+0000","last_fullsized":"2023-10-21T18:28:36.969606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'782","last_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_deep_scrub":"25'782","last_deep_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.969514+0000","objects_scrubbed":2,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:42.170333+0000","scrub_duration":0.012547963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'358","reported_seq":433,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.811549+0000","last_change":"2023-10-21T16:27:31.933121+0000","last_active":"2023-10-21T18:28:15.811549+0000","last_peered":"2023-10-21T18:28:15.811549+0000","last_clean":"2023-10-21T18:28:15.811549+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:28:15.811549+0000","last_undegraded":"2023-10-21T18:28:15.811549+0000","last_fullsized":"2023-10-21T18:28:15.811549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'245","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.794866+0000","last_change":"2023-10-21T18:28:28.794916+0000","last_active":"2023-10-21T18:28:28.794866+0000","last_peered":"2023-10-21T18:28:28.794866+0000","last_clean":"2023-10-21T18:28:28.794866+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:28:28.794866+0000","last_undegraded":"2023-10-21T18:28:28.794866+0000","last_fullsized":"2023-10-21T18:28:28.794866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'245","last_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_deep_scrub":"25'245","last_deep_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.794791+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.380233+0000","scrub_duration":0.016721482999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'442","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.794198+0000","last_change":"2023-10-21T16:27:57.700525+0000","last_active":"2023-10-21T18:28:15.794198+0000","last_peered":"2023-10-21T18:28:15.794198+0000","last_clean":"2023-10-21T18:28:15.794198+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:28:15.794198+0000","last_undegraded":"2023-10-21T18:28:15.794198+0000","last_fullsized":"2023-10-21T18:28:15.794198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'367","reported_seq":443,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.863341+0000","last_change":"2023-10-21T18:28:38.863423+0000","last_active":"2023-10-21T18:28:38.863341+0000","last_peered":"2023-10-21T18:28:38.863341+0000","last_clean":"2023-10-21T18:28:38.863341+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:28:38.863341+0000","last_undegraded":"2023-10-21T18:28:38.863341+0000","last_fullsized":"2023-10-21T18:28:38.863341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'367","last_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_deep_scrub":"25'367","last_deep_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.863261+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:58:19.348721+0000","scrub_duration":0.025519416999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'400","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958680+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:28:15.958680+0000","last_peered":"2023-10-21T18:28:15.958680+0000","last_clean":"2023-10-21T18:28:15.958680+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:28:15.958680+0000","last_undegraded":"2023-10-21T18:28:15.958680+0000","last_fullsized":"2023-10-21T18:28:15.958680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":238,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.997704+0000","last_change":"2023-10-21T18:28:27.997829+0000","last_active":"2023-10-21T18:28:27.997704+0000","last_peered":"2023-10-21T18:28:27.997704+0000","last_clean":"2023-10-21T18:28:27.997704+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:28:27.997704+0000","last_undegraded":"2023-10-21T18:28:27.997704+0000","last_fullsized":"2023-10-21T18:28:27.997704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.997532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:28:43.552482+0000","scrub_duration":0.009368375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'328","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:19.464143+0000","last_change":"2023-10-21T16:27:30.343515+0000","last_active":"2023-10-21T18:28:19.464143+0000","last_peered":"2023-10-21T18:28:19.464143+0000","last_clean":"2023-10-21T18:28:19.464143+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:28:19.464143+0000","last_undegraded":"2023-10-21T18:28:19.464143+0000","last_fullsized":"2023-10-21T18:28:19.464143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'406","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.462452+0000","last_change":"2023-10-21T16:27:31.875232+0000","last_active":"2023-10-21T18:28:22.462452+0000","last_peered":"2023-10-21T18:28:22.462452+0000","last_clean":"2023-10-21T18:28:22.462452+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:28:22.462452+0000","last_undegraded":"2023-10-21T18:28:22.462452+0000","last_fullsized":"2023-10-21T18:28:22.462452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'723","reported_seq":798,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:27:49.457165+0000","last_change":"2023-10-21T16:27:30.336769+0000","last_active":"2023-10-21T18:27:49.457165+0000","last_peered":"2023-10-21T18:27:49.457165+0000","last_clean":"2023-10-21T18:27:49.457165+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:27:49.457165+0000","last_undegraded":"2023-10-21T18:27:49.457165+0000","last_fullsized":"2023-10-21T18:27:49.457165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'417","reported_seq":517,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.398011+0000","last_change":"2023-10-21T16:27:31.892214+0000","last_active":"2023-10-21T18:28:22.398011+0000","last_peered":"2023-10-21T18:28:22.398011+0000","last_clean":"2023-10-21T18:28:22.398011+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:22.398011+0000","last_undegraded":"2023-10-21T18:28:22.398011+0000","last_fullsized":"2023-10-21T18:28:22.398011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3018,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.592629+0000","last_change":"2023-10-21T18:28:34.592678+0000","last_active":"2023-10-21T18:28:34.592629+0000","last_peered":"2023-10-21T18:28:34.592629+0000","last_clean":"2023-10-21T18:28:34.592629+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:34.592629+0000","last_undegraded":"2023-10-21T18:28:34.592629+0000","last_fullsized":"2023-10-21T18:28:34.592629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1496","last_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_deep_scrub":"25'1496","last_deep_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.592545+0000","objects_scrubbed":1,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:50:54.878023+0000","scrub_duration":0.0053032239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'381","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.665936+0000","last_change":"2023-10-21T18:28:37.665972+0000","last_active":"2023-10-21T18:28:37.665936+0000","last_peered":"2023-10-21T18:28:37.665936+0000","last_clean":"2023-10-21T18:28:37.665936+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:37.665936+0000","last_undegraded":"2023-10-21T18:28:37.665936+0000","last_fullsized":"2023-10-21T18:28:37.665936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.665867+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:14.652085+0000","scrub_duration":0.00173624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'392","reported_seq":465,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:19.464094+0000","last_change":"2023-10-21T16:27:30.342508+0000","last_active":"2023-10-21T18:28:19.464094+0000","last_peered":"2023-10-21T18:28:19.464094+0000","last_clean":"2023-10-21T18:28:19.464094+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:28:19.464094+0000","last_undegraded":"2023-10-21T18:28:19.464094+0000","last_fullsized":"2023-10-21T18:28:19.464094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'392","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:21.420711+0000","last_change":"2023-10-21T16:27:31.935313+0000","last_active":"2023-10-21T18:28:21.420711+0000","last_peered":"2023-10-21T18:28:21.420711+0000","last_clean":"2023-10-21T18:28:21.420711+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:28:21.420711+0000","last_undegraded":"2023-10-21T18:28:21.420711+0000","last_fullsized":"2023-10-21T18:28:21.420711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'412","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.803226+0000","last_change":"2023-10-21T18:28:27.803298+0000","last_active":"2023-10-21T18:28:27.803226+0000","last_peered":"2023-10-21T18:28:27.803226+0000","last_clean":"2023-10-21T18:28:27.803226+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:28:27.803226+0000","last_undegraded":"2023-10-21T18:28:27.803226+0000","last_fullsized":"2023-10-21T18:28:27.803226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.803157+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:26:58.915015+0000","scrub_duration":0.013419940999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'410","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.790738+0000","last_change":"2023-10-21T18:28:42.790738+0000","last_active":"2023-10-21T18:28:42.790738+0000","last_peered":"2023-10-21T18:28:42.790738+0000","last_clean":"2023-10-21T18:28:42.790738+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:28:42.790738+0000","last_undegraded":"2023-10-21T18:28:42.790738+0000","last_fullsized":"2023-10-21T18:28:42.790738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.790342+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:48:47.994060+0000","scrub_duration":0.0044279569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":661,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686327+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:28:24.686327+0000","last_peered":"2023-10-21T18:28:24.686327+0000","last_clean":"2023-10-21T18:28:24.686327+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:28:24.686327+0000","last_undegraded":"2023-10-21T18:28:24.686327+0000","last_fullsized":"2023-10-21T18:28:24.686327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'377","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.398078+0000","last_change":"2023-10-21T16:27:31.888973+0000","last_active":"2023-10-21T18:28:22.398078+0000","last_peered":"2023-10-21T18:28:22.398078+0000","last_clean":"2023-10-21T18:28:22.398078+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:28:22.398078+0000","last_undegraded":"2023-10-21T18:28:22.398078+0000","last_fullsized":"2023-10-21T18:28:22.398078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1346","reported_seq":1424,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.973350+0000","last_change":"2023-10-21T18:28:38.973398+0000","last_active":"2023-10-21T18:28:38.973350+0000","last_peered":"2023-10-21T18:28:38.973350+0000","last_clean":"2023-10-21T18:28:38.973350+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:38.973350+0000","last_undegraded":"2023-10-21T18:28:38.973350+0000","last_fullsized":"2023-10-21T18:28:38.973350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1346","last_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_deep_scrub":"25'1346","last_deep_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.973260+0000","objects_scrubbed":1,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:12.623488+0000","scrub_duration":0.016535959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3534,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'364","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.799711+0000","last_change":"2023-10-21T16:27:31.889588+0000","last_active":"2023-10-21T18:28:15.799711+0000","last_peered":"2023-10-21T18:28:15.799711+0000","last_clean":"2023-10-21T18:28:15.799711+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:28:15.799711+0000","last_undegraded":"2023-10-21T18:28:15.799711+0000","last_fullsized":"2023-10-21T18:28:15.799711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'320","reported_seq":390,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.198678+0000","last_change":"2023-10-21T16:27:30.346719+0000","last_active":"2023-10-21T18:28:15.198678+0000","last_peered":"2023-10-21T18:28:15.198678+0000","last_clean":"2023-10-21T18:28:15.198678+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:28:15.198678+0000","last_undegraded":"2023-10-21T18:28:15.198678+0000","last_fullsized":"2023-10-21T18:28:15.198678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'463","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.982433+0000","last_change":"2023-10-21T18:28:39.982468+0000","last_active":"2023-10-21T18:28:39.982433+0000","last_peered":"2023-10-21T18:28:39.982433+0000","last_clean":"2023-10-21T18:28:39.982433+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:28:39.982433+0000","last_undegraded":"2023-10-21T18:28:39.982433+0000","last_fullsized":"2023-10-21T18:28:39.982433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'463","last_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_deep_scrub":"25'463","last_deep_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.982361+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:46.690293+0000","scrub_duration":0.0022391640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'262","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.764406+0000","last_change":"2023-10-21T18:28:28.764488+0000","last_active":"2023-10-21T18:28:28.764406+0000","last_peered":"2023-10-21T18:28:28.764406+0000","last_clean":"2023-10-21T18:28:28.764406+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:28:28.764406+0000","last_undegraded":"2023-10-21T18:28:28.764406+0000","last_fullsized":"2023-10-21T18:28:28.764406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'262","last_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_deep_scrub":"25'262","last_deep_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.764322+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.349764+0000","scrub_duration":0.017180768999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'421","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.628533+0000","last_change":"2023-10-21T18:28:37.628656+0000","last_active":"2023-10-21T18:28:37.628533+0000","last_peered":"2023-10-21T18:28:37.628533+0000","last_clean":"2023-10-21T18:28:37.628533+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:37.628533+0000","last_undegraded":"2023-10-21T18:28:37.628533+0000","last_fullsized":"2023-10-21T18:28:37.628533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.628358+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:43:36.552484+0000","scrub_duration":0.0042654920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'421","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:33.920091+0000","last_change":"2023-10-21T18:28:33.920158+0000","last_active":"2023-10-21T18:28:33.920091+0000","last_peered":"2023-10-21T18:28:33.920091+0000","last_clean":"2023-10-21T18:28:33.920091+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:28:33.920091+0000","last_undegraded":"2023-10-21T18:28:33.920091+0000","last_fullsized":"2023-10-21T18:28:33.920091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_clean_scrub_stamp":"2023-10-21T18:28:33.919990+0000","objects_scrubbed":1,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:02:20.582216+0000","scrub_duration":0.031339309000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'402","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.008007+0000","last_change":"2023-10-21T18:28:46.008047+0000","last_active":"2023-10-21T18:28:46.008007+0000","last_peered":"2023-10-21T18:28:46.008007+0000","last_clean":"2023-10-21T18:28:46.008007+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:46.008007+0000","last_undegraded":"2023-10-21T18:28:46.008007+0000","last_fullsized":"2023-10-21T18:28:46.008007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.007918+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:26.978090+0000","scrub_duration":0.0024174869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1150","reported_seq":1228,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.872881+0000","last_change":"2023-10-21T18:28:35.872930+0000","last_active":"2023-10-21T18:28:35.872881+0000","last_peered":"2023-10-21T18:28:35.872881+0000","last_clean":"2023-10-21T18:28:35.872881+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:28:35.872881+0000","last_undegraded":"2023-10-21T18:28:35.872881+0000","last_fullsized":"2023-10-21T18:28:35.872881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1150","last_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_deep_scrub":"25'1150","last_deep_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.872800+0000","objects_scrubbed":2,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:13.547254+0000","scrub_duration":0.023641031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.780382+0000","last_change":"2023-10-21T16:27:31.900930+0000","last_active":"2023-10-21T18:28:15.780382+0000","last_peered":"2023-10-21T18:28:15.780382+0000","last_clean":"2023-10-21T18:28:15.780382+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:15.780382+0000","last_undegraded":"2023-10-21T18:28:15.780382+0000","last_fullsized":"2023-10-21T18:28:15.780382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1137","reported_seq":1205,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:26:44.833097+0000","last_change":"2023-10-21T16:27:30.343715+0000","last_active":"2023-10-21T18:26:44.833097+0000","last_peered":"2023-10-21T18:26:44.833097+0000","last_clean":"2023-10-21T18:26:44.833097+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:26:44.833097+0000","last_undegraded":"2023-10-21T18:26:44.833097+0000","last_fullsized":"2023-10-21T18:26:44.833097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'449","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960953+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:28:15.960953+0000","last_peered":"2023-10-21T18:28:15.960953+0000","last_clean":"2023-10-21T18:28:15.960953+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:28:15.960953+0000","last_undegraded":"2023-10-21T18:28:15.960953+0000","last_fullsized":"2023-10-21T18:28:15.960953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'451","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959380+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:28:15.959380+0000","last_peered":"2023-10-21T18:28:15.959380+0000","last_clean":"2023-10-21T18:28:15.959380+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:28:15.959380+0000","last_undegraded":"2023-10-21T18:28:15.959380+0000","last_fullsized":"2023-10-21T18:28:15.959380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'767","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.901291+0000","last_change":"2023-10-21T18:28:38.901414+0000","last_active":"2023-10-21T18:28:38.901291+0000","last_peered":"2023-10-21T18:28:38.901291+0000","last_clean":"2023-10-21T18:28:38.901291+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:28:38.901291+0000","last_undegraded":"2023-10-21T18:28:38.901291+0000","last_fullsized":"2023-10-21T18:28:38.901291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'767","last_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_deep_scrub":"25'767","last_deep_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.901093+0000","objects_scrubbed":2,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:45.609026+0000","scrub_duration":0.038403093999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'370","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.896736+0000","last_change":"2023-10-21T16:27:31.928462+0000","last_active":"2023-10-21T18:28:15.896736+0000","last_peered":"2023-10-21T18:28:15.896736+0000","last_clean":"2023-10-21T18:28:15.896736+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:28:15.896736+0000","last_undegraded":"2023-10-21T18:28:15.896736+0000","last_fullsized":"2023-10-21T18:28:15.896736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1576","reported_seq":1647,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.953119+0000","last_change":"2023-10-21T18:28:34.953300+0000","last_active":"2023-10-21T18:28:34.953119+0000","last_peered":"2023-10-21T18:28:34.953119+0000","last_clean":"2023-10-21T18:28:34.953119+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:28:34.953119+0000","last_undegraded":"2023-10-21T18:28:34.953119+0000","last_fullsized":"2023-10-21T18:28:34.953119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1576","last_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_deep_scrub":"25'1576","last_deep_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.952989+0000","objects_scrubbed":5,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:40.153808+0000","scrub_duration":0.10868122500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'358","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464892+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:28:22.464892+0000","last_peered":"2023-10-21T18:28:22.464892+0000","last_clean":"2023-10-21T18:28:22.464892+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:28:22.464892+0000","last_undegraded":"2023-10-21T18:28:22.464892+0000","last_fullsized":"2023-10-21T18:28:22.464892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'570","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.761823+0000","last_change":"2023-10-21T18:28:30.761864+0000","last_active":"2023-10-21T18:28:30.761823+0000","last_peered":"2023-10-21T18:28:30.761823+0000","last_clean":"2023-10-21T18:28:30.761823+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:28:30.761823+0000","last_undegraded":"2023-10-21T18:28:30.761823+0000","last_fullsized":"2023-10-21T18:28:30.761823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'570","last_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_deep_scrub":"25'570","last_deep_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.761761+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:43.428584+0000","scrub_duration":0.020968085000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'382","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.872236+0000","last_change":"2023-10-21T16:27:31.719255+0000","last_active":"2023-10-21T18:28:15.872236+0000","last_peered":"2023-10-21T18:28:15.872236+0000","last_clean":"2023-10-21T18:28:15.872236+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:28:15.872236+0000","last_undegraded":"2023-10-21T18:28:15.872236+0000","last_fullsized":"2023-10-21T18:28:15.872236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'611","reported_seq":692,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.955503+0000","last_change":"2023-10-21T18:28:35.955562+0000","last_active":"2023-10-21T18:28:35.955503+0000","last_peered":"2023-10-21T18:28:35.955503+0000","last_clean":"2023-10-21T18:28:35.955503+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:28:35.955503+0000","last_undegraded":"2023-10-21T18:28:35.955503+0000","last_fullsized":"2023-10-21T18:28:35.955503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'611","last_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_deep_scrub":"25'611","last_deep_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.955427+0000","objects_scrubbed":4,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:48.622250+0000","scrub_duration":0.046963560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26357,"ondisk_log_size":26357,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216339300,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24246,"num_write_kb":225038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432678600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23867,"ondisk_log_size":23867,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478200,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.093},"min":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.67000000000000004},"max":{"1min":1.704,"5min":1.704,"15min":2.2519999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.117,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.70399999999999996,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.871,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.4339999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2749999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7889999999999999,"5min":2.25,"15min":2.2610000000000001},"last":1.631},{"interface":"front","average":{"1min":1.298,"5min":1.3819999999999999,"15min":1.409},"min":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.69399999999999995},"max":{"1min":1.675,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.474}]},{"osd":2,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.526,"15min":1.5209999999999999},"min":{"1min":0.85599999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0670000000000002,"5min":2.367,"15min":2.367},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.536,"15min":1.5700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8109999999999999,"5min":2.0449999999999999,"15min":2.6669999999999998},"last":1.149}]},{"osd":4,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.974,"15min":2.782},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3300000000000001,"15min":1.375},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7250000000000001,"5min":2.1240000000000001,"15min":2.319},"last":1.2549999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.431,"15min":1.482},"min":{"1min":0.874,"5min":0.874,"15min":0.70099999999999996},"max":{"1min":1.863,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.95799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.994,"5min":2.1760000000000002,"15min":2.423},"last":0.92100000000000004}]},{"osd":6,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.49,"15min":1.512},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.9249999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.607,"15min":1.6359999999999999},"min":{"1min":1.008,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.044,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5129999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.615,"15min":1.669},"min":{"1min":1.1579999999999999,"5min":1.01,"15min":0.999},"max":{"1min":2.1850000000000001,"5min":2.29,"15min":2.5859999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.6060000000000001,"15min":1.6439999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.2400000000000002,"5min":2.2429999999999999,"15min":3.0449999999999999},"last":1.3100000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478201,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.0449999999999999},"min":{"1min":0.72599999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.2509999999999999,"5min":1.7430000000000001,"15min":3.153},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2390000000000001,"15min":1.2250000000000001},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8460000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.181}]},{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.333,"15min":1.3620000000000001},"min":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.198,"5min":2.198,"15min":2.7480000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.4510000000000001,"15min":1.4299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.63400000000000001},"max":{"1min":1.9730000000000001,"5min":2.335,"15min":2.621},"last":1.399}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.379,"15min":1.3979999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55400000000000005},"max":{"1min":1.998,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5960000000000001,"15min":1.623},"min":{"1min":1.0640000000000001,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.101,"5min":2.3130000000000002,"15min":3.867},"last":1.2270000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3260000000000001,"15min":1.3600000000000001},"min":{"1min":0.96099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.889,"5min":2.048,"15min":2.895},"last":0.998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.363,"15min":1.3580000000000001},"min":{"1min":0.755,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8089999999999999,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4570000000000001,"15min":1.4430000000000001},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9850000000000001,"5min":2.2320000000000002,"15min":2.524},"last":1.341},{"interface":"front","average":{"1min":1.282,"5min":1.3680000000000001,"15min":1.355},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.59899999999999998},"max":{"1min":1.706,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":1.4590000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.466,"15min":1.4570000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.64400000000000002},"max":{"1min":1.847,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.554},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4630000000000001,"15min":1.52},"min":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84099999999999997},"max":{"1min":2.0099999999999998,"5min":2.2690000000000001,"15min":3.0259999999999998},"last":1.141}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6200000000000001,"15min":1.5940000000000001},"min":{"1min":0.79400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1040000000000001,"5min":2.2200000000000002,"15min":2.8029999999999999},"last":1.732},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.591,"15min":1.577},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.622},"max":{"1min":1.982,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.617}]}]},{"osd":1,"up_from":16,"seq":68719478201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51979688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.03,"15min":1.0629999999999999},"min":{"1min":0.71299999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.581,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2909999999999999,"15min":1.264},"min":{"1min":0.77600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9330000000000001,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":1.7170000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1950000000000001,"15min":1.202},"min":{"1min":0.70099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8939999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":1.073},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4139999999999999,"15min":1.4199999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.69699999999999995},"max":{"1min":1.9450000000000001,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.635}]},{"osd":3,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.486,"15min":1.51},"min":{"1min":1.028,"5min":0.95199999999999996,"15min":0.77300000000000002},"max":{"1min":1.8540000000000001,"5min":2.1099999999999999,"15min":2.681},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.5329999999999999,"15min":1.5469999999999999},"min":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.929,"5min":2.1480000000000001,"15min":2.544},"last":1.401}]},{"osd":4,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3460000000000001,"15min":1.377},"min":{"1min":0.92600000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6890000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.88,"5min":0.84499999999999997,"15min":0.77200000000000002},"max":{"1min":1.6779999999999999,"5min":1.958,"15min":2.1600000000000001},"last":1.5349999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.482,"15min":1.4830000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8959999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.526},"min":{"1min":0.96299999999999997,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":1.8740000000000001,"5min":2.165,"15min":2.6850000000000001},"last":1.9279999999999999}]},{"osd":6,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.54,"15min":1.5329999999999999},"min":{"1min":1.1419999999999999,"5min":0.91500000000000004,"15min":0.83499999999999996},"max":{"1min":1.97,"5min":2.173,"15min":2.5459999999999998},"last":1.843},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6140000000000001,"15min":1.6220000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.78900000000000003},"max":{"1min":2.04,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.891}]},{"osd":7,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.669,"15min":1.6779999999999999},"min":{"1min":1.2809999999999999,"5min":1.085,"15min":1.0469999999999999},"max":{"1min":2,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":2.0409999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.696,"15min":1.6970000000000001},"min":{"1min":1.2130000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.052,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.986}]}]},{"osd":0,"up_from":16,"seq":68719478202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84943738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.115,"15min":1.0960000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8759999999999999,"5min":2.0150000000000001,"15min":2.04},"last":1.373},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2370000000000001,"15min":1.2609999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.881,"5min":2.0539999999999998,"15min":2.161},"last":1.5569999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2470000000000001,"15min":1.296},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.60599999999999998},"max":{"1min":1.643,"5min":1.95,"15min":2.3820000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3999999999999999,"15min":1.427},"min":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.992,"5min":2.1219999999999999,"15min":2.5550000000000002},"last":1.2110000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.462,"15min":1.4670000000000001},"min":{"1min":0.81100000000000005,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.2269999999999999,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":1.825},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.502,"15min":1.5149999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9670000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.788}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.345,"15min":1.367},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8089999999999999,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":2.2360000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3260000000000001,"15min":1.337},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.1600000000000001},"last":1.653}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.377,"15min":1.4119999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.012,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":1.865},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.52,"15min":1.5329999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1669999999999998,"5min":2.597,"15min":2.7370000000000001},"last":2.3140000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.413,"15min":1.478},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.181,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.913},{"interface":"front","average":{"1min":1.419,"5min":1.5329999999999999,"15min":1.556},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.2480000000000002,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":1.734}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6080000000000001,"15min":1.6739999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.5249999999999999},"last":2.0209999999999999},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.647,"15min":1.6879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3839999999999999,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":2.3759999999999999}]}]},{"osd":6,"up_from":15,"seq":64424510905,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.41499999999999998},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.1419999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.47999999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0800000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":1.079,"5min":1.395,"15min":1.395},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1080000000000001,"5min":1.232,"15min":1.5069999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48599999999999999},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":2.1840000000000002},"last":0.872}]},{"osd":3,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.321},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"max":{"1min":1.1759999999999999,"5min":1.2969999999999999,"15min":1.327},"last":0.84699999999999998}]},{"osd":4,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.82699999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.61199999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33900000000000002}]},{"osd":5,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.76200000000000001},"last":0.312},{"interface":"front","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.36099999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.59199999999999997,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.39600000000000002}]},{"osd":7,"last update":"Sat Oct 21 18:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.44,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.72099999999999997,"15min":0.85699999999999998},"last":0.36799999999999999}]}]},{"osd":5,"up_from":15,"seq":64424510905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114532,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257308,"statfs":{"total":96636764160,"available":96519483392,"internally_reserved":0,"allocated":52654080,"data_stored":52476546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.05,"5min":1.2,"15min":1.212},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.75},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42399999999999999},"max":{"1min":1.101,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":1.105,"5min":1.2549999999999999,"15min":1.554},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0489999999999999,"15min":1.419},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.264,"15min":1.3069999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2250000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.79900000000000004},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.518},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.51200000000000001,"5min":0.503,"15min":0.45400000000000001},"max":{"1min":1.115,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.92200000000000004}]},{"osd":4,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.67500000000000004},"last":0.41099999999999998}]},{"osd":6,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.443},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.38500000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.42899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424510905,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.1850000000000001,"15min":1.349},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.355},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.78400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.1830000000000001,"15min":1.429},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.499,"15min":0.42799999999999999},"max":{"1min":1.087,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.432},"max":{"1min":1.0680000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.76700000000000002},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.1719999999999999,"5min":1.24,"15min":1.349},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.121,"5min":1.2869999999999999,"15min":1.361},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0249999999999999,"5min":1.893,"15min":1.893},"last":0.97399999999999998}]},{"osd":5,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.61699999999999999,"15min":0.68400000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.625,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.59299999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.67700000000000005,"15min":0.77700000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.81499999999999995},"last":0.53900000000000003}]}]},{"osd":7,"up_from":14,"seq":60129543608,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":0.5}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.33300000000000002}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.376}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51297463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:28:50.934 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.935 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.935 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.935 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.936 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.936 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.936 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.936 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.937 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.937 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.938 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.938 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.938 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.938 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.939 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.939 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.939 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.939 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.940 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.940 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.940 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.941 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.941 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.941 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.941 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.942 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.942 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.943 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.943 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.944 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.944 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.944 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.944 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.945 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.945 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.945 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.946 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.946 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.946 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.947 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.947 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.947 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.947 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.948 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.948 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.948 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.949 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.949 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.949 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.950 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.950 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.950 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:28:50.951 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-21T18:28:58.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:28:58.900 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:29:10.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:29:11.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.184+0000 7f003bd1d640 1 Processor -- start 2023-10-21T18:29:11.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.184+0000 7f003bd1d640 1 -- start start 2023-10-21T18:29:11.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.185+0000 7f003bd1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.185+0000 7f003bd1d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0034157cc0 0x7f0034150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.185+0000 7f003bd1d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00340c59d0 0x7f0034151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.186+0000 7f003bd1d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340c23f0 con 0x7f0034157cc0 2023-10-21T18:29:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.186+0000 7f003bd1d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0034156fa0 con 0x7f00340c59d0 2023-10-21T18:29:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.186+0000 7f003bd1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003415aaf0 con 0x7f00340c55f0 2023-10-21T18:29:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.186+0000 7f003a2ba640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00340c59d0 0x7f0034151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.186+0000 7f0039ab9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.187+0000 7f0039ab9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:32778/0 (socket says 172.21.15.12:32778) 2023-10-21T18:29:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.187+0000 7f0039ab9640 1 -- 172.21.15.12:0/2907950801 learned_addr learned my addr 172.21.15.12:0/2907950801 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:11.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f003a2ba640 1 -- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 msgr2=0x7f0034157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:11.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f003a2ba640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f003a2ba640 1 -- 172.21.15.12:0/2907950801 >> v2:172.21.15.12:3300/0 conn(0x7f0034157cc0 msgr2=0x7f0034150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:11.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f003a2ba640 1 --2- 172.21.15.12:0/2907950801 >> v2:172.21.15.12:3300/0 conn(0x7f0034157cc0 0x7f0034150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f003a2ba640 1 -- 172.21.15.12:0/2907950801 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003415add0 con 0x7f00340c59d0 2023-10-21T18:29:11.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.189+0000 7f0039ab9640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:29:11.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.191+0000 7f003a2ba640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f0034151320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00340c1b00 tx=0x7f002c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b303b7f12636437a server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.195+0000 7f0038ab7640 1 -- 172.21.15.12:0/2907950801 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c031830 con 0x7f00340c59d0 2023-10-21T18:29:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.195+0000 7f0038ab7640 1 -- 172.21.15.12:0/2907950801 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c031990 con 0x7f00340c59d0 2023-10-21T18:29:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.195+0000 7f0038ab7640 1 -- 172.21.15.12:0/2907950801 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c031d20 con 0x7f00340c59d0 2023-10-21T18:29:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.195+0000 7f003bd1d640 1 -- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 msgr2=0x7f0034151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.195+0000 7f003bd1d640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f0034151320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00340c1b00 tx=0x7f002c02b8d0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 -- 172.21.15.12:0/2907950801 shutdown_connections 2023-10-21T18:29:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f0034151320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 --2- 172.21.15.12:0/2907950801 >> v2:172.21.15.12:3300/0 conn(0x7f0034157cc0 0x7f0034150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 --2- 172.21.15.12:0/2907950801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f0034157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 -- 172.21.15.12:0/2907950801 >> 172.21.15.12:0/2907950801 conn(0x7f0034069de0 msgr2=0x7f003406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 -- 172.21.15.12:0/2907950801 shutdown_connections 2023-10-21T18:29:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.196+0000 7f003bd1d640 1 -- 172.21.15.12:0/2907950801 wait complete. 2023-10-21T18:29:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.198+0000 7f003bd1d640 1 Processor -- start 2023-10-21T18:29:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.198+0000 7f003bd1d640 1 -- start start 2023-10-21T18:29:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.199+0000 7f003bd1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f003414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f003bd1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f003bd1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0034157cc0 0x7f003414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f003bd1d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003414c000 con 0x7f0034157cc0 2023-10-21T18:29:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f003bd1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003414bcf0 con 0x7f00340c59d0 2023-10-21T18:29:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f003bd1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003414ca40 con 0x7f00340c55f0 2023-10-21T18:29:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f00392b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.200+0000 7f0039ab9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f003414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.201+0000 7f00392b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:57378/0 (socket says 172.21.15.12:57378) 2023-10-21T18:29:11.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.201+0000 7f00392b8640 1 -- 172.21.15.12:0/823083291 learned_addr learned my addr 172.21.15.12:0/823083291 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.204+0000 7f00392b8640 1 -- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 msgr2=0x7f003414b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.204+0000 7f00392b8640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f003414b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.204+0000 7f00392b8640 1 -- 172.21.15.12:0/823083291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0034157cc0 msgr2=0x7f003414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.204+0000 7f00392b8640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0034157cc0 0x7f003414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.204+0000 7f00392b8640 1 -- 172.21.15.12:0/823083291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300094d0 con 0x7f00340c59d0 2023-10-21T18:29:11.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.208+0000 7f00392b8640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f002400ba80 tx=0x7f002400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:11.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.211+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400cc00 con 0x7f00340c59d0 2023-10-21T18:29:11.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.212+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400cd80 con 0x7f00340c59d0 2023-10-21T18:29:11.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.212+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024014680 con 0x7f00340c59d0 2023-10-21T18:29:11.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.212+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c009400 con 0x7f00340c59d0 2023-10-21T18:29:11.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.212+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034150160 con 0x7f00340c59d0 2023-10-21T18:29:11.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.213+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003414cbd0 con 0x7f00340c59d0 2023-10-21T18:29:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.232+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f002401d3b0 con 0x7f00340c59d0 2023-10-21T18:29:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.234+0000 7f002a7fc640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 0x7f001806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.234+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0024089840 con 0x7f00340c59d0 2023-10-21T18:29:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.234+0000 7f0039ab9640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 0x7f001806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.235+0000 7f0039ab9640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 0x7f001806d3b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0030006ca0 tx=0x7f0030009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:11.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.475+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0024054ad0 con 0x7f00340c59d0 2023-10-21T18:29:11.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.694+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f003415b390 con 0x7f001806aef0 2023-10-21T18:29:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.701+0000 7f002a7fc640 1 -- 172.21.15.12:0/823083291 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291076 (secure 0 0 0) 0x7f0030009940 con 0x7f001806aef0 2023-10-21T18:29:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:29:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 msgr2=0x7f001806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 0x7f001806d3b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0030006ca0 tx=0x7f0030009240 comp rx=0 tx=0).stop 2023-10-21T18:29:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 msgr2=0x7f003414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f002400ba80 tx=0x7f002400bf40 comp rx=0 tx=0).stop 2023-10-21T18:29:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 shutdown_connections 2023-10-21T18:29:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f001806aef0 0x7f001806d3b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0034157cc0 0x7f003414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00340c59d0 0x7f003414ced0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 --2- 172.21.15.12:0/823083291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00340c55f0 0x7f003414b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 >> 172.21.15.12:0/823083291 conn(0x7f0034069de0 msgr2=0x7f0034156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 shutdown_connections 2023-10-21T18:29:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:11.709+0000 7f003bd1d640 1 -- 172.21.15.12:0/823083291 wait complete. 2023-10-21T18:29:11.736 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3683,"stamp":"2023-10-21T18:29:11.147447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216929668,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48793,"num_write_kb":4575230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50362,"ondisk_log_size":50362,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":945872,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754028848,"statfs":{"total":773094113280,"available":772125540352,"internally_reserved":0,"allocated":435961856,"data_stored":434594192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":532532794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003023"},"pg_stats":[{"pgid":"3.3f","version":"25'409","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.035326+0000","last_change":"2023-10-21T18:29:04.035506+0000","last_active":"2023-10-21T18:29:04.035326+0000","last_peered":"2023-10-21T18:29:04.035326+0000","last_clean":"2023-10-21T18:29:04.035326+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:29:04.035326+0000","last_undegraded":"2023-10-21T18:29:04.035326+0000","last_fullsized":"2023-10-21T18:29:04.035326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.035110+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:43.400496+0000","scrub_duration":0.0043130260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'423","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.690490+0000","last_change":"2023-10-21T18:28:49.690534+0000","last_active":"2023-10-21T18:28:49.690490+0000","last_peered":"2023-10-21T18:28:49.690490+0000","last_clean":"2023-10-21T18:28:49.690490+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:28:49.690490+0000","last_undegraded":"2023-10-21T18:28:49.690490+0000","last_fullsized":"2023-10-21T18:28:49.690490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.690405+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:04.270503+0000","scrub_duration":0.0026678240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'376","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.660584+0000","last_change":"2023-10-21T18:28:46.660627+0000","last_active":"2023-10-21T18:28:46.660584+0000","last_peered":"2023-10-21T18:28:46.660584+0000","last_clean":"2023-10-21T18:28:46.660584+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:28:46.660584+0000","last_undegraded":"2023-10-21T18:28:46.660584+0000","last_fullsized":"2023-10-21T18:28:46.660584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'376","last_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_deep_scrub":"25'376","last_deep_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.660492+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:04:09.387985+0000","scrub_duration":0.0021392680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'405","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:31.943133+0000","last_change":"2023-10-21T18:28:31.943357+0000","last_active":"2023-10-21T18:28:31.943133+0000","last_peered":"2023-10-21T18:28:31.943133+0000","last_clean":"2023-10-21T18:28:31.943133+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:28:31.943133+0000","last_undegraded":"2023-10-21T18:28:31.943133+0000","last_fullsized":"2023-10-21T18:28:31.943133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_clean_scrub_stamp":"2023-10-21T18:28:31.942864+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:39.601766+0000","scrub_duration":0.0053496380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":508,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.780410+0000","last_change":"2023-10-21T16:27:57.847712+0000","last_active":"2023-10-21T18:28:15.780410+0000","last_peered":"2023-10-21T18:28:15.780410+0000","last_clean":"2023-10-21T18:28:15.780410+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:28:15.780410+0000","last_undegraded":"2023-10-21T18:28:15.780410+0000","last_fullsized":"2023-10-21T18:28:15.780410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'388","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.874884+0000","last_change":"2023-10-21T18:28:29.874962+0000","last_active":"2023-10-21T18:28:29.874884+0000","last_peered":"2023-10-21T18:28:29.874884+0000","last_clean":"2023-10-21T18:28:29.874884+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:28:29.874884+0000","last_undegraded":"2023-10-21T18:28:29.874884+0000","last_fullsized":"2023-10-21T18:28:29.874884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'388","last_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_deep_scrub":"25'388","last_deep_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.874757+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:03:33.858731+0000","scrub_duration":0.0039421550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'407","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826595+0000","last_change":"2023-10-21T18:28:43.826713+0000","last_active":"2023-10-21T18:28:43.826595+0000","last_peered":"2023-10-21T18:28:43.826595+0000","last_clean":"2023-10-21T18:28:43.826595+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:28:43.826595+0000","last_undegraded":"2023-10-21T18:28:43.826595+0000","last_fullsized":"2023-10-21T18:28:43.826595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'407","last_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_deep_scrub":"25'407","last_deep_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826446+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:06:26.675534+0000","scrub_duration":0.0042928150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'384","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.877192+0000","last_change":"2023-10-21T16:27:31.922576+0000","last_active":"2023-10-21T18:28:15.877192+0000","last_peered":"2023-10-21T18:28:15.877192+0000","last_clean":"2023-10-21T18:28:15.877192+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:28:15.877192+0000","last_undegraded":"2023-10-21T18:28:15.877192+0000","last_fullsized":"2023-10-21T18:28:15.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'428","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.034040+0000","last_change":"2023-10-21T18:28:45.034149+0000","last_active":"2023-10-21T18:28:45.034040+0000","last_peered":"2023-10-21T18:28:45.034040+0000","last_clean":"2023-10-21T18:28:45.034040+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:28:45.034040+0000","last_undegraded":"2023-10-21T18:28:45.034040+0000","last_fullsized":"2023-10-21T18:28:45.034040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.033874+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:46.708217+0000","scrub_duration":0.0047872369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.942804+0000","last_change":"2023-10-21T18:28:51.942932+0000","last_active":"2023-10-21T18:28:51.942804+0000","last_peered":"2023-10-21T18:28:51.942804+0000","last_clean":"2023-10-21T18:28:51.942804+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:28:51.942804+0000","last_undegraded":"2023-10-21T18:28:51.942804+0000","last_fullsized":"2023-10-21T18:28:51.942804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.942622+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:22.215720+0000","scrub_duration":0.0057898489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'366","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.906474+0000","last_change":"2023-10-21T18:28:50.906600+0000","last_active":"2023-10-21T18:28:50.906474+0000","last_peered":"2023-10-21T18:28:50.906474+0000","last_clean":"2023-10-21T18:28:50.906474+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:28:50.906474+0000","last_undegraded":"2023-10-21T18:28:50.906474+0000","last_fullsized":"2023-10-21T18:28:50.906474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.906355+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:06:07.160796+0000","scrub_duration":0.0040660480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'373","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:01.057082+0000","last_change":"2023-10-21T18:29:01.057312+0000","last_active":"2023-10-21T18:29:01.057082+0000","last_peered":"2023-10-21T18:29:01.057082+0000","last_clean":"2023-10-21T18:29:01.057082+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:29:01.057082+0000","last_undegraded":"2023-10-21T18:29:01.057082+0000","last_fullsized":"2023-10-21T18:29:01.057082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'373","last_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_deep_scrub":"25'373","last_deep_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_clean_scrub_stamp":"2023-10-21T18:29:01.056873+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:26:06.772053+0000","scrub_duration":0.0065493540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'411","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826664+0000","last_change":"2023-10-21T18:28:43.826723+0000","last_active":"2023-10-21T18:28:43.826664+0000","last_peered":"2023-10-21T18:28:43.826664+0000","last_clean":"2023-10-21T18:28:43.826664+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:28:43.826664+0000","last_undegraded":"2023-10-21T18:28:43.826664+0000","last_fullsized":"2023-10-21T18:28:43.826664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826560+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:06.412002+0000","scrub_duration":0.0035619480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'409","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.746890+0000","last_change":"2023-10-21T18:28:52.746951+0000","last_active":"2023-10-21T18:28:52.746890+0000","last_peered":"2023-10-21T18:28:52.746890+0000","last_clean":"2023-10-21T18:28:52.746890+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:28:52.746890+0000","last_undegraded":"2023-10-21T18:28:52.746890+0000","last_fullsized":"2023-10-21T18:28:52.746890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.746784+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:59.454717+0000","scrub_duration":0.002219937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'429","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.699387+0000","last_change":"2023-10-21T18:28:36.699387+0000","last_active":"2023-10-21T18:28:36.699387+0000","last_peered":"2023-10-21T18:28:36.699387+0000","last_clean":"2023-10-21T18:28:36.699387+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:28:36.699387+0000","last_undegraded":"2023-10-21T18:28:36.699387+0000","last_fullsized":"2023-10-21T18:28:36.699387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.699278+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:43.407211+0000","scrub_duration":0.0042182460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'427","reported_seq":526,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.578932+0000","last_change":"2023-10-21T18:28:35.578932+0000","last_active":"2023-10-21T18:28:35.578932+0000","last_peered":"2023-10-21T18:28:35.578932+0000","last_clean":"2023-10-21T18:28:35.578932+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:28:35.578932+0000","last_undegraded":"2023-10-21T18:28:35.578932+0000","last_fullsized":"2023-10-21T18:28:35.578932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.578584+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:31.224721+0000","scrub_duration":0.0053980649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'462","reported_seq":566,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686666+0000","last_change":"2023-10-21T16:27:31.936383+0000","last_active":"2023-10-21T18:28:24.686666+0000","last_peered":"2023-10-21T18:28:24.686666+0000","last_clean":"2023-10-21T18:28:24.686666+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:28:24.686666+0000","last_undegraded":"2023-10-21T18:28:24.686666+0000","last_fullsized":"2023-10-21T18:28:24.686666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:53.416169+0000","last_change":"2023-10-21T18:28:53.416216+0000","last_active":"2023-10-21T18:28:53.416169+0000","last_peered":"2023-10-21T18:28:53.416169+0000","last_clean":"2023-10-21T18:28:53.416169+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:53.416169+0000","last_undegraded":"2023-10-21T18:28:53.416169+0000","last_fullsized":"2023-10-21T18:28:53.416169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:53.416093+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:19.552816+0000","scrub_duration":0.0043137169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'404","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.958557+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:28:15.958557+0000","last_peered":"2023-10-21T18:28:15.958557+0000","last_clean":"2023-10-21T18:28:15.958557+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:28:15.958557+0000","last_undegraded":"2023-10-21T18:28:15.958557+0000","last_fullsized":"2023-10-21T18:28:15.958557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:07.070807+0000","last_change":"2023-10-21T18:29:07.070919+0000","last_active":"2023-10-21T18:29:07.070807+0000","last_peered":"2023-10-21T18:29:07.070807+0000","last_clean":"2023-10-21T18:29:07.070807+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:29:07.070807+0000","last_undegraded":"2023-10-21T18:29:07.070807+0000","last_fullsized":"2023-10-21T18:29:07.070807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_clean_scrub_stamp":"2023-10-21T18:29:07.070615+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:29:27.871808+0000","scrub_duration":0.0054759869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'400","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.966366+0000","last_change":"2023-10-21T18:28:42.966366+0000","last_active":"2023-10-21T18:28:42.966366+0000","last_peered":"2023-10-21T18:28:42.966366+0000","last_clean":"2023-10-21T18:28:42.966366+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:28:42.966366+0000","last_undegraded":"2023-10-21T18:28:42.966366+0000","last_fullsized":"2023-10-21T18:28:42.966366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'400","last_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_deep_scrub":"25'400","last_deep_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.966240+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:19.952458+0000","scrub_duration":0.0031400999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'449","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.941449+0000","last_change":"2023-10-21T18:28:36.941449+0000","last_active":"2023-10-21T18:28:36.941449+0000","last_peered":"2023-10-21T18:28:36.941449+0000","last_clean":"2023-10-21T18:28:36.941449+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:28:36.941449+0000","last_undegraded":"2023-10-21T18:28:36.941449+0000","last_fullsized":"2023-10-21T18:28:36.941449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.941104+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:44.600005+0000","scrub_duration":0.006421108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:05.555080+0000","last_change":"2023-10-21T18:29:05.555176+0000","last_active":"2023-10-21T18:29:05.555080+0000","last_peered":"2023-10-21T18:29:05.555080+0000","last_clean":"2023-10-21T18:29:05.555080+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:29:05.555080+0000","last_undegraded":"2023-10-21T18:29:05.555080+0000","last_fullsized":"2023-10-21T18:29:05.555080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_clean_scrub_stamp":"2023-10-21T18:29:05.554977+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:28.358403+0000","scrub_duration":0.0040465589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'412","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.584281+0000","last_change":"2023-10-21T18:28:36.584402+0000","last_active":"2023-10-21T18:28:36.584281+0000","last_peered":"2023-10-21T18:28:36.584281+0000","last_clean":"2023-10-21T18:28:36.584281+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:36.584281+0000","last_undegraded":"2023-10-21T18:28:36.584281+0000","last_fullsized":"2023-10-21T18:28:36.584281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.584058+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:42:57.833730+0000","scrub_duration":0.0042012220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'408","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.028051+0000","last_change":"2023-10-21T16:27:31.918046+0000","last_active":"2023-10-21T18:28:27.028051+0000","last_peered":"2023-10-21T18:28:27.028051+0000","last_clean":"2023-10-21T18:28:27.028051+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:28:27.028051+0000","last_undegraded":"2023-10-21T18:28:27.028051+0000","last_fullsized":"2023-10-21T18:28:27.028051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'487","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.855941+0000","last_change":"2023-10-21T18:28:46.855941+0000","last_active":"2023-10-21T18:28:46.855941+0000","last_peered":"2023-10-21T18:28:46.855941+0000","last_clean":"2023-10-21T18:28:46.855941+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:28:46.855941+0000","last_undegraded":"2023-10-21T18:28:46.855941+0000","last_fullsized":"2023-10-21T18:28:46.855941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'487","last_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_deep_scrub":"25'487","last_deep_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.855612+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:29:17.471747+0000","scrub_duration":0.0054321940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'417","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.740068+0000","last_change":"2023-10-21T18:28:55.740104+0000","last_active":"2023-10-21T18:28:55.740068+0000","last_peered":"2023-10-21T18:28:55.740068+0000","last_clean":"2023-10-21T18:28:55.740068+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:28:55.740068+0000","last_undegraded":"2023-10-21T18:28:55.740068+0000","last_fullsized":"2023-10-21T18:28:55.740068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.740003+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:54.707531+0000","scrub_duration":0.0020128619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'406","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.820012+0000","last_change":"2023-10-21T18:28:57.820057+0000","last_active":"2023-10-21T18:28:57.820012+0000","last_peered":"2023-10-21T18:28:57.820012+0000","last_clean":"2023-10-21T18:28:57.820012+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:28:57.820012+0000","last_undegraded":"2023-10-21T18:28:57.820012+0000","last_fullsized":"2023-10-21T18:28:57.820012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.819933+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:38.790104+0000","scrub_duration":0.0044187219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'398","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:06.580335+0000","last_change":"2023-10-21T18:29:06.580377+0000","last_active":"2023-10-21T18:29:06.580335+0000","last_peered":"2023-10-21T18:29:06.580335+0000","last_clean":"2023-10-21T18:29:06.580335+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:29:06.580335+0000","last_undegraded":"2023-10-21T18:29:06.580335+0000","last_fullsized":"2023-10-21T18:29:06.580335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_clean_scrub_stamp":"2023-10-21T18:29:06.580250+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:42.050479+0000","scrub_duration":0.0021721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'469","reported_seq":564,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.465244+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:28:24.465244+0000","last_peered":"2023-10-21T18:28:24.465244+0000","last_clean":"2023-10-21T18:28:24.465244+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:28:24.465244+0000","last_undegraded":"2023-10-21T18:28:24.465244+0000","last_fullsized":"2023-10-21T18:28:24.465244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.523209+0000","last_change":"2023-10-21T18:28:42.523252+0000","last_active":"2023-10-21T18:28:42.523209+0000","last_peered":"2023-10-21T18:28:42.523209+0000","last_clean":"2023-10-21T18:28:42.523209+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:42.523209+0000","last_undegraded":"2023-10-21T18:28:42.523209+0000","last_fullsized":"2023-10-21T18:28:42.523209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'457","last_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_deep_scrub":"25'457","last_deep_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.523122+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:34.806713+0000","scrub_duration":0.003821732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'423","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.898803+0000","last_change":"2023-10-21T18:28:30.898913+0000","last_active":"2023-10-21T18:28:30.898803+0000","last_peered":"2023-10-21T18:28:30.898803+0000","last_clean":"2023-10-21T18:28:30.898803+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:28:30.898803+0000","last_undegraded":"2023-10-21T18:28:30.898803+0000","last_fullsized":"2023-10-21T18:28:30.898803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.898643+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:43:54.121212+0000","scrub_duration":0.004221242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'417","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.983813+0000","last_change":"2023-10-21T18:28:30.983860+0000","last_active":"2023-10-21T18:28:30.983813+0000","last_peered":"2023-10-21T18:28:30.983813+0000","last_clean":"2023-10-21T18:28:30.983813+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:28:30.983813+0000","last_undegraded":"2023-10-21T18:28:30.983813+0000","last_fullsized":"2023-10-21T18:28:30.983813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.983725+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:00:54.743691+0000","scrub_duration":0.0040209740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'223","reported_seq":294,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.693077+0000","last_change":"2023-10-21T18:28:35.693118+0000","last_active":"2023-10-21T18:28:35.693077+0000","last_peered":"2023-10-21T18:28:35.693077+0000","last_clean":"2023-10-21T18:28:35.693077+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:28:35.693077+0000","last_undegraded":"2023-10-21T18:28:35.693077+0000","last_fullsized":"2023-10-21T18:28:35.693077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'223","last_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_deep_scrub":"25'223","last_deep_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.693006+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:26.846010+0000","scrub_duration":0.011849706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'378","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.110876+0000","last_change":"2023-10-21T18:28:52.110911+0000","last_active":"2023-10-21T18:28:52.110876+0000","last_peered":"2023-10-21T18:28:52.110876+0000","last_clean":"2023-10-21T18:28:52.110876+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:28:52.110876+0000","last_undegraded":"2023-10-21T18:28:52.110876+0000","last_fullsized":"2023-10-21T18:28:52.110876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'378","last_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_deep_scrub":"25'378","last_deep_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.110809+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:11:36.694729+0000","scrub_duration":0.0036171549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1321","reported_seq":1392,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.687023+0000","last_change":"2023-10-21T18:29:03.687154+0000","last_active":"2023-10-21T18:29:03.687023+0000","last_peered":"2023-10-21T18:29:03.687023+0000","last_clean":"2023-10-21T18:29:03.687023+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:29:03.687023+0000","last_undegraded":"2023-10-21T18:29:03.687023+0000","last_fullsized":"2023-10-21T18:29:03.687023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1321","last_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_deep_scrub":"25'1321","last_deep_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.686852+0000","objects_scrubbed":4,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:32:23.455573+0000","scrub_duration":0.107670841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'776","reported_seq":849,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.858788+0000","last_change":"2023-10-21T18:28:36.858788+0000","last_active":"2023-10-21T18:28:36.858788+0000","last_peered":"2023-10-21T18:28:36.858788+0000","last_clean":"2023-10-21T18:28:36.858788+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:28:36.858788+0000","last_undegraded":"2023-10-21T18:28:36.858788+0000","last_fullsized":"2023-10-21T18:28:36.858788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'776","last_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_deep_scrub":"25'776","last_deep_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.858682+0000","objects_scrubbed":1,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:38.533026+0000","scrub_duration":0.035982591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'464","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464799+0000","last_change":"2023-10-21T16:27:31.889259+0000","last_active":"2023-10-21T18:28:22.464799+0000","last_peered":"2023-10-21T18:28:22.464799+0000","last_clean":"2023-10-21T18:28:22.464799+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:28:22.464799+0000","last_undegraded":"2023-10-21T18:28:22.464799+0000","last_fullsized":"2023-10-21T18:28:22.464799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'907","reported_seq":980,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.562864+0000","last_change":"2023-10-21T18:28:47.563062+0000","last_active":"2023-10-21T18:28:47.562864+0000","last_peered":"2023-10-21T18:28:47.562864+0000","last_clean":"2023-10-21T18:28:47.562864+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:28:47.562864+0000","last_undegraded":"2023-10-21T18:28:47.562864+0000","last_fullsized":"2023-10-21T18:28:47.562864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'907","last_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_deep_scrub":"25'907","last_deep_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.562685+0000","objects_scrubbed":3,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:36:48.077046+0000","scrub_duration":0.083295784999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'415","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:54.115025+0000","last_change":"2023-10-21T18:28:54.115025+0000","last_active":"2023-10-21T18:28:54.115025+0000","last_peered":"2023-10-21T18:28:54.115025+0000","last_clean":"2023-10-21T18:28:54.115025+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:28:54.115025+0000","last_undegraded":"2023-10-21T18:28:54.115025+0000","last_fullsized":"2023-10-21T18:28:54.115025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'415","last_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_deep_scrub":"25'415","last_deep_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:54.114810+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:43.902447+0000","scrub_duration":0.0042339600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.944245+0000","last_change":"2023-10-21T18:28:28.944434+0000","last_active":"2023-10-21T18:28:28.944245+0000","last_peered":"2023-10-21T18:28:28.944245+0000","last_clean":"2023-10-21T18:28:28.944245+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:28:28.944245+0000","last_undegraded":"2023-10-21T18:28:28.944245+0000","last_fullsized":"2023-10-21T18:28:28.944245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.944008+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:47:21.203623+0000","scrub_duration":0.0041208629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'419","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.845991+0000","last_change":"2023-10-21T18:28:45.846105+0000","last_active":"2023-10-21T18:28:45.845991+0000","last_peered":"2023-10-21T18:28:45.845991+0000","last_clean":"2023-10-21T18:28:45.845991+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:28:45.845991+0000","last_undegraded":"2023-10-21T18:28:45.845991+0000","last_fullsized":"2023-10-21T18:28:45.845991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'419","last_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_deep_scrub":"25'419","last_deep_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.845733+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:45:21.778624+0000","scrub_duration":0.0052853249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1390","reported_seq":1463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.894216+0000","last_change":"2023-10-21T18:28:36.894345+0000","last_active":"2023-10-21T18:28:36.894216+0000","last_peered":"2023-10-21T18:28:36.894216+0000","last_clean":"2023-10-21T18:28:36.894216+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:36.894216+0000","last_undegraded":"2023-10-21T18:28:36.894216+0000","last_fullsized":"2023-10-21T18:28:36.894216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1390","last_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_deep_scrub":"25'1390","last_deep_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.894015+0000","objects_scrubbed":4,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:10.544242+0000","scrub_duration":0.093137905000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13548657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1323,"num_write_kb":13905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'410","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464902+0000","last_change":"2023-10-21T16:27:31.910664+0000","last_active":"2023-10-21T18:28:22.464902+0000","last_peered":"2023-10-21T18:28:22.464902+0000","last_clean":"2023-10-21T18:28:22.464902+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:28:22.464902+0000","last_undegraded":"2023-10-21T18:28:22.464902+0000","last_fullsized":"2023-10-21T18:28:22.464902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1996","reported_seq":2069,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.442457+0000","last_change":"2023-10-21T18:28:29.442502+0000","last_active":"2023-10-21T18:28:29.442457+0000","last_peered":"2023-10-21T18:28:29.442457+0000","last_clean":"2023-10-21T18:28:29.442457+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:29.442457+0000","last_undegraded":"2023-10-21T18:28:29.442457+0000","last_fullsized":"2023-10-21T18:28:29.442457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1996","last_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_deep_scrub":"25'1996","last_deep_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.442390+0000","objects_scrubbed":4,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:49.487666+0000","scrub_duration":0.022358660999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960471+0000","last_change":"2023-10-21T16:27:31.916502+0000","last_active":"2023-10-21T18:28:15.960471+0000","last_peered":"2023-10-21T18:28:15.960471+0000","last_clean":"2023-10-21T18:28:15.960471+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:28:15.960471+0000","last_undegraded":"2023-10-21T18:28:15.960471+0000","last_fullsized":"2023-10-21T18:28:15.960471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1724","reported_seq":1799,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:25.859284+0000","last_change":"2023-10-21T18:28:25.859284+0000","last_active":"2023-10-21T18:28:25.859284+0000","last_peered":"2023-10-21T18:28:25.859284+0000","last_clean":"2023-10-21T18:28:25.859284+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:28:25.859284+0000","last_undegraded":"2023-10-21T18:28:25.859284+0000","last_fullsized":"2023-10-21T18:28:25.859284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1724","last_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_deep_scrub":"25'1724","last_deep_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:25.859118+0000","objects_scrubbed":6,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:33.368476+0000","scrub_duration":0.057169405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.829056+0000","last_change":"2023-10-21T18:28:44.829224+0000","last_active":"2023-10-21T18:28:44.829056+0000","last_peered":"2023-10-21T18:28:44.829056+0000","last_clean":"2023-10-21T18:28:44.829056+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:28:44.829056+0000","last_undegraded":"2023-10-21T18:28:44.829056+0000","last_fullsized":"2023-10-21T18:28:44.829056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.828875+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:15.215270+0000","scrub_duration":0.0040916859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'326","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.607328+0000","last_change":"2023-10-21T18:28:37.607328+0000","last_active":"2023-10-21T18:28:37.607328+0000","last_peered":"2023-10-21T18:28:37.607328+0000","last_clean":"2023-10-21T18:28:37.607328+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:28:37.607328+0000","last_undegraded":"2023-10-21T18:28:37.607328+0000","last_fullsized":"2023-10-21T18:28:37.607328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'326","last_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_deep_scrub":"25'326","last_deep_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.607192+0000","objects_scrubbed":4,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:24:31.987420+0000","scrub_duration":0.043194149000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'385","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.850205+0000","last_change":"2023-10-21T18:28:39.850205+0000","last_active":"2023-10-21T18:28:39.850205+0000","last_peered":"2023-10-21T18:28:39.850205+0000","last_clean":"2023-10-21T18:28:39.850205+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:28:39.850205+0000","last_undegraded":"2023-10-21T18:28:39.850205+0000","last_fullsized":"2023-10-21T18:28:39.850205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'385","last_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_deep_scrub":"25'385","last_deep_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.850078+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:10.961936+0000","scrub_duration":0.0039236139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686347+0000","last_change":"2023-10-21T16:27:30.344574+0000","last_active":"2023-10-21T18:28:24.686347+0000","last_peered":"2023-10-21T18:28:24.686347+0000","last_clean":"2023-10-21T18:28:24.686347+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:28:24.686347+0000","last_undegraded":"2023-10-21T18:28:24.686347+0000","last_fullsized":"2023-10-21T18:28:24.686347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'428","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686684+0000","last_change":"2023-10-21T16:27:31.933882+0000","last_active":"2023-10-21T18:28:24.686684+0000","last_peered":"2023-10-21T18:28:24.686684+0000","last_clean":"2023-10-21T18:28:24.686684+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:28:24.686684+0000","last_undegraded":"2023-10-21T18:28:24.686684+0000","last_fullsized":"2023-10-21T18:28:24.686684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:41.866112+0000","last_change":"2023-10-21T18:28:41.866112+0000","last_active":"2023-10-21T18:28:41.866112+0000","last_peered":"2023-10-21T18:28:41.866112+0000","last_clean":"2023-10-21T18:28:41.866112+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:28:41.866112+0000","last_undegraded":"2023-10-21T18:28:41.866112+0000","last_fullsized":"2023-10-21T18:28:41.866112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'45","last_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_deep_scrub":"25'45","last_deep_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_clean_scrub_stamp":"2023-10-21T18:28:41.865799+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:22.835970+0000","scrub_duration":0.0037365559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'429","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.001247+0000","last_change":"2023-10-21T18:28:44.001247+0000","last_active":"2023-10-21T18:28:44.001247+0000","last_peered":"2023-10-21T18:28:44.001247+0000","last_clean":"2023-10-21T18:28:44.001247+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:28:44.001247+0000","last_undegraded":"2023-10-21T18:28:44.001247+0000","last_fullsized":"2023-10-21T18:28:44.001247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.000789+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:21.675243+0000","scrub_duration":0.0042857920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'819","reported_seq":894,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.888008+0000","last_change":"2023-10-21T18:28:28.888008+0000","last_active":"2023-10-21T18:28:28.888008+0000","last_peered":"2023-10-21T18:28:28.888008+0000","last_clean":"2023-10-21T18:28:28.888008+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:28:28.888008+0000","last_undegraded":"2023-10-21T18:28:28.888008+0000","last_fullsized":"2023-10-21T18:28:28.888008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'819","last_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_deep_scrub":"25'819","last_deep_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.887893+0000","objects_scrubbed":6,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:30.562236+0000","scrub_duration":0.023693352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'488","reported_seq":584,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.598988+0000","last_change":"2023-10-21T18:28:34.598988+0000","last_active":"2023-10-21T18:28:34.598988+0000","last_peered":"2023-10-21T18:28:34.598988+0000","last_clean":"2023-10-21T18:28:34.598988+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:28:34.598988+0000","last_undegraded":"2023-10-21T18:28:34.598988+0000","last_fullsized":"2023-10-21T18:28:34.598988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'488","last_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_deep_scrub":"25'488","last_deep_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.598552+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:03:57.326046+0000","scrub_duration":0.005866652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'738","reported_seq":814,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:40.938993+0000","last_change":"2023-10-21T18:28:40.939120+0000","last_active":"2023-10-21T18:28:40.938993+0000","last_peered":"2023-10-21T18:28:40.938993+0000","last_clean":"2023-10-21T18:28:40.938993+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:28:40.938993+0000","last_undegraded":"2023-10-21T18:28:40.938993+0000","last_fullsized":"2023-10-21T18:28:40.938993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'738","last_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_deep_scrub":"25'738","last_deep_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:40.938810+0000","objects_scrubbed":2,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:39.906339+0000","scrub_duration":0.037421380999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'366","reported_seq":454,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.859351+0000","last_change":"2023-10-21T18:28:47.859351+0000","last_active":"2023-10-21T18:28:47.859351+0000","last_peered":"2023-10-21T18:28:47.859351+0000","last_clean":"2023-10-21T18:28:47.859351+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:28:47.859351+0000","last_undegraded":"2023-10-21T18:28:47.859351+0000","last_fullsized":"2023-10-21T18:28:47.859351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.858872+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:54:00.525695+0000","scrub_duration":0.0059569339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'782","reported_seq":859,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.969679+0000","last_change":"2023-10-21T18:28:36.969679+0000","last_active":"2023-10-21T18:28:36.969679+0000","last_peered":"2023-10-21T18:28:36.969679+0000","last_clean":"2023-10-21T18:28:36.969679+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:28:36.969679+0000","last_undegraded":"2023-10-21T18:28:36.969679+0000","last_fullsized":"2023-10-21T18:28:36.969679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'782","last_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_deep_scrub":"25'782","last_deep_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.969514+0000","objects_scrubbed":2,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:42.170333+0000","scrub_duration":0.012547963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'358","reported_seq":441,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.006751+0000","last_change":"2023-10-21T18:28:57.006906+0000","last_active":"2023-10-21T18:28:57.006751+0000","last_peered":"2023-10-21T18:28:57.006751+0000","last_clean":"2023-10-21T18:28:57.006751+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:28:57.006751+0000","last_undegraded":"2023-10-21T18:28:57.006751+0000","last_fullsized":"2023-10-21T18:28:57.006751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'358","last_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_deep_scrub":"25'358","last_deep_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.006561+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:19.809987+0000","scrub_duration":0.0048299759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'245","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.794916+0000","last_change":"2023-10-21T18:28:28.794916+0000","last_active":"2023-10-21T18:28:28.794916+0000","last_peered":"2023-10-21T18:28:28.794916+0000","last_clean":"2023-10-21T18:28:28.794916+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:28:28.794916+0000","last_undegraded":"2023-10-21T18:28:28.794916+0000","last_fullsized":"2023-10-21T18:28:28.794916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'245","last_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_deep_scrub":"25'245","last_deep_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.794791+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.380233+0000","scrub_duration":0.016721482999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'442","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.004406+0000","last_change":"2023-10-21T18:29:04.004451+0000","last_active":"2023-10-21T18:29:04.004406+0000","last_peered":"2023-10-21T18:29:04.004406+0000","last_clean":"2023-10-21T18:29:04.004406+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:29:04.004406+0000","last_undegraded":"2023-10-21T18:29:04.004406+0000","last_fullsized":"2023-10-21T18:29:04.004406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.004313+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:26.807739+0000","scrub_duration":0.0029157160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'367","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.863423+0000","last_change":"2023-10-21T18:28:38.863423+0000","last_active":"2023-10-21T18:28:38.863423+0000","last_peered":"2023-10-21T18:28:38.863423+0000","last_clean":"2023-10-21T18:28:38.863423+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:28:38.863423+0000","last_undegraded":"2023-10-21T18:28:38.863423+0000","last_fullsized":"2023-10-21T18:28:38.863423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'367","last_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_deep_scrub":"25'367","last_deep_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.863261+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:58:19.348721+0000","scrub_duration":0.025519416999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'400","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686742+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:28:24.686742+0000","last_peered":"2023-10-21T18:28:24.686742+0000","last_clean":"2023-10-21T18:28:24.686742+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:28:24.686742+0000","last_undegraded":"2023-10-21T18:28:24.686742+0000","last_fullsized":"2023-10-21T18:28:24.686742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":238,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.997704+0000","last_change":"2023-10-21T18:28:27.997829+0000","last_active":"2023-10-21T18:28:27.997704+0000","last_peered":"2023-10-21T18:28:27.997704+0000","last_clean":"2023-10-21T18:28:27.997704+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:28:27.997704+0000","last_undegraded":"2023-10-21T18:28:27.997704+0000","last_fullsized":"2023-10-21T18:28:27.997704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.997532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:28:43.552482+0000","scrub_duration":0.009368375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'329","reported_seq":411,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.485285+0000","last_change":"2023-10-21T18:28:49.485402+0000","last_active":"2023-10-21T18:28:49.485285+0000","last_peered":"2023-10-21T18:28:49.485285+0000","last_clean":"2023-10-21T18:28:49.485285+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:28:49.485285+0000","last_undegraded":"2023-10-21T18:28:49.485285+0000","last_fullsized":"2023-10-21T18:28:49.485285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'329","last_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_deep_scrub":"25'329","last_deep_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.485085+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:01:12.425342+0000","scrub_duration":0.030119357999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'406","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.048575+0000","last_change":"2023-10-21T18:28:50.048622+0000","last_active":"2023-10-21T18:28:50.048575+0000","last_peered":"2023-10-21T18:28:50.048575+0000","last_clean":"2023-10-21T18:28:50.048575+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:28:50.048575+0000","last_undegraded":"2023-10-21T18:28:50.048575+0000","last_fullsized":"2023-10-21T18:28:50.048575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.048504+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:45.694640+0000","scrub_duration":0.0038304010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'726","reported_seq":809,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.573946+0000","last_change":"2023-10-21T18:28:45.574076+0000","last_active":"2023-10-21T18:28:45.573946+0000","last_peered":"2023-10-21T18:28:45.573946+0000","last_clean":"2023-10-21T18:28:45.573946+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:28:45.573946+0000","last_undegraded":"2023-10-21T18:28:45.573946+0000","last_fullsized":"2023-10-21T18:28:45.573946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'726","last_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_deep_scrub":"25'726","last_deep_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.573759+0000","objects_scrubbed":3,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:35:02.509083+0000","scrub_duration":0.061729854000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'417","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.751201+0000","last_change":"2023-10-21T18:28:51.751288+0000","last_active":"2023-10-21T18:28:51.751201+0000","last_peered":"2023-10-21T18:28:51.751201+0000","last_clean":"2023-10-21T18:28:51.751201+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:51.751201+0000","last_undegraded":"2023-10-21T18:28:51.751201+0000","last_fullsized":"2023-10-21T18:28:51.751201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.751118+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:25.401345+0000","scrub_duration":0.0042027590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3018,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.592629+0000","last_change":"2023-10-21T18:28:34.592678+0000","last_active":"2023-10-21T18:28:34.592629+0000","last_peered":"2023-10-21T18:28:34.592629+0000","last_clean":"2023-10-21T18:28:34.592629+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:34.592629+0000","last_undegraded":"2023-10-21T18:28:34.592629+0000","last_fullsized":"2023-10-21T18:28:34.592629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1496","last_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_deep_scrub":"25'1496","last_deep_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.592545+0000","objects_scrubbed":1,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:50:54.878023+0000","scrub_duration":0.0053032239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'381","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.665936+0000","last_change":"2023-10-21T18:28:37.665972+0000","last_active":"2023-10-21T18:28:37.665936+0000","last_peered":"2023-10-21T18:28:37.665936+0000","last_clean":"2023-10-21T18:28:37.665936+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:37.665936+0000","last_undegraded":"2023-10-21T18:28:37.665936+0000","last_fullsized":"2023-10-21T18:28:37.665936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.665867+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:14.652085+0000","scrub_duration":0.00173624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'394","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:58.665539+0000","last_change":"2023-10-21T18:28:58.665660+0000","last_active":"2023-10-21T18:28:58.665539+0000","last_peered":"2023-10-21T18:28:58.665539+0000","last_clean":"2023-10-21T18:28:58.665539+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:28:58.665539+0000","last_undegraded":"2023-10-21T18:28:58.665539+0000","last_fullsized":"2023-10-21T18:28:58.665539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'394","last_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_deep_scrub":"25'394","last_deep_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_clean_scrub_stamp":"2023-10-21T18:28:58.665360+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:38.030747+0000","scrub_duration":0.038550477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'392","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.062134+0000","last_change":"2023-10-21T18:29:00.062351+0000","last_active":"2023-10-21T18:29:00.062134+0000","last_peered":"2023-10-21T18:29:00.062134+0000","last_clean":"2023-10-21T18:29:00.062134+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:29:00.062134+0000","last_undegraded":"2023-10-21T18:29:00.062134+0000","last_fullsized":"2023-10-21T18:29:00.062134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.061847+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:35.532076+0000","scrub_duration":0.0059602409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'412","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.803226+0000","last_change":"2023-10-21T18:28:27.803298+0000","last_active":"2023-10-21T18:28:27.803226+0000","last_peered":"2023-10-21T18:28:27.803226+0000","last_clean":"2023-10-21T18:28:27.803226+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:28:27.803226+0000","last_undegraded":"2023-10-21T18:28:27.803226+0000","last_fullsized":"2023-10-21T18:28:27.803226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.803157+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:26:58.915015+0000","scrub_duration":0.013419940999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'410","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.790738+0000","last_change":"2023-10-21T18:28:42.790738+0000","last_active":"2023-10-21T18:28:42.790738+0000","last_peered":"2023-10-21T18:28:42.790738+0000","last_clean":"2023-10-21T18:28:42.790738+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:28:42.790738+0000","last_undegraded":"2023-10-21T18:28:42.790738+0000","last_fullsized":"2023-10-21T18:28:42.790738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.790342+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:48:47.994060+0000","scrub_duration":0.0044279569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'588","reported_seq":661,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686327+0000","last_change":"2023-10-21T16:27:30.339912+0000","last_active":"2023-10-21T18:28:24.686327+0000","last_peered":"2023-10-21T18:28:24.686327+0000","last_clean":"2023-10-21T18:28:24.686327+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:28:24.686327+0000","last_undegraded":"2023-10-21T18:28:24.686327+0000","last_fullsized":"2023-10-21T18:28:24.686327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:28.782025+0000","last_clean_scrub_stamp":"2023-10-21T16:27:28.782025+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'377","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.799414+0000","last_change":"2023-10-21T18:28:48.799478+0000","last_active":"2023-10-21T18:28:48.799414+0000","last_peered":"2023-10-21T18:28:48.799414+0000","last_clean":"2023-10-21T18:28:48.799414+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:28:48.799414+0000","last_undegraded":"2023-10-21T18:28:48.799414+0000","last_fullsized":"2023-10-21T18:28:48.799414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'377","last_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_deep_scrub":"25'377","last_deep_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.799323+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:35.602039+0000","scrub_duration":0.002269002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1346","reported_seq":1425,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.973398+0000","last_change":"2023-10-21T18:28:38.973398+0000","last_active":"2023-10-21T18:28:38.973398+0000","last_peered":"2023-10-21T18:28:38.973398+0000","last_clean":"2023-10-21T18:28:38.973398+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:38.973398+0000","last_undegraded":"2023-10-21T18:28:38.973398+0000","last_fullsized":"2023-10-21T18:28:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1346","last_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_deep_scrub":"25'1346","last_deep_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.973260+0000","objects_scrubbed":1,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:12.623488+0000","scrub_duration":0.016535959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3534,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'364","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.154590+0000","last_change":"2023-10-21T18:28:55.154631+0000","last_active":"2023-10-21T18:28:55.154590+0000","last_peered":"2023-10-21T18:28:55.154590+0000","last_clean":"2023-10-21T18:28:55.154590+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:28:55.154590+0000","last_undegraded":"2023-10-21T18:28:55.154590+0000","last_fullsized":"2023-10-21T18:28:55.154590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'364","last_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_deep_scrub":"25'364","last_deep_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.154507+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:25.427604+0000","scrub_duration":0.0015667109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'322","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.530044+0000","last_change":"2023-10-21T18:28:44.530044+0000","last_active":"2023-10-21T18:28:44.530044+0000","last_peered":"2023-10-21T18:28:44.530044+0000","last_clean":"2023-10-21T18:28:44.530044+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:28:44.530044+0000","last_undegraded":"2023-10-21T18:28:44.530044+0000","last_fullsized":"2023-10-21T18:28:44.530044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'322","last_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_deep_scrub":"25'322","last_deep_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.529753+0000","objects_scrubbed":2,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:22:36.717064+0000","scrub_duration":0.032510153999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'463","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.982468+0000","last_change":"2023-10-21T18:28:39.982468+0000","last_active":"2023-10-21T18:28:39.982468+0000","last_peered":"2023-10-21T18:28:39.982468+0000","last_clean":"2023-10-21T18:28:39.982468+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:28:39.982468+0000","last_undegraded":"2023-10-21T18:28:39.982468+0000","last_fullsized":"2023-10-21T18:28:39.982468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'463","last_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_deep_scrub":"25'463","last_deep_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.982361+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:46.690293+0000","scrub_duration":0.0022391640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'262","reported_seq":341,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.764488+0000","last_change":"2023-10-21T18:28:28.764488+0000","last_active":"2023-10-21T18:28:28.764488+0000","last_peered":"2023-10-21T18:28:28.764488+0000","last_clean":"2023-10-21T18:28:28.764488+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:28:28.764488+0000","last_undegraded":"2023-10-21T18:28:28.764488+0000","last_fullsized":"2023-10-21T18:28:28.764488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'262","last_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_deep_scrub":"25'262","last_deep_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.764322+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.349764+0000","scrub_duration":0.017180768999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'421","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.628656+0000","last_change":"2023-10-21T18:28:37.628656+0000","last_active":"2023-10-21T18:28:37.628656+0000","last_peered":"2023-10-21T18:28:37.628656+0000","last_clean":"2023-10-21T18:28:37.628656+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:37.628656+0000","last_undegraded":"2023-10-21T18:28:37.628656+0000","last_fullsized":"2023-10-21T18:28:37.628656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.628358+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:43:36.552484+0000","scrub_duration":0.0042654920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'421","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:33.920158+0000","last_change":"2023-10-21T18:28:33.920158+0000","last_active":"2023-10-21T18:28:33.920158+0000","last_peered":"2023-10-21T18:28:33.920158+0000","last_clean":"2023-10-21T18:28:33.920158+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:28:33.920158+0000","last_undegraded":"2023-10-21T18:28:33.920158+0000","last_fullsized":"2023-10-21T18:28:33.920158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_clean_scrub_stamp":"2023-10-21T18:28:33.919990+0000","objects_scrubbed":1,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:02:20.582216+0000","scrub_duration":0.031339309000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.008047+0000","last_change":"2023-10-21T18:28:46.008047+0000","last_active":"2023-10-21T18:28:46.008047+0000","last_peered":"2023-10-21T18:28:46.008047+0000","last_clean":"2023-10-21T18:28:46.008047+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:46.008047+0000","last_undegraded":"2023-10-21T18:28:46.008047+0000","last_fullsized":"2023-10-21T18:28:46.008047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.007918+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:26.978090+0000","scrub_duration":0.0024174869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1150","reported_seq":1228,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.872881+0000","last_change":"2023-10-21T18:28:35.872930+0000","last_active":"2023-10-21T18:28:35.872881+0000","last_peered":"2023-10-21T18:28:35.872881+0000","last_clean":"2023-10-21T18:28:35.872881+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:28:35.872881+0000","last_undegraded":"2023-10-21T18:28:35.872881+0000","last_fullsized":"2023-10-21T18:28:35.872881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1150","last_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_deep_scrub":"25'1150","last_deep_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.872800+0000","objects_scrubbed":2,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:13.547254+0000","scrub_duration":0.023641031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.375757+0000","last_change":"2023-10-21T18:28:48.375757+0000","last_active":"2023-10-21T18:28:48.375757+0000","last_peered":"2023-10-21T18:28:48.375757+0000","last_clean":"2023-10-21T18:28:48.375757+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:48.375757+0000","last_undegraded":"2023-10-21T18:28:48.375757+0000","last_fullsized":"2023-10-21T18:28:48.375757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.375634+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:27:22.872575+0000","scrub_duration":0.0018102509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1141","reported_seq":1218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.697327+0000","last_change":"2023-10-21T18:29:00.697460+0000","last_active":"2023-10-21T18:29:00.697327+0000","last_peered":"2023-10-21T18:29:00.697327+0000","last_clean":"2023-10-21T18:29:00.697327+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:29:00.697327+0000","last_undegraded":"2023-10-21T18:29:00.697327+0000","last_fullsized":"2023-10-21T18:29:00.697327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1141","last_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_deep_scrub":"25'1141","last_deep_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.697114+0000","objects_scrubbed":4,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:28:47.299927+0000","scrub_duration":0.078786130999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'449","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.960953+0000","last_change":"2023-10-21T16:27:31.916508+0000","last_active":"2023-10-21T18:28:15.960953+0000","last_peered":"2023-10-21T18:28:15.960953+0000","last_clean":"2023-10-21T18:28:15.960953+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:28:15.960953+0000","last_undegraded":"2023-10-21T18:28:15.960953+0000","last_fullsized":"2023-10-21T18:28:15.960953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'451","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959380+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:28:15.959380+0000","last_peered":"2023-10-21T18:28:15.959380+0000","last_clean":"2023-10-21T18:28:15.959380+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:28:15.959380+0000","last_undegraded":"2023-10-21T18:28:15.959380+0000","last_fullsized":"2023-10-21T18:28:15.959380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'767","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.901291+0000","last_change":"2023-10-21T18:28:38.901414+0000","last_active":"2023-10-21T18:28:38.901291+0000","last_peered":"2023-10-21T18:28:38.901291+0000","last_clean":"2023-10-21T18:28:38.901291+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:28:38.901291+0000","last_undegraded":"2023-10-21T18:28:38.901291+0000","last_fullsized":"2023-10-21T18:28:38.901291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'767","last_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_deep_scrub":"25'767","last_deep_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.901093+0000","objects_scrubbed":2,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:45.609026+0000","scrub_duration":0.038403093999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'370","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.970215+0000","last_change":"2023-10-21T18:28:47.970410+0000","last_active":"2023-10-21T18:28:47.970215+0000","last_peered":"2023-10-21T18:28:47.970215+0000","last_clean":"2023-10-21T18:28:47.970215+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:28:47.970215+0000","last_undegraded":"2023-10-21T18:28:47.970215+0000","last_fullsized":"2023-10-21T18:28:47.970215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'370","last_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_deep_scrub":"25'370","last_deep_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.969971+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:19.081829+0000","scrub_duration":0.0057846690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1576","reported_seq":1647,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.953119+0000","last_change":"2023-10-21T18:28:34.953300+0000","last_active":"2023-10-21T18:28:34.953119+0000","last_peered":"2023-10-21T18:28:34.953119+0000","last_clean":"2023-10-21T18:28:34.953119+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:28:34.953119+0000","last_undegraded":"2023-10-21T18:28:34.953119+0000","last_fullsized":"2023-10-21T18:28:34.953119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1576","last_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_deep_scrub":"25'1576","last_deep_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.952989+0000","objects_scrubbed":5,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:40.153808+0000","scrub_duration":0.10868122500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'358","reported_seq":447,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:22.464892+0000","last_change":"2023-10-21T16:27:31.918037+0000","last_active":"2023-10-21T18:28:22.464892+0000","last_peered":"2023-10-21T18:28:22.464892+0000","last_clean":"2023-10-21T18:28:22.464892+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:28:22.464892+0000","last_undegraded":"2023-10-21T18:28:22.464892+0000","last_fullsized":"2023-10-21T18:28:22.464892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'570","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.761823+0000","last_change":"2023-10-21T18:28:30.761864+0000","last_active":"2023-10-21T18:28:30.761823+0000","last_peered":"2023-10-21T18:28:30.761823+0000","last_clean":"2023-10-21T18:28:30.761823+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:28:30.761823+0000","last_undegraded":"2023-10-21T18:28:30.761823+0000","last_fullsized":"2023-10-21T18:28:30.761823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'570","last_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_deep_scrub":"25'570","last_deep_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.761761+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:43.428584+0000","scrub_duration":0.020968085000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'382","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.636179+0000","last_change":"2023-10-21T18:29:03.636219+0000","last_active":"2023-10-21T18:29:03.636179+0000","last_peered":"2023-10-21T18:29:03.636179+0000","last_clean":"2023-10-21T18:29:03.636179+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:29:03.636179+0000","last_undegraded":"2023-10-21T18:29:03.636179+0000","last_fullsized":"2023-10-21T18:29:03.636179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'382","last_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_deep_scrub":"25'382","last_deep_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.636095+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:24:17.188213+0000","scrub_duration":0.0043045710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'611","reported_seq":692,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.955503+0000","last_change":"2023-10-21T18:28:35.955562+0000","last_active":"2023-10-21T18:28:35.955503+0000","last_peered":"2023-10-21T18:28:35.955503+0000","last_clean":"2023-10-21T18:28:35.955503+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:28:35.955503+0000","last_undegraded":"2023-10-21T18:28:35.955503+0000","last_fullsized":"2023-10-21T18:28:35.955503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'611","last_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_deep_scrub":"25'611","last_deep_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.955427+0000","objects_scrubbed":4,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:48.622250+0000","scrub_duration":0.046963560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26357,"ondisk_log_size":26357,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216339300,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24246,"num_write_kb":225038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432678600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23886,"ondisk_log_size":23886,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478205,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0669999999999999,"15min":1.0940000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4850000000000001,"5min":1.704,"15min":2.2519999999999998},"last":1.268},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2390000000000001,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.7629999999999999,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":1.0189999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2749999999999999,"15min":1.274},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.978,"5min":2.25,"15min":2.25},"last":1.077},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8859999999999999,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.4510000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.508,"15min":1.522},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.093,"5min":2.367,"15min":2.367},"last":1.895},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.6669999999999998},"last":1.8360000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2929999999999999,"15min":1.325},"min":{"1min":0.84099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.782},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3480000000000001,"15min":1.373},"min":{"1min":0.877,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9430000000000001,"5min":2.1240000000000001,"15min":2.319},"last":1.4890000000000001}]},{"osd":5,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4379999999999999,"15min":1.4710000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.70099999999999996},"max":{"1min":2.0070000000000001,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":1.615},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4910000000000001,"15min":1.5269999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.395,"5min":2.395,"15min":2.423},"last":1.974}]},{"osd":6,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.514},"min":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.9249999999999998},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.6220000000000001,"15min":1.633},"min":{"1min":0.97899999999999998,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.331,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.772}]},{"osd":7,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.6319999999999999,"15min":1.671},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.496,"5min":2.496,"15min":2.5169999999999999},"last":2.0630000000000002},{"interface":"front","average":{"1min":1.647,"5min":1.6040000000000001,"15min":1.645},"min":{"1min":0.96499999999999997,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.1600000000000001,"5min":2.2400000000000002,"15min":3.0449999999999999},"last":1.9430000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478206,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.0449999999999999},"min":{"1min":0.72599999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.2509999999999999,"5min":1.7430000000000001,"15min":3.153},"last":1.125},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2390000000000001,"15min":1.2250000000000001},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8460000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.94699999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.333,"15min":1.3620000000000001},"min":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.198,"5min":2.198,"15min":2.7480000000000002},"last":1.47},{"interface":"front","average":{"1min":1.246,"5min":1.4510000000000001,"15min":1.4299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.63400000000000001},"max":{"1min":1.9730000000000001,"5min":2.335,"15min":2.621},"last":1.081}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.379,"15min":1.3979999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55400000000000005},"max":{"1min":1.998,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5960000000000001,"15min":1.623},"min":{"1min":1.0640000000000001,"5min":0.873,"15min":0.79600000000000004},"max":{"1min":2.101,"5min":2.3130000000000002,"15min":3.867},"last":1.556}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3260000000000001,"15min":1.3600000000000001},"min":{"1min":0.96099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.889,"5min":2.048,"15min":2.895},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.363,"15min":1.3580000000000001},"min":{"1min":0.755,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8089999999999999,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.3080000000000001}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4570000000000001,"15min":1.4430000000000001},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9850000000000001,"5min":2.2320000000000002,"15min":2.524},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.3680000000000001,"15min":1.355},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.59899999999999998},"max":{"1min":1.706,"5min":2.4100000000000001,"15min":2.7360000000000002},"last":1.349}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.466,"15min":1.4570000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.64400000000000002},"max":{"1min":1.847,"5min":2.3109999999999999,"15min":2.9689999999999999},"last":1.494},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4630000000000001,"15min":1.52},"min":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84099999999999997},"max":{"1min":2.0099999999999998,"5min":2.2690000000000001,"15min":3.0259999999999998},"last":1.272}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6200000000000001,"15min":1.5940000000000001},"min":{"1min":0.79400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1040000000000001,"5min":2.2200000000000002,"15min":2.8029999999999999},"last":1.595},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.591,"15min":1.577},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.622},"max":{"1min":1.982,"5min":2.2010000000000001,"15min":2.8620000000000001},"last":1.1970000000000001}]}]},{"osd":1,"up_from":16,"seq":68719478206,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51979688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.03,"15min":1.0629999999999999},"min":{"1min":0.71299999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.581,"5min":1.9730000000000001,"15min":2.2029999999999998},"last":1.111},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2909999999999999,"15min":1.264},"min":{"1min":0.77600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9330000000000001,"5min":2.0339999999999998,"15min":2.3679999999999999},"last":1.79}]},{"osd":2,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1950000000000001,"15min":1.202},"min":{"1min":0.70099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8939999999999999,"5min":2.2000000000000002,"15min":2.6539999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4139999999999999,"15min":1.4199999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.69699999999999995},"max":{"1min":1.9450000000000001,"5min":2.2650000000000001,"15min":2.5779999999999998},"last":1.2190000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.486,"15min":1.51},"min":{"1min":1.028,"5min":0.95199999999999996,"15min":0.77300000000000002},"max":{"1min":1.8540000000000001,"5min":2.1099999999999999,"15min":2.681},"last":1.48},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.5329999999999999,"15min":1.5469999999999999},"min":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.929,"5min":2.1480000000000001,"15min":2.544},"last":1.8919999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3460000000000001,"15min":1.377},"min":{"1min":0.92600000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6890000000000001,"5min":2.04,"15min":2.3130000000000002},"last":1.329},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.88,"5min":0.84499999999999997,"15min":0.77200000000000002},"max":{"1min":1.6779999999999999,"5min":1.958,"15min":2.1600000000000001},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.482,"15min":1.4830000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8959999999999999,"5min":2.1320000000000001,"15min":2.3610000000000002},"last":1.403},{"interface":"front","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.526},"min":{"1min":0.96299999999999997,"5min":0.91500000000000004,"15min":0.85199999999999998},"max":{"1min":1.8740000000000001,"5min":2.165,"15min":2.6850000000000001},"last":1.6599999999999999}]},{"osd":6,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.54,"15min":1.5329999999999999},"min":{"1min":1.1419999999999999,"5min":0.91500000000000004,"15min":0.83499999999999996},"max":{"1min":1.97,"5min":2.173,"15min":2.5459999999999998},"last":1.595},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.6140000000000001,"15min":1.6220000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.78900000000000003},"max":{"1min":2.04,"5min":2.2799999999999998,"15min":2.5379999999999998},"last":1.538}]},{"osd":7,"last update":"Sat Oct 21 18:28:24 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.669,"15min":1.6779999999999999},"min":{"1min":1.2809999999999999,"5min":1.085,"15min":1.0469999999999999},"max":{"1min":2,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.696,"15min":1.6970000000000001},"min":{"1min":1.2130000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.052,"5min":2.4649999999999999,"15min":3.0030000000000001},"last":1.698}]}]},{"osd":0,"up_from":16,"seq":68719478207,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84943738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.115,"15min":1.0960000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8759999999999999,"5min":2.0150000000000001,"15min":2.04},"last":1.353},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2370000000000001,"15min":1.2609999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.881,"5min":2.0539999999999998,"15min":2.161},"last":1.593}]},{"osd":2,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2470000000000001,"15min":1.296},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.60599999999999998},"max":{"1min":1.643,"5min":1.95,"15min":2.3820000000000001},"last":1.006},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3999999999999999,"15min":1.427},"min":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.992,"5min":2.1219999999999999,"15min":2.5550000000000002},"last":1.1160000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.462,"15min":1.4670000000000001},"min":{"1min":0.81100000000000005,"5min":0.73499999999999999,"15min":0.53500000000000003},"max":{"1min":2.2269999999999999,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.502,"15min":1.5149999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9670000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.391}]},{"osd":4,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.345,"15min":1.367},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8089999999999999,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3260000000000001,"15min":1.337},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.1600000000000001},"last":1.1970000000000001}]},{"osd":5,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.377,"15min":1.4119999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.012,"5min":2.0880000000000001,"15min":2.3420000000000001},"last":1.254},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.52,"15min":1.5329999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1669999999999998,"5min":2.597,"15min":2.7370000000000001},"last":1.054}]},{"osd":6,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.413,"15min":1.478},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.181,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.5329999999999999,"15min":1.556},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.2480000000000002,"5min":2.3149999999999999,"15min":2.4220000000000002},"last":1.4119999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6080000000000001,"15min":1.6739999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.5249999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.647,"15min":1.6879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3839999999999999,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":1.4670000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.752,"15min":0.745},"min":{"1min":0.432,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.097,"5min":1.224,"15min":1.224},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.079,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96299999999999997,"5min":1.395,"15min":1.395},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.5069999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.76100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.085,"5min":1.1120000000000001,"15min":2.1840000000000002},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.05,"5min":1.2450000000000001,"15min":1.321},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1850000000000001,"15min":1.327},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.82699999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.67100000000000004,"15min":0.69999999999999996},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41899999999999998,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.64300000000000002,"15min":0.76200000000000001},"last":0.377},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29499999999999998},"max":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.439}]},{"osd":7,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.60599999999999998,"5min":0.70099999999999996,"15min":0.85699999999999998},"last":0.48599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424510909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114532,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257308,"statfs":{"total":96636764160,"available":96519483392,"internally_reserved":0,"allocated":52654080,"data_stored":52476546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.05,"5min":1.2,"15min":1.212},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.75},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42399999999999999},"max":{"1min":1.101,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":1.105,"5min":1.2549999999999999,"15min":1.554},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0489999999999999,"15min":1.419},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.264,"15min":1.3069999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2250000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.79900000000000004},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.518},"last":1.02},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.51200000000000001,"5min":0.503,"15min":0.45400000000000001},"max":{"1min":1.115,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.67500000000000004},"last":0.36599999999999999}]},{"osd":6,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.443},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.42199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424510909,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.093,"5min":1.097,"15min":1.349},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.754},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97599999999999998,"5min":1.2929999999999999,"15min":1.355},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.77700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.429},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.075,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.435,"15min":0.432},"max":{"1min":1.2509999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.349},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0940000000000001,"5min":1.2869999999999999,"15min":1.361},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.80800000000000005},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.23,"5min":1.893,"15min":1.893},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.68400000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.437,"15min":0.45300000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.34599999999999997}]},{"osd":6,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58999999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.32000000000000001,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.375}]},{"osd":7,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.77700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.30299999999999999},"max":{"1min":0.69899999999999995,"5min":0.72399999999999998,"15min":0.81499999999999995},"last":0.35699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129543612,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.234},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":1.0760000000000001,"5min":1.159,"15min":1.2290000000000001},"last":1.054}]},{"osd":1,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.0800000000000001,"5min":1.214,"15min":1.2210000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.98299999999999998}]},{"osd":2,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.347},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.208,"5min":1.208,"15min":1.3049999999999999},"last":0.94499999999999995}]},{"osd":3,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.333,"15min":1.333},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.23100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.435}]},{"osd":5,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.432,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 21 18:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51297463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:29:11.742 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.743 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.743 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.743 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.744 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.744 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.745 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.745 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.745 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.746 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.746 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.746 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.747 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-21T16:27:28.782025+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=28, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.747 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.747 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.748 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:11.748 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-21T18:29:29.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:29:29.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:29:31.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:29:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.971+0000 7f8a21f0c640 1 Processor -- start 2023-10-21T18:29:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.971+0000 7f8a21f0c640 1 -- start start 2023-10-21T18:29:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.974+0000 7f8a21f0c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8a1c156680 0x7f8a1c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.974+0000 7f8a21f0c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.975+0000 7f8a21f0c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c0c7700 con 0x7f8a1c0c7150 2023-10-21T18:29:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.975+0000 7f8a21f0c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0c9020 con 0x7f8a1c156680 2023-10-21T18:29:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.975+0000 7f8a21f0c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06b9a0 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.975+0000 7f8a1bfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8a1c0c7150 0x7f8a1c15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:54718/0 (socket says 172.21.15.12:54718) 2023-10-21T18:29:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.976+0000 7f8a1bfff640 1 -- 172.21.15.12:0/3525509516 learned_addr learned my addr 172.21.15.12:0/3525509516 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.976+0000 7f8a1affd640 1 --2- 172.21.15.12:0/3525509516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1a7fc640 1 -- 172.21.15.12:0/3525509516 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629972117 0 0) 0x7f8a1c0c7700 con 0x7f8a1c0c7150 2023-10-21T18:29:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1a7fc640 1 -- 172.21.15.12:0/3525509516 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a04003520 con 0x7f8a1c0c7150 2023-10-21T18:29:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1affd640 1 -- 172.21.15.12:0/3525509516 >> v2:172.21.15.12:3300/0 conn(0x7f8a1c156680 msgr2=0x7f8a1c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1affd640 1 --2- 172.21.15.12:0/3525509516 >> v2:172.21.15.12:3300/0 conn(0x7f8a1c156680 0x7f8a1c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1affd640 1 -- 172.21.15.12:0/3525509516 >> v1:172.21.15.99:6789/0 conn(0x7f8a1c0c7150 legacy=0x7f8a1c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.978+0000 7f8a1affd640 1 -- 172.21.15.12:0/3525509516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c06bc80 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.980+0000 7f8a1affd640 1 --2- 172.21.15.12:0/3525509516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0c8290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a100097a0 tx=0x7f8a1002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e731fa28e7790a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:31.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.984+0000 7f8a1a7fc640 1 -- 172.21.15.12:0/3525509516 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10030800 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.984+0000 7f8a1a7fc640 1 -- 172.21.15.12:0/3525509516 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10030960 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.984+0000 7f8a1a7fc640 1 -- 172.21.15.12:0/3525509516 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10030cf0 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.985+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3525509516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 msgr2=0x7f8a1c0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.985+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3525509516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0c8290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a100097a0 tx=0x7f8a1002b940 comp rx=0 tx=0).stop 2023-10-21T18:29:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3525509516 shutdown_connections 2023-10-21T18:29:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3525509516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0c8290 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3525509516 >> v2:172.21.15.12:3300/0 conn(0x7f8a1c156680 0x7f8a1c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:31.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3525509516 >> 172.21.15.12:0/3525509516 conn(0x7f8a1c065ab0 msgr2=0x7f8a1c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:31.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3525509516 shutdown_connections 2023-10-21T18:29:31.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.986+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3525509516 wait complete. 2023-10-21T18:29:31.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.989+0000 7f8a21f0c640 1 Processor -- start 2023-10-21T18:29:31.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.990+0000 7f8a21f0c640 1 -- start start 2023-10-21T18:29:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 0x7f8a1c0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0cb9d0 con 0x7f8a1c0c9bf0 2023-10-21T18:29:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c1f2ae0 con 0x7f8a1c156680 2023-10-21T18:29:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.991+0000 7f8a21f0c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b1170 con 0x7f8a1c0c7150 2023-10-21T18:29:31.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.992+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.992+0000 7f8a1b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 0x7f8a1c0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.992+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:42300/0 (socket says 172.21.15.12:42300) 2023-10-21T18:29:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.992+0000 7f8a1b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 0x7f8a1c0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:41930/0 (socket says 172.21.15.12:41930) 2023-10-21T18:29:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.992+0000 7f8a1bfff640 1 -- 172.21.15.12:0/3016690153 learned_addr learned my addr 172.21.15.12:0/3016690153 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.995+0000 7f8a1affd640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.996+0000 7f8a1bfff640 1 -- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 msgr2=0x7f8a1c0cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.996+0000 7f8a1bfff640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 0x7f8a1c0cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.996+0000 7f8a1bfff640 1 -- 172.21.15.12:0/3016690153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a1c0c9bf0 msgr2=0x7f8a1c0af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.996+0000 7f8a1bfff640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.996+0000 7f8a1bfff640 1 -- 172.21.15.12:0/3016690153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009400 con 0x7f8a1c156680 2023-10-21T18:29:31.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:31.998+0000 7f8a1bfff640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400caa0 tx=0x7f8a1400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.002+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400ab40 con 0x7f8a1c156680 2023-10-21T18:29:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.002+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400aca0 con 0x7f8a1c156680 2023-10-21T18:29:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.002+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14012620 con 0x7f8a1c156680 2023-10-21T18:29:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.002+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c1f2d60 con 0x7f8a1c156680 2023-10-21T18:29:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.002+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c0b13c0 con 0x7f8a1c156680 2023-10-21T18:29:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.004+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c06cc30 con 0x7f8a1c156680 2023-10-21T18:29:32.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.024+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a14007070 con 0x7f8a1c156680 2023-10-21T18:29:32.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.024+0000 7f8a03fff640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 0x7f8a0806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:32.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.025+0000 7f8a1b7fe640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 0x7f8a0806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:32.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.025+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8a14013e70 con 0x7f8a1c156680 2023-10-21T18:29:32.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.026+0000 7f8a1b7fe640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 0x7f8a0806d380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009990 tx=0x7f8a0c009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.259+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a14054a30 con 0x7f8a1c156680 2023-10-21T18:29:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.460+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a1c06c240 con 0x7f8a0806aec0 2023-10-21T18:29:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.469+0000 7f8a03fff640 1 -- 172.21.15.12:0/3016690153 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291676 (secure 0 0 0) 0x7f8a0c00e850 con 0x7f8a0806aec0 2023-10-21T18:29:32.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:32.476 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:29:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 msgr2=0x7f8a0806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 0x7f8a0806d380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009990 tx=0x7f8a0c009110 comp rx=0 tx=0).stop 2023-10-21T18:29:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 msgr2=0x7f8a1c1f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400caa0 tx=0x7f8a1400cea0 comp rx=0 tx=0).stop 2023-10-21T18:29:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 shutdown_connections 2023-10-21T18:29:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f8a0806aec0 0x7f8a0806d380 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a1c156680 0x7f8a1c1f31f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a1c0c9bf0 0x7f8a1c0af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 --2- 172.21.15.12:0/3016690153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1c0c7150 0x7f8a1c0cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 >> 172.21.15.12:0/3016690153 conn(0x7f8a1c065ab0 msgr2=0x7f8a1c15be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 shutdown_connections 2023-10-21T18:29:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:32.477+0000 7f8a21f0c640 1 -- 172.21.15.12:0/3016690153 wait complete. 2023-10-21T18:29:32.500 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3693,"stamp":"2023-10-21T18:29:31.152642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216929668,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48793,"num_write_kb":4575230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50364,"ondisk_log_size":50364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":945872,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754028848,"statfs":{"total":773094113280,"available":772125540352,"internally_reserved":0,"allocated":435961856,"data_stored":434594192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":532532794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003253"},"pg_stats":[{"pgid":"3.3f","version":"25'409","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.035326+0000","last_change":"2023-10-21T18:29:04.035506+0000","last_active":"2023-10-21T18:29:04.035326+0000","last_peered":"2023-10-21T18:29:04.035326+0000","last_clean":"2023-10-21T18:29:04.035326+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:29:04.035326+0000","last_undegraded":"2023-10-21T18:29:04.035326+0000","last_fullsized":"2023-10-21T18:29:04.035326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.035110+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:43.400496+0000","scrub_duration":0.0043130260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'423","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.690490+0000","last_change":"2023-10-21T18:28:49.690534+0000","last_active":"2023-10-21T18:28:49.690490+0000","last_peered":"2023-10-21T18:28:49.690490+0000","last_clean":"2023-10-21T18:28:49.690490+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:28:49.690490+0000","last_undegraded":"2023-10-21T18:28:49.690490+0000","last_fullsized":"2023-10-21T18:28:49.690490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.690405+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:04.270503+0000","scrub_duration":0.0026678240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'376","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.660584+0000","last_change":"2023-10-21T18:28:46.660627+0000","last_active":"2023-10-21T18:28:46.660584+0000","last_peered":"2023-10-21T18:28:46.660584+0000","last_clean":"2023-10-21T18:28:46.660584+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:28:46.660584+0000","last_undegraded":"2023-10-21T18:28:46.660584+0000","last_fullsized":"2023-10-21T18:28:46.660584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'376","last_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_deep_scrub":"25'376","last_deep_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.660492+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:04:09.387985+0000","scrub_duration":0.0021392680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'405","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:31.943133+0000","last_change":"2023-10-21T18:28:31.943357+0000","last_active":"2023-10-21T18:28:31.943133+0000","last_peered":"2023-10-21T18:28:31.943133+0000","last_clean":"2023-10-21T18:28:31.943133+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:28:31.943133+0000","last_undegraded":"2023-10-21T18:28:31.943133+0000","last_fullsized":"2023-10-21T18:28:31.943133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_clean_scrub_stamp":"2023-10-21T18:28:31.942864+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:39.601766+0000","scrub_duration":0.0053496380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:07.385082+0000","last_change":"2023-10-21T18:29:07.385121+0000","last_active":"2023-10-21T18:29:07.385082+0000","last_peered":"2023-10-21T18:29:07.385082+0000","last_clean":"2023-10-21T18:29:07.385082+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:29:07.385082+0000","last_undegraded":"2023-10-21T18:29:07.385082+0000","last_fullsized":"2023-10-21T18:29:07.385082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:29:07.384998+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:29:07.384998+0000","last_clean_scrub_stamp":"2023-10-21T18:29:07.384998+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:08:56.752861+0000","scrub_duration":0.0018450140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'388","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.874884+0000","last_change":"2023-10-21T18:28:29.874962+0000","last_active":"2023-10-21T18:28:29.874884+0000","last_peered":"2023-10-21T18:28:29.874884+0000","last_clean":"2023-10-21T18:28:29.874884+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:28:29.874884+0000","last_undegraded":"2023-10-21T18:28:29.874884+0000","last_fullsized":"2023-10-21T18:28:29.874884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'388","last_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_deep_scrub":"25'388","last_deep_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.874757+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:03:33.858731+0000","scrub_duration":0.0039421550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'407","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826595+0000","last_change":"2023-10-21T18:28:43.826713+0000","last_active":"2023-10-21T18:28:43.826595+0000","last_peered":"2023-10-21T18:28:43.826595+0000","last_clean":"2023-10-21T18:28:43.826595+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:28:43.826595+0000","last_undegraded":"2023-10-21T18:28:43.826595+0000","last_fullsized":"2023-10-21T18:28:43.826595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'407","last_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_deep_scrub":"25'407","last_deep_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826446+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:06:26.675534+0000","scrub_duration":0.0042928150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'384","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:10.554677+0000","last_change":"2023-10-21T18:29:10.554716+0000","last_active":"2023-10-21T18:29:10.554677+0000","last_peered":"2023-10-21T18:29:10.554677+0000","last_clean":"2023-10-21T18:29:10.554677+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:29:10.554677+0000","last_undegraded":"2023-10-21T18:29:10.554677+0000","last_fullsized":"2023-10-21T18:29:10.554677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'384","last_scrub_stamp":"2023-10-21T18:29:10.554593+0000","last_deep_scrub":"25'384","last_deep_scrub_stamp":"2023-10-21T18:29:10.554593+0000","last_clean_scrub_stamp":"2023-10-21T18:29:10.554593+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:24:21.176505+0000","scrub_duration":0.003743213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'428","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.034040+0000","last_change":"2023-10-21T18:28:45.034149+0000","last_active":"2023-10-21T18:28:45.034040+0000","last_peered":"2023-10-21T18:28:45.034040+0000","last_clean":"2023-10-21T18:28:45.034040+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:28:45.034040+0000","last_undegraded":"2023-10-21T18:28:45.034040+0000","last_fullsized":"2023-10-21T18:28:45.034040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.033874+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:46.708217+0000","scrub_duration":0.0047872369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.942804+0000","last_change":"2023-10-21T18:28:51.942932+0000","last_active":"2023-10-21T18:28:51.942804+0000","last_peered":"2023-10-21T18:28:51.942804+0000","last_clean":"2023-10-21T18:28:51.942804+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:28:51.942804+0000","last_undegraded":"2023-10-21T18:28:51.942804+0000","last_fullsized":"2023-10-21T18:28:51.942804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.942622+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:22.215720+0000","scrub_duration":0.0057898489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'366","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.906474+0000","last_change":"2023-10-21T18:28:50.906600+0000","last_active":"2023-10-21T18:28:50.906474+0000","last_peered":"2023-10-21T18:28:50.906474+0000","last_clean":"2023-10-21T18:28:50.906474+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:28:50.906474+0000","last_undegraded":"2023-10-21T18:28:50.906474+0000","last_fullsized":"2023-10-21T18:28:50.906474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.906355+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:06:07.160796+0000","scrub_duration":0.0040660480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'373","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:01.057082+0000","last_change":"2023-10-21T18:29:01.057312+0000","last_active":"2023-10-21T18:29:01.057082+0000","last_peered":"2023-10-21T18:29:01.057082+0000","last_clean":"2023-10-21T18:29:01.057082+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:29:01.057082+0000","last_undegraded":"2023-10-21T18:29:01.057082+0000","last_fullsized":"2023-10-21T18:29:01.057082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'373","last_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_deep_scrub":"25'373","last_deep_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_clean_scrub_stamp":"2023-10-21T18:29:01.056873+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:26:06.772053+0000","scrub_duration":0.0065493540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'411","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826664+0000","last_change":"2023-10-21T18:28:43.826723+0000","last_active":"2023-10-21T18:28:43.826664+0000","last_peered":"2023-10-21T18:28:43.826664+0000","last_clean":"2023-10-21T18:28:43.826664+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:28:43.826664+0000","last_undegraded":"2023-10-21T18:28:43.826664+0000","last_fullsized":"2023-10-21T18:28:43.826664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826560+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:06.412002+0000","scrub_duration":0.0035619480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'409","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.746951+0000","last_change":"2023-10-21T18:28:52.746951+0000","last_active":"2023-10-21T18:28:52.746951+0000","last_peered":"2023-10-21T18:28:52.746951+0000","last_clean":"2023-10-21T18:28:52.746951+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:28:52.746951+0000","last_undegraded":"2023-10-21T18:28:52.746951+0000","last_fullsized":"2023-10-21T18:28:52.746951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.746784+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:59.454717+0000","scrub_duration":0.002219937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'429","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.699387+0000","last_change":"2023-10-21T18:28:36.699387+0000","last_active":"2023-10-21T18:28:36.699387+0000","last_peered":"2023-10-21T18:28:36.699387+0000","last_clean":"2023-10-21T18:28:36.699387+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:28:36.699387+0000","last_undegraded":"2023-10-21T18:28:36.699387+0000","last_fullsized":"2023-10-21T18:28:36.699387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.699278+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:43.407211+0000","scrub_duration":0.0042182460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'427","reported_seq":526,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.578932+0000","last_change":"2023-10-21T18:28:35.578932+0000","last_active":"2023-10-21T18:28:35.578932+0000","last_peered":"2023-10-21T18:28:35.578932+0000","last_clean":"2023-10-21T18:28:35.578932+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:28:35.578932+0000","last_undegraded":"2023-10-21T18:28:35.578932+0000","last_fullsized":"2023-10-21T18:28:35.578932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.578584+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:31.224721+0000","scrub_duration":0.0053980649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'462","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:18.605885+0000","last_change":"2023-10-21T18:29:18.606001+0000","last_active":"2023-10-21T18:29:18.605885+0000","last_peered":"2023-10-21T18:29:18.605885+0000","last_clean":"2023-10-21T18:29:18.605885+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:29:18.605885+0000","last_undegraded":"2023-10-21T18:29:18.605885+0000","last_fullsized":"2023-10-21T18:29:18.605885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'462","last_scrub_stamp":"2023-10-21T18:29:18.605674+0000","last_deep_scrub":"25'462","last_deep_scrub_stamp":"2023-10-21T18:29:18.605674+0000","last_clean_scrub_stamp":"2023-10-21T18:29:18.605674+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:24:54.510094+0000","scrub_duration":0.0056319500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:53.416169+0000","last_change":"2023-10-21T18:28:53.416216+0000","last_active":"2023-10-21T18:28:53.416169+0000","last_peered":"2023-10-21T18:28:53.416169+0000","last_clean":"2023-10-21T18:28:53.416169+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:53.416169+0000","last_undegraded":"2023-10-21T18:28:53.416169+0000","last_fullsized":"2023-10-21T18:28:53.416169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:53.416093+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:19.552816+0000","scrub_duration":0.0043137169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'404","reported_seq":480,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686918+0000","last_change":"2023-10-21T16:27:31.915642+0000","last_active":"2023-10-21T18:28:24.686918+0000","last_peered":"2023-10-21T18:28:24.686918+0000","last_clean":"2023-10-21T18:28:24.686918+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:28:24.686918+0000","last_undegraded":"2023-10-21T18:28:24.686918+0000","last_fullsized":"2023-10-21T18:28:24.686918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:07.070807+0000","last_change":"2023-10-21T18:29:07.070919+0000","last_active":"2023-10-21T18:29:07.070807+0000","last_peered":"2023-10-21T18:29:07.070807+0000","last_clean":"2023-10-21T18:29:07.070807+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:29:07.070807+0000","last_undegraded":"2023-10-21T18:29:07.070807+0000","last_fullsized":"2023-10-21T18:29:07.070807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_clean_scrub_stamp":"2023-10-21T18:29:07.070615+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:29:27.871808+0000","scrub_duration":0.0054759869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'400","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.966366+0000","last_change":"2023-10-21T18:28:42.966366+0000","last_active":"2023-10-21T18:28:42.966366+0000","last_peered":"2023-10-21T18:28:42.966366+0000","last_clean":"2023-10-21T18:28:42.966366+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:28:42.966366+0000","last_undegraded":"2023-10-21T18:28:42.966366+0000","last_fullsized":"2023-10-21T18:28:42.966366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'400","last_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_deep_scrub":"25'400","last_deep_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.966240+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:19.952458+0000","scrub_duration":0.0031400999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'449","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.941449+0000","last_change":"2023-10-21T18:28:36.941449+0000","last_active":"2023-10-21T18:28:36.941449+0000","last_peered":"2023-10-21T18:28:36.941449+0000","last_clean":"2023-10-21T18:28:36.941449+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:28:36.941449+0000","last_undegraded":"2023-10-21T18:28:36.941449+0000","last_fullsized":"2023-10-21T18:28:36.941449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.941104+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:44.600005+0000","scrub_duration":0.006421108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:05.555080+0000","last_change":"2023-10-21T18:29:05.555176+0000","last_active":"2023-10-21T18:29:05.555080+0000","last_peered":"2023-10-21T18:29:05.555080+0000","last_clean":"2023-10-21T18:29:05.555080+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:29:05.555080+0000","last_undegraded":"2023-10-21T18:29:05.555080+0000","last_fullsized":"2023-10-21T18:29:05.555080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_clean_scrub_stamp":"2023-10-21T18:29:05.554977+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:28.358403+0000","scrub_duration":0.0040465589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'412","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.584402+0000","last_change":"2023-10-21T18:28:36.584402+0000","last_active":"2023-10-21T18:28:36.584402+0000","last_peered":"2023-10-21T18:28:36.584402+0000","last_clean":"2023-10-21T18:28:36.584402+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:36.584402+0000","last_undegraded":"2023-10-21T18:28:36.584402+0000","last_fullsized":"2023-10-21T18:28:36.584402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.584058+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:42:57.833730+0000","scrub_duration":0.0042012220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'408","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:22.661182+0000","last_change":"2023-10-21T18:29:22.661229+0000","last_active":"2023-10-21T18:29:22.661182+0000","last_peered":"2023-10-21T18:29:22.661182+0000","last_clean":"2023-10-21T18:29:22.661182+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:29:22.661182+0000","last_undegraded":"2023-10-21T18:29:22.661182+0000","last_fullsized":"2023-10-21T18:29:22.661182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2023-10-21T18:29:22.661100+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2023-10-21T18:29:22.661100+0000","last_clean_scrub_stamp":"2023-10-21T18:29:22.661100+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:22:20.716242+0000","scrub_duration":0.0037799209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'487","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.855941+0000","last_change":"2023-10-21T18:28:46.855941+0000","last_active":"2023-10-21T18:28:46.855941+0000","last_peered":"2023-10-21T18:28:46.855941+0000","last_clean":"2023-10-21T18:28:46.855941+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:28:46.855941+0000","last_undegraded":"2023-10-21T18:28:46.855941+0000","last_fullsized":"2023-10-21T18:28:46.855941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'487","last_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_deep_scrub":"25'487","last_deep_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.855612+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:29:17.471747+0000","scrub_duration":0.0054321940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'417","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.740068+0000","last_change":"2023-10-21T18:28:55.740104+0000","last_active":"2023-10-21T18:28:55.740068+0000","last_peered":"2023-10-21T18:28:55.740068+0000","last_clean":"2023-10-21T18:28:55.740068+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:28:55.740068+0000","last_undegraded":"2023-10-21T18:28:55.740068+0000","last_fullsized":"2023-10-21T18:28:55.740068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.740003+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:54.707531+0000","scrub_duration":0.0020128619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'406","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.820012+0000","last_change":"2023-10-21T18:28:57.820057+0000","last_active":"2023-10-21T18:28:57.820012+0000","last_peered":"2023-10-21T18:28:57.820012+0000","last_clean":"2023-10-21T18:28:57.820012+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:28:57.820012+0000","last_undegraded":"2023-10-21T18:28:57.820012+0000","last_fullsized":"2023-10-21T18:28:57.820012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.819933+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:38.790104+0000","scrub_duration":0.0044187219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'398","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:06.580335+0000","last_change":"2023-10-21T18:29:06.580377+0000","last_active":"2023-10-21T18:29:06.580335+0000","last_peered":"2023-10-21T18:29:06.580335+0000","last_clean":"2023-10-21T18:29:06.580335+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:29:06.580335+0000","last_undegraded":"2023-10-21T18:29:06.580335+0000","last_fullsized":"2023-10-21T18:29:06.580335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_clean_scrub_stamp":"2023-10-21T18:29:06.580250+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:42.050479+0000","scrub_duration":0.0021721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'469","reported_seq":564,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.465244+0000","last_change":"2023-10-21T16:27:31.910808+0000","last_active":"2023-10-21T18:28:24.465244+0000","last_peered":"2023-10-21T18:28:24.465244+0000","last_clean":"2023-10-21T18:28:24.465244+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:28:24.465244+0000","last_undegraded":"2023-10-21T18:28:24.465244+0000","last_fullsized":"2023-10-21T18:28:24.465244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.523209+0000","last_change":"2023-10-21T18:28:42.523252+0000","last_active":"2023-10-21T18:28:42.523209+0000","last_peered":"2023-10-21T18:28:42.523209+0000","last_clean":"2023-10-21T18:28:42.523209+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:42.523209+0000","last_undegraded":"2023-10-21T18:28:42.523209+0000","last_fullsized":"2023-10-21T18:28:42.523209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'457","last_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_deep_scrub":"25'457","last_deep_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.523122+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:34.806713+0000","scrub_duration":0.003821732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'423","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.898803+0000","last_change":"2023-10-21T18:28:30.898913+0000","last_active":"2023-10-21T18:28:30.898803+0000","last_peered":"2023-10-21T18:28:30.898803+0000","last_clean":"2023-10-21T18:28:30.898803+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:28:30.898803+0000","last_undegraded":"2023-10-21T18:28:30.898803+0000","last_fullsized":"2023-10-21T18:28:30.898803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.898643+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:43:54.121212+0000","scrub_duration":0.004221242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'417","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.983813+0000","last_change":"2023-10-21T18:28:30.983860+0000","last_active":"2023-10-21T18:28:30.983813+0000","last_peered":"2023-10-21T18:28:30.983813+0000","last_clean":"2023-10-21T18:28:30.983813+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:28:30.983813+0000","last_undegraded":"2023-10-21T18:28:30.983813+0000","last_fullsized":"2023-10-21T18:28:30.983813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.983725+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:00:54.743691+0000","scrub_duration":0.0040209740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'223","reported_seq":294,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.693077+0000","last_change":"2023-10-21T18:28:35.693118+0000","last_active":"2023-10-21T18:28:35.693077+0000","last_peered":"2023-10-21T18:28:35.693077+0000","last_clean":"2023-10-21T18:28:35.693077+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:28:35.693077+0000","last_undegraded":"2023-10-21T18:28:35.693077+0000","last_fullsized":"2023-10-21T18:28:35.693077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'223","last_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_deep_scrub":"25'223","last_deep_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.693006+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:26.846010+0000","scrub_duration":0.011849706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'378","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.110876+0000","last_change":"2023-10-21T18:28:52.110911+0000","last_active":"2023-10-21T18:28:52.110876+0000","last_peered":"2023-10-21T18:28:52.110876+0000","last_clean":"2023-10-21T18:28:52.110876+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:28:52.110876+0000","last_undegraded":"2023-10-21T18:28:52.110876+0000","last_fullsized":"2023-10-21T18:28:52.110876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'378","last_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_deep_scrub":"25'378","last_deep_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.110809+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:11:36.694729+0000","scrub_duration":0.0036171549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1321","reported_seq":1392,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.687023+0000","last_change":"2023-10-21T18:29:03.687154+0000","last_active":"2023-10-21T18:29:03.687023+0000","last_peered":"2023-10-21T18:29:03.687023+0000","last_clean":"2023-10-21T18:29:03.687023+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:29:03.687023+0000","last_undegraded":"2023-10-21T18:29:03.687023+0000","last_fullsized":"2023-10-21T18:29:03.687023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1321","last_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_deep_scrub":"25'1321","last_deep_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.686852+0000","objects_scrubbed":4,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:32:23.455573+0000","scrub_duration":0.107670841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'776","reported_seq":849,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.858788+0000","last_change":"2023-10-21T18:28:36.858788+0000","last_active":"2023-10-21T18:28:36.858788+0000","last_peered":"2023-10-21T18:28:36.858788+0000","last_clean":"2023-10-21T18:28:36.858788+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:28:36.858788+0000","last_undegraded":"2023-10-21T18:28:36.858788+0000","last_fullsized":"2023-10-21T18:28:36.858788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'776","last_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_deep_scrub":"25'776","last_deep_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.858682+0000","objects_scrubbed":1,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:38.533026+0000","scrub_duration":0.035982591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'464","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:11.563173+0000","last_change":"2023-10-21T18:29:11.563241+0000","last_active":"2023-10-21T18:29:11.563173+0000","last_peered":"2023-10-21T18:29:11.563173+0000","last_clean":"2023-10-21T18:29:11.563173+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:29:11.563173+0000","last_undegraded":"2023-10-21T18:29:11.563173+0000","last_fullsized":"2023-10-21T18:29:11.563173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'464","last_scrub_stamp":"2023-10-21T18:29:11.563095+0000","last_deep_scrub":"25'464","last_deep_scrub_stamp":"2023-10-21T18:29:11.563095+0000","last_clean_scrub_stamp":"2023-10-21T18:29:11.563095+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:15:51.661868+0000","scrub_duration":0.0023160500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'907","reported_seq":980,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.562864+0000","last_change":"2023-10-21T18:28:47.563062+0000","last_active":"2023-10-21T18:28:47.562864+0000","last_peered":"2023-10-21T18:28:47.562864+0000","last_clean":"2023-10-21T18:28:47.562864+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:28:47.562864+0000","last_undegraded":"2023-10-21T18:28:47.562864+0000","last_fullsized":"2023-10-21T18:28:47.562864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'907","last_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_deep_scrub":"25'907","last_deep_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.562685+0000","objects_scrubbed":3,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:36:48.077046+0000","scrub_duration":0.083295784999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'415","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:54.115025+0000","last_change":"2023-10-21T18:28:54.115025+0000","last_active":"2023-10-21T18:28:54.115025+0000","last_peered":"2023-10-21T18:28:54.115025+0000","last_clean":"2023-10-21T18:28:54.115025+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:28:54.115025+0000","last_undegraded":"2023-10-21T18:28:54.115025+0000","last_fullsized":"2023-10-21T18:28:54.115025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'415","last_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_deep_scrub":"25'415","last_deep_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:54.114810+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:43.902447+0000","scrub_duration":0.0042339600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.944245+0000","last_change":"2023-10-21T18:28:28.944434+0000","last_active":"2023-10-21T18:28:28.944245+0000","last_peered":"2023-10-21T18:28:28.944245+0000","last_clean":"2023-10-21T18:28:28.944245+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:28:28.944245+0000","last_undegraded":"2023-10-21T18:28:28.944245+0000","last_fullsized":"2023-10-21T18:28:28.944245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.944008+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:47:21.203623+0000","scrub_duration":0.0041208629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'419","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.845991+0000","last_change":"2023-10-21T18:28:45.846105+0000","last_active":"2023-10-21T18:28:45.845991+0000","last_peered":"2023-10-21T18:28:45.845991+0000","last_clean":"2023-10-21T18:28:45.845991+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:28:45.845991+0000","last_undegraded":"2023-10-21T18:28:45.845991+0000","last_fullsized":"2023-10-21T18:28:45.845991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'419","last_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_deep_scrub":"25'419","last_deep_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.845733+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:45:21.778624+0000","scrub_duration":0.0052853249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1390","reported_seq":1463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.894216+0000","last_change":"2023-10-21T18:28:36.894345+0000","last_active":"2023-10-21T18:28:36.894216+0000","last_peered":"2023-10-21T18:28:36.894216+0000","last_clean":"2023-10-21T18:28:36.894216+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:36.894216+0000","last_undegraded":"2023-10-21T18:28:36.894216+0000","last_fullsized":"2023-10-21T18:28:36.894216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1390","last_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_deep_scrub":"25'1390","last_deep_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.894015+0000","objects_scrubbed":4,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:10.544242+0000","scrub_duration":0.093137905000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13548657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1323,"num_write_kb":13905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'410","reported_seq":510,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:24.612586+0000","last_change":"2023-10-21T18:29:24.612629+0000","last_active":"2023-10-21T18:29:24.612586+0000","last_peered":"2023-10-21T18:29:24.612586+0000","last_clean":"2023-10-21T18:29:24.612586+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:29:24.612586+0000","last_undegraded":"2023-10-21T18:29:24.612586+0000","last_fullsized":"2023-10-21T18:29:24.612586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:29:24.612510+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:29:24.612510+0000","last_clean_scrub_stamp":"2023-10-21T18:29:24.612510+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:29:13.690931+0000","scrub_duration":0.003804263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1996","reported_seq":2069,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.442457+0000","last_change":"2023-10-21T18:28:29.442502+0000","last_active":"2023-10-21T18:28:29.442457+0000","last_peered":"2023-10-21T18:28:29.442457+0000","last_clean":"2023-10-21T18:28:29.442457+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:29.442457+0000","last_undegraded":"2023-10-21T18:28:29.442457+0000","last_fullsized":"2023-10-21T18:28:29.442457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1996","last_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_deep_scrub":"25'1996","last_deep_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.442390+0000","objects_scrubbed":4,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:49.487666+0000","scrub_duration":0.022358660999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:23.677839+0000","last_change":"2023-10-21T18:29:23.677952+0000","last_active":"2023-10-21T18:29:23.677839+0000","last_peered":"2023-10-21T18:29:23.677839+0000","last_clean":"2023-10-21T18:29:23.677839+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:29:23.677839+0000","last_undegraded":"2023-10-21T18:29:23.677839+0000","last_fullsized":"2023-10-21T18:29:23.677839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2023-10-21T18:29:23.677669+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2023-10-21T18:29:23.677669+0000","last_clean_scrub_stamp":"2023-10-21T18:29:23.677669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:38:57.855764+0000","scrub_duration":0.005510081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1724","reported_seq":1799,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:25.859284+0000","last_change":"2023-10-21T18:28:25.859284+0000","last_active":"2023-10-21T18:28:25.859284+0000","last_peered":"2023-10-21T18:28:25.859284+0000","last_clean":"2023-10-21T18:28:25.859284+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:28:25.859284+0000","last_undegraded":"2023-10-21T18:28:25.859284+0000","last_fullsized":"2023-10-21T18:28:25.859284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1724","last_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_deep_scrub":"25'1724","last_deep_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:25.859118+0000","objects_scrubbed":6,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:33.368476+0000","scrub_duration":0.057169405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.829056+0000","last_change":"2023-10-21T18:28:44.829224+0000","last_active":"2023-10-21T18:28:44.829056+0000","last_peered":"2023-10-21T18:28:44.829056+0000","last_clean":"2023-10-21T18:28:44.829056+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:28:44.829056+0000","last_undegraded":"2023-10-21T18:28:44.829056+0000","last_fullsized":"2023-10-21T18:28:44.829056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.828875+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:15.215270+0000","scrub_duration":0.0040916859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'326","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.607328+0000","last_change":"2023-10-21T18:28:37.607328+0000","last_active":"2023-10-21T18:28:37.607328+0000","last_peered":"2023-10-21T18:28:37.607328+0000","last_clean":"2023-10-21T18:28:37.607328+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:28:37.607328+0000","last_undegraded":"2023-10-21T18:28:37.607328+0000","last_fullsized":"2023-10-21T18:28:37.607328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'326","last_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_deep_scrub":"25'326","last_deep_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.607192+0000","objects_scrubbed":4,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:24:31.987420+0000","scrub_duration":0.043194149000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'385","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.850205+0000","last_change":"2023-10-21T18:28:39.850205+0000","last_active":"2023-10-21T18:28:39.850205+0000","last_peered":"2023-10-21T18:28:39.850205+0000","last_clean":"2023-10-21T18:28:39.850205+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:28:39.850205+0000","last_undegraded":"2023-10-21T18:28:39.850205+0000","last_fullsized":"2023-10-21T18:28:39.850205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'385","last_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_deep_scrub":"25'385","last_deep_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.850078+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:10.961936+0000","scrub_duration":0.0039236139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:14.603885+0000","last_change":"2023-10-21T18:29:14.604027+0000","last_active":"2023-10-21T18:29:14.603885+0000","last_peered":"2023-10-21T18:29:14.603885+0000","last_clean":"2023-10-21T18:29:14.603885+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:29:14.603885+0000","last_undegraded":"2023-10-21T18:29:14.603885+0000","last_fullsized":"2023-10-21T18:29:14.603885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-21T18:29:14.603702+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-21T18:29:14.603702+0000","last_clean_scrub_stamp":"2023-10-21T18:29:14.603702+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:10:52.888900+0000","scrub_duration":0.0031561390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'428","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:19.626994+0000","last_change":"2023-10-21T18:29:19.627250+0000","last_active":"2023-10-21T18:29:19.626994+0000","last_peered":"2023-10-21T18:29:19.626994+0000","last_clean":"2023-10-21T18:29:19.626994+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:29:19.626994+0000","last_undegraded":"2023-10-21T18:29:19.626994+0000","last_fullsized":"2023-10-21T18:29:19.626994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:29:19.626781+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:29:19.626781+0000","last_clean_scrub_stamp":"2023-10-21T18:29:19.626781+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:34.907998+0000","scrub_duration":0.005731295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:41.866112+0000","last_change":"2023-10-21T18:28:41.866112+0000","last_active":"2023-10-21T18:28:41.866112+0000","last_peered":"2023-10-21T18:28:41.866112+0000","last_clean":"2023-10-21T18:28:41.866112+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:28:41.866112+0000","last_undegraded":"2023-10-21T18:28:41.866112+0000","last_fullsized":"2023-10-21T18:28:41.866112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'45","last_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_deep_scrub":"25'45","last_deep_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_clean_scrub_stamp":"2023-10-21T18:28:41.865799+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:22.835970+0000","scrub_duration":0.0037365559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'429","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.001247+0000","last_change":"2023-10-21T18:28:44.001247+0000","last_active":"2023-10-21T18:28:44.001247+0000","last_peered":"2023-10-21T18:28:44.001247+0000","last_clean":"2023-10-21T18:28:44.001247+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:28:44.001247+0000","last_undegraded":"2023-10-21T18:28:44.001247+0000","last_fullsized":"2023-10-21T18:28:44.001247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.000789+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:21.675243+0000","scrub_duration":0.0042857920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'819","reported_seq":894,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.888008+0000","last_change":"2023-10-21T18:28:28.888008+0000","last_active":"2023-10-21T18:28:28.888008+0000","last_peered":"2023-10-21T18:28:28.888008+0000","last_clean":"2023-10-21T18:28:28.888008+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:28:28.888008+0000","last_undegraded":"2023-10-21T18:28:28.888008+0000","last_fullsized":"2023-10-21T18:28:28.888008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'819","last_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_deep_scrub":"25'819","last_deep_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.887893+0000","objects_scrubbed":6,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:30.562236+0000","scrub_duration":0.023693352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'488","reported_seq":584,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.598988+0000","last_change":"2023-10-21T18:28:34.598988+0000","last_active":"2023-10-21T18:28:34.598988+0000","last_peered":"2023-10-21T18:28:34.598988+0000","last_clean":"2023-10-21T18:28:34.598988+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:28:34.598988+0000","last_undegraded":"2023-10-21T18:28:34.598988+0000","last_fullsized":"2023-10-21T18:28:34.598988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'488","last_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_deep_scrub":"25'488","last_deep_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.598552+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:03:57.326046+0000","scrub_duration":0.005866652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'738","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:40.939120+0000","last_change":"2023-10-21T18:28:40.939120+0000","last_active":"2023-10-21T18:28:40.939120+0000","last_peered":"2023-10-21T18:28:40.939120+0000","last_clean":"2023-10-21T18:28:40.939120+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:28:40.939120+0000","last_undegraded":"2023-10-21T18:28:40.939120+0000","last_fullsized":"2023-10-21T18:28:40.939120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'738","last_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_deep_scrub":"25'738","last_deep_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:40.938810+0000","objects_scrubbed":2,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:39.906339+0000","scrub_duration":0.037421380999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'366","reported_seq":454,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.859351+0000","last_change":"2023-10-21T18:28:47.859351+0000","last_active":"2023-10-21T18:28:47.859351+0000","last_peered":"2023-10-21T18:28:47.859351+0000","last_clean":"2023-10-21T18:28:47.859351+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:28:47.859351+0000","last_undegraded":"2023-10-21T18:28:47.859351+0000","last_fullsized":"2023-10-21T18:28:47.859351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.858872+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:54:00.525695+0000","scrub_duration":0.0059569339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'782","reported_seq":859,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.969679+0000","last_change":"2023-10-21T18:28:36.969679+0000","last_active":"2023-10-21T18:28:36.969679+0000","last_peered":"2023-10-21T18:28:36.969679+0000","last_clean":"2023-10-21T18:28:36.969679+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:28:36.969679+0000","last_undegraded":"2023-10-21T18:28:36.969679+0000","last_fullsized":"2023-10-21T18:28:36.969679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'782","last_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_deep_scrub":"25'782","last_deep_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.969514+0000","objects_scrubbed":2,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:42.170333+0000","scrub_duration":0.012547963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'358","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.006906+0000","last_change":"2023-10-21T18:28:57.006906+0000","last_active":"2023-10-21T18:28:57.006906+0000","last_peered":"2023-10-21T18:28:57.006906+0000","last_clean":"2023-10-21T18:28:57.006906+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:28:57.006906+0000","last_undegraded":"2023-10-21T18:28:57.006906+0000","last_fullsized":"2023-10-21T18:28:57.006906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'358","last_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_deep_scrub":"25'358","last_deep_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.006561+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:19.809987+0000","scrub_duration":0.0048299759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'245","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.794916+0000","last_change":"2023-10-21T18:28:28.794916+0000","last_active":"2023-10-21T18:28:28.794916+0000","last_peered":"2023-10-21T18:28:28.794916+0000","last_clean":"2023-10-21T18:28:28.794916+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:28:28.794916+0000","last_undegraded":"2023-10-21T18:28:28.794916+0000","last_fullsized":"2023-10-21T18:28:28.794916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'245","last_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_deep_scrub":"25'245","last_deep_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.794791+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.380233+0000","scrub_duration":0.016721482999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'442","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.004451+0000","last_change":"2023-10-21T18:29:04.004451+0000","last_active":"2023-10-21T18:29:04.004451+0000","last_peered":"2023-10-21T18:29:04.004451+0000","last_clean":"2023-10-21T18:29:04.004451+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:29:04.004451+0000","last_undegraded":"2023-10-21T18:29:04.004451+0000","last_fullsized":"2023-10-21T18:29:04.004451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.004313+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:26.807739+0000","scrub_duration":0.0029157160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'367","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.863423+0000","last_change":"2023-10-21T18:28:38.863423+0000","last_active":"2023-10-21T18:28:38.863423+0000","last_peered":"2023-10-21T18:28:38.863423+0000","last_clean":"2023-10-21T18:28:38.863423+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:28:38.863423+0000","last_undegraded":"2023-10-21T18:28:38.863423+0000","last_fullsized":"2023-10-21T18:28:38.863423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'367","last_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_deep_scrub":"25'367","last_deep_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.863261+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:58:19.348721+0000","scrub_duration":0.025519416999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'400","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:24.686742+0000","last_change":"2023-10-21T16:27:31.916857+0000","last_active":"2023-10-21T18:28:24.686742+0000","last_peered":"2023-10-21T18:28:24.686742+0000","last_clean":"2023-10-21T18:28:24.686742+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:28:24.686742+0000","last_undegraded":"2023-10-21T18:28:24.686742+0000","last_fullsized":"2023-10-21T18:28:24.686742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":238,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.997704+0000","last_change":"2023-10-21T18:28:27.997829+0000","last_active":"2023-10-21T18:28:27.997704+0000","last_peered":"2023-10-21T18:28:27.997704+0000","last_clean":"2023-10-21T18:28:27.997704+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:28:27.997704+0000","last_undegraded":"2023-10-21T18:28:27.997704+0000","last_fullsized":"2023-10-21T18:28:27.997704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.997532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:28:43.552482+0000","scrub_duration":0.009368375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'329","reported_seq":411,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.485285+0000","last_change":"2023-10-21T18:28:49.485402+0000","last_active":"2023-10-21T18:28:49.485285+0000","last_peered":"2023-10-21T18:28:49.485285+0000","last_clean":"2023-10-21T18:28:49.485285+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:28:49.485285+0000","last_undegraded":"2023-10-21T18:28:49.485285+0000","last_fullsized":"2023-10-21T18:28:49.485285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'329","last_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_deep_scrub":"25'329","last_deep_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.485085+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:01:12.425342+0000","scrub_duration":0.030119357999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'406","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.048575+0000","last_change":"2023-10-21T18:28:50.048622+0000","last_active":"2023-10-21T18:28:50.048575+0000","last_peered":"2023-10-21T18:28:50.048575+0000","last_clean":"2023-10-21T18:28:50.048575+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:28:50.048575+0000","last_undegraded":"2023-10-21T18:28:50.048575+0000","last_fullsized":"2023-10-21T18:28:50.048575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.048504+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:45.694640+0000","scrub_duration":0.0038304010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'726","reported_seq":809,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.573946+0000","last_change":"2023-10-21T18:28:45.574076+0000","last_active":"2023-10-21T18:28:45.573946+0000","last_peered":"2023-10-21T18:28:45.573946+0000","last_clean":"2023-10-21T18:28:45.573946+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:28:45.573946+0000","last_undegraded":"2023-10-21T18:28:45.573946+0000","last_fullsized":"2023-10-21T18:28:45.573946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'726","last_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_deep_scrub":"25'726","last_deep_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.573759+0000","objects_scrubbed":3,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:35:02.509083+0000","scrub_duration":0.061729854000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'417","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.751201+0000","last_change":"2023-10-21T18:28:51.751288+0000","last_active":"2023-10-21T18:28:51.751201+0000","last_peered":"2023-10-21T18:28:51.751201+0000","last_clean":"2023-10-21T18:28:51.751201+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:51.751201+0000","last_undegraded":"2023-10-21T18:28:51.751201+0000","last_fullsized":"2023-10-21T18:28:51.751201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.751118+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:25.401345+0000","scrub_duration":0.0042027590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3018,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.592629+0000","last_change":"2023-10-21T18:28:34.592678+0000","last_active":"2023-10-21T18:28:34.592629+0000","last_peered":"2023-10-21T18:28:34.592629+0000","last_clean":"2023-10-21T18:28:34.592629+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:34.592629+0000","last_undegraded":"2023-10-21T18:28:34.592629+0000","last_fullsized":"2023-10-21T18:28:34.592629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1496","last_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_deep_scrub":"25'1496","last_deep_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.592545+0000","objects_scrubbed":1,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:50:54.878023+0000","scrub_duration":0.0053032239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'381","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.665936+0000","last_change":"2023-10-21T18:28:37.665972+0000","last_active":"2023-10-21T18:28:37.665936+0000","last_peered":"2023-10-21T18:28:37.665936+0000","last_clean":"2023-10-21T18:28:37.665936+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:37.665936+0000","last_undegraded":"2023-10-21T18:28:37.665936+0000","last_fullsized":"2023-10-21T18:28:37.665936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.665867+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:14.652085+0000","scrub_duration":0.00173624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'394","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:58.665539+0000","last_change":"2023-10-21T18:28:58.665660+0000","last_active":"2023-10-21T18:28:58.665539+0000","last_peered":"2023-10-21T18:28:58.665539+0000","last_clean":"2023-10-21T18:28:58.665539+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:28:58.665539+0000","last_undegraded":"2023-10-21T18:28:58.665539+0000","last_fullsized":"2023-10-21T18:28:58.665539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'394","last_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_deep_scrub":"25'394","last_deep_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_clean_scrub_stamp":"2023-10-21T18:28:58.665360+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:38.030747+0000","scrub_duration":0.038550477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'392","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.062134+0000","last_change":"2023-10-21T18:29:00.062351+0000","last_active":"2023-10-21T18:29:00.062134+0000","last_peered":"2023-10-21T18:29:00.062134+0000","last_clean":"2023-10-21T18:29:00.062134+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:29:00.062134+0000","last_undegraded":"2023-10-21T18:29:00.062134+0000","last_fullsized":"2023-10-21T18:29:00.062134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.061847+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:35.532076+0000","scrub_duration":0.0059602409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'412","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.803226+0000","last_change":"2023-10-21T18:28:27.803298+0000","last_active":"2023-10-21T18:28:27.803226+0000","last_peered":"2023-10-21T18:28:27.803226+0000","last_clean":"2023-10-21T18:28:27.803226+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:28:27.803226+0000","last_undegraded":"2023-10-21T18:28:27.803226+0000","last_fullsized":"2023-10-21T18:28:27.803226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.803157+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:26:58.915015+0000","scrub_duration":0.013419940999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'410","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.790738+0000","last_change":"2023-10-21T18:28:42.790738+0000","last_active":"2023-10-21T18:28:42.790738+0000","last_peered":"2023-10-21T18:28:42.790738+0000","last_clean":"2023-10-21T18:28:42.790738+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:28:42.790738+0000","last_undegraded":"2023-10-21T18:28:42.790738+0000","last_fullsized":"2023-10-21T18:28:42.790738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.790342+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:48:47.994060+0000","scrub_duration":0.0044279569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'590","reported_seq":671,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:15.628519+0000","last_change":"2023-10-21T18:29:15.628647+0000","last_active":"2023-10-21T18:29:15.628519+0000","last_peered":"2023-10-21T18:29:15.628519+0000","last_clean":"2023-10-21T18:29:15.628519+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:29:15.628519+0000","last_undegraded":"2023-10-21T18:29:15.628519+0000","last_fullsized":"2023-10-21T18:29:15.628519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'590","last_scrub_stamp":"2023-10-21T18:29:15.628361+0000","last_deep_scrub":"25'590","last_deep_scrub_stamp":"2023-10-21T18:29:15.628361+0000","last_clean_scrub_stamp":"2023-10-21T18:29:15.628361+0000","objects_scrubbed":2,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:58:24.880560+0000","scrub_duration":0.054942662000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'377","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.799414+0000","last_change":"2023-10-21T18:28:48.799478+0000","last_active":"2023-10-21T18:28:48.799414+0000","last_peered":"2023-10-21T18:28:48.799414+0000","last_clean":"2023-10-21T18:28:48.799414+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:28:48.799414+0000","last_undegraded":"2023-10-21T18:28:48.799414+0000","last_fullsized":"2023-10-21T18:28:48.799414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'377","last_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_deep_scrub":"25'377","last_deep_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.799323+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:35.602039+0000","scrub_duration":0.002269002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1346","reported_seq":1425,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.973398+0000","last_change":"2023-10-21T18:28:38.973398+0000","last_active":"2023-10-21T18:28:38.973398+0000","last_peered":"2023-10-21T18:28:38.973398+0000","last_clean":"2023-10-21T18:28:38.973398+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:38.973398+0000","last_undegraded":"2023-10-21T18:28:38.973398+0000","last_fullsized":"2023-10-21T18:28:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1346","last_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_deep_scrub":"25'1346","last_deep_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.973260+0000","objects_scrubbed":1,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:12.623488+0000","scrub_duration":0.016535959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3534,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'364","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.154590+0000","last_change":"2023-10-21T18:28:55.154631+0000","last_active":"2023-10-21T18:28:55.154590+0000","last_peered":"2023-10-21T18:28:55.154590+0000","last_clean":"2023-10-21T18:28:55.154590+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:28:55.154590+0000","last_undegraded":"2023-10-21T18:28:55.154590+0000","last_fullsized":"2023-10-21T18:28:55.154590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'364","last_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_deep_scrub":"25'364","last_deep_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.154507+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:25.427604+0000","scrub_duration":0.0015667109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'322","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.530044+0000","last_change":"2023-10-21T18:28:44.530044+0000","last_active":"2023-10-21T18:28:44.530044+0000","last_peered":"2023-10-21T18:28:44.530044+0000","last_clean":"2023-10-21T18:28:44.530044+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:28:44.530044+0000","last_undegraded":"2023-10-21T18:28:44.530044+0000","last_fullsized":"2023-10-21T18:28:44.530044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'322","last_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_deep_scrub":"25'322","last_deep_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.529753+0000","objects_scrubbed":2,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:22:36.717064+0000","scrub_duration":0.032510153999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'463","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.982468+0000","last_change":"2023-10-21T18:28:39.982468+0000","last_active":"2023-10-21T18:28:39.982468+0000","last_peered":"2023-10-21T18:28:39.982468+0000","last_clean":"2023-10-21T18:28:39.982468+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:28:39.982468+0000","last_undegraded":"2023-10-21T18:28:39.982468+0000","last_fullsized":"2023-10-21T18:28:39.982468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'463","last_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_deep_scrub":"25'463","last_deep_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.982361+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:46.690293+0000","scrub_duration":0.0022391640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'262","reported_seq":341,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.764488+0000","last_change":"2023-10-21T18:28:28.764488+0000","last_active":"2023-10-21T18:28:28.764488+0000","last_peered":"2023-10-21T18:28:28.764488+0000","last_clean":"2023-10-21T18:28:28.764488+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:28:28.764488+0000","last_undegraded":"2023-10-21T18:28:28.764488+0000","last_fullsized":"2023-10-21T18:28:28.764488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'262","last_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_deep_scrub":"25'262","last_deep_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.764322+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.349764+0000","scrub_duration":0.017180768999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'421","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.628656+0000","last_change":"2023-10-21T18:28:37.628656+0000","last_active":"2023-10-21T18:28:37.628656+0000","last_peered":"2023-10-21T18:28:37.628656+0000","last_clean":"2023-10-21T18:28:37.628656+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:37.628656+0000","last_undegraded":"2023-10-21T18:28:37.628656+0000","last_fullsized":"2023-10-21T18:28:37.628656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.628358+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:43:36.552484+0000","scrub_duration":0.0042654920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'421","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:33.920158+0000","last_change":"2023-10-21T18:28:33.920158+0000","last_active":"2023-10-21T18:28:33.920158+0000","last_peered":"2023-10-21T18:28:33.920158+0000","last_clean":"2023-10-21T18:28:33.920158+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:28:33.920158+0000","last_undegraded":"2023-10-21T18:28:33.920158+0000","last_fullsized":"2023-10-21T18:28:33.920158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_clean_scrub_stamp":"2023-10-21T18:28:33.919990+0000","objects_scrubbed":1,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:02:20.582216+0000","scrub_duration":0.031339309000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.008047+0000","last_change":"2023-10-21T18:28:46.008047+0000","last_active":"2023-10-21T18:28:46.008047+0000","last_peered":"2023-10-21T18:28:46.008047+0000","last_clean":"2023-10-21T18:28:46.008047+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:46.008047+0000","last_undegraded":"2023-10-21T18:28:46.008047+0000","last_fullsized":"2023-10-21T18:28:46.008047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.007918+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:26.978090+0000","scrub_duration":0.0024174869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1150","reported_seq":1229,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.872930+0000","last_change":"2023-10-21T18:28:35.872930+0000","last_active":"2023-10-21T18:28:35.872930+0000","last_peered":"2023-10-21T18:28:35.872930+0000","last_clean":"2023-10-21T18:28:35.872930+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:28:35.872930+0000","last_undegraded":"2023-10-21T18:28:35.872930+0000","last_fullsized":"2023-10-21T18:28:35.872930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1150","last_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_deep_scrub":"25'1150","last_deep_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.872800+0000","objects_scrubbed":2,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:13.547254+0000","scrub_duration":0.023641031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.375757+0000","last_change":"2023-10-21T18:28:48.375757+0000","last_active":"2023-10-21T18:28:48.375757+0000","last_peered":"2023-10-21T18:28:48.375757+0000","last_clean":"2023-10-21T18:28:48.375757+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:48.375757+0000","last_undegraded":"2023-10-21T18:28:48.375757+0000","last_fullsized":"2023-10-21T18:28:48.375757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.375634+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:27:22.872575+0000","scrub_duration":0.0018102509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1141","reported_seq":1218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.697327+0000","last_change":"2023-10-21T18:29:00.697460+0000","last_active":"2023-10-21T18:29:00.697327+0000","last_peered":"2023-10-21T18:29:00.697327+0000","last_clean":"2023-10-21T18:29:00.697327+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:29:00.697327+0000","last_undegraded":"2023-10-21T18:29:00.697327+0000","last_fullsized":"2023-10-21T18:29:00.697327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1141","last_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_deep_scrub":"25'1141","last_deep_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.697114+0000","objects_scrubbed":4,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:28:47.299927+0000","scrub_duration":0.078786130999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'449","reported_seq":549,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:16.535433+0000","last_change":"2023-10-21T18:29:16.535558+0000","last_active":"2023-10-21T18:29:16.535433+0000","last_peered":"2023-10-21T18:29:16.535433+0000","last_clean":"2023-10-21T18:29:16.535433+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:29:16.535433+0000","last_undegraded":"2023-10-21T18:29:16.535433+0000","last_fullsized":"2023-10-21T18:29:16.535433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:29:16.535255+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:29:16.535255+0000","last_clean_scrub_stamp":"2023-10-21T18:29:16.535255+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:55:08.227715+0000","scrub_duration":0.0058660509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'451","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:15.959380+0000","last_change":"2023-10-21T16:27:31.927113+0000","last_active":"2023-10-21T18:28:15.959380+0000","last_peered":"2023-10-21T18:28:15.959380+0000","last_clean":"2023-10-21T18:28:15.959380+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:28:15.959380+0000","last_undegraded":"2023-10-21T18:28:15.959380+0000","last_fullsized":"2023-10-21T18:28:15.959380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-21T16:27:30.060379+0000","last_clean_scrub_stamp":"2023-10-21T16:27:30.060379+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'767","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.901291+0000","last_change":"2023-10-21T18:28:38.901414+0000","last_active":"2023-10-21T18:28:38.901291+0000","last_peered":"2023-10-21T18:28:38.901291+0000","last_clean":"2023-10-21T18:28:38.901291+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:28:38.901291+0000","last_undegraded":"2023-10-21T18:28:38.901291+0000","last_fullsized":"2023-10-21T18:28:38.901291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'767","last_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_deep_scrub":"25'767","last_deep_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.901093+0000","objects_scrubbed":2,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:45.609026+0000","scrub_duration":0.038403093999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'370","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.970215+0000","last_change":"2023-10-21T18:28:47.970410+0000","last_active":"2023-10-21T18:28:47.970215+0000","last_peered":"2023-10-21T18:28:47.970215+0000","last_clean":"2023-10-21T18:28:47.970215+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:28:47.970215+0000","last_undegraded":"2023-10-21T18:28:47.970215+0000","last_fullsized":"2023-10-21T18:28:47.970215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'370","last_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_deep_scrub":"25'370","last_deep_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.969971+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:19.081829+0000","scrub_duration":0.0057846690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1576","reported_seq":1647,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.953119+0000","last_change":"2023-10-21T18:28:34.953300+0000","last_active":"2023-10-21T18:28:34.953119+0000","last_peered":"2023-10-21T18:28:34.953119+0000","last_clean":"2023-10-21T18:28:34.953119+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:28:34.953119+0000","last_undegraded":"2023-10-21T18:28:34.953119+0000","last_fullsized":"2023-10-21T18:28:34.953119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1576","last_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_deep_scrub":"25'1576","last_deep_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.952989+0000","objects_scrubbed":5,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:40.153808+0000","scrub_duration":0.10868122500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'358","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:19.649842+0000","last_change":"2023-10-21T18:29:19.649910+0000","last_active":"2023-10-21T18:29:19.649842+0000","last_peered":"2023-10-21T18:29:19.649842+0000","last_clean":"2023-10-21T18:29:19.649842+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:29:19.649842+0000","last_undegraded":"2023-10-21T18:29:19.649842+0000","last_fullsized":"2023-10-21T18:29:19.649842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'358","last_scrub_stamp":"2023-10-21T18:29:19.649731+0000","last_deep_scrub":"25'358","last_deep_scrub_stamp":"2023-10-21T18:29:19.649731+0000","last_clean_scrub_stamp":"2023-10-21T18:29:19.649731+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:31:36.734701+0000","scrub_duration":0.0031332920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'570","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.761823+0000","last_change":"2023-10-21T18:28:30.761864+0000","last_active":"2023-10-21T18:28:30.761823+0000","last_peered":"2023-10-21T18:28:30.761823+0000","last_clean":"2023-10-21T18:28:30.761823+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:28:30.761823+0000","last_undegraded":"2023-10-21T18:28:30.761823+0000","last_fullsized":"2023-10-21T18:28:30.761823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'570","last_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_deep_scrub":"25'570","last_deep_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.761761+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:43.428584+0000","scrub_duration":0.020968085000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'382","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.636179+0000","last_change":"2023-10-21T18:29:03.636219+0000","last_active":"2023-10-21T18:29:03.636179+0000","last_peered":"2023-10-21T18:29:03.636179+0000","last_clean":"2023-10-21T18:29:03.636179+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:29:03.636179+0000","last_undegraded":"2023-10-21T18:29:03.636179+0000","last_fullsized":"2023-10-21T18:29:03.636179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'382","last_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_deep_scrub":"25'382","last_deep_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.636095+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:24:17.188213+0000","scrub_duration":0.0043045710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'611","reported_seq":692,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.955503+0000","last_change":"2023-10-21T18:28:35.955562+0000","last_active":"2023-10-21T18:28:35.955503+0000","last_peered":"2023-10-21T18:28:35.955503+0000","last_clean":"2023-10-21T18:28:35.955503+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:28:35.955503+0000","last_undegraded":"2023-10-21T18:28:35.955503+0000","last_fullsized":"2023-10-21T18:28:35.955503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'611","last_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_deep_scrub":"25'611","last_deep_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.955427+0000","objects_scrubbed":4,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:48.622250+0000","scrub_duration":0.046963560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26357,"ondisk_log_size":26357,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216339300,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24246,"num_write_kb":225038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432678600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23888,"ondisk_log_size":23888,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478209,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0669999999999999,"15min":1.0940000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4850000000000001,"5min":1.704,"15min":2.2519999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2390000000000001,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.7629999999999999,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":0.90100000000000002}]},{"osd":1,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2749999999999999,"15min":1.274},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.978,"5min":2.25,"15min":2.25},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8859999999999999,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.45}]},{"osd":2,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.508,"15min":1.522},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.093,"5min":2.367,"15min":2.367},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.6669999999999998},"last":1.661}]},{"osd":4,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2929999999999999,"15min":1.325},"min":{"1min":0.84099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.782},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3480000000000001,"15min":1.373},"min":{"1min":0.877,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9430000000000001,"5min":2.1240000000000001,"15min":2.319},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4379999999999999,"15min":1.4710000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.70099999999999996},"max":{"1min":2.0070000000000001,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4910000000000001,"15min":1.5269999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.395,"5min":2.395,"15min":2.423},"last":1.9570000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.514},"min":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.9249999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.6220000000000001,"15min":1.633},"min":{"1min":0.97899999999999998,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.331,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.899}]},{"osd":7,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.6319999999999999,"15min":1.671},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.496,"5min":2.496,"15min":2.5169999999999999},"last":2.048},{"interface":"front","average":{"1min":1.647,"5min":1.6040000000000001,"15min":1.645},"min":{"1min":0.96499999999999997,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.1600000000000001,"5min":2.2400000000000002,"15min":3.0449999999999999},"last":1.8280000000000001}]}]},{"osd":2,"up_from":16,"seq":68719478210,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.99099999999999999,"15min":1.044},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.439},"max":{"1min":1.6399999999999999,"5min":1.7430000000000001,"15min":3.153},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.321,"5min":1.254,"15min":1.2350000000000001},"min":{"1min":0.72299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.9970000000000001,"5min":2.0609999999999999,"15min":2.1560000000000001},"last":1.728}]},{"osd":1,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.339,"15min":1.3680000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8500000000000001,"5min":2.198,"15min":2.7480000000000002},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.63400000000000001},"max":{"1min":1.8400000000000001,"5min":2.335,"15min":2.621},"last":1.141}]},{"osd":3,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3660000000000001,"15min":1.391},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.746,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5840000000000001,"15min":1.6180000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.79600000000000004},"max":{"1min":2.2200000000000002,"5min":2.3130000000000002,"15min":3.867},"last":1.6679999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":0.91600000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.895},"last":1.383},{"interface":"front","average":{"1min":1.27,"5min":1.319,"15min":1.355},"min":{"1min":0.84899999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.341}]},{"osd":5,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.411,"15min":1.4379999999999999},"min":{"1min":1.0089999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9690000000000001,"5min":2.2320000000000002,"15min":2.524},"last":1.448},{"interface":"front","average":{"1min":1.292,"5min":1.3560000000000001,"15min":1.351},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.59899999999999998},"max":{"1min":2.319,"5min":2.319,"15min":2.7360000000000002},"last":1.3160000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4510000000000001,"15min":1.4530000000000001},"min":{"1min":0.84199999999999997,"5min":0.77100000000000002,"15min":0.64400000000000002},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.9689999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.452,"15min":1.514},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.84099999999999997},"max":{"1min":2.0619999999999998,"5min":2.1360000000000001,"15min":3.0259999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5900000000000001,"15min":1.591},"min":{"1min":1.099,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1000000000000001,"5min":2.2200000000000002,"15min":2.8029999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.571,"15min":1.5700000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.622},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.8620000000000001},"last":1.5269999999999999}]}]},{"osd":1,"up_from":16,"seq":68719478210,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51979688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0389999999999999,"15min":1.0580000000000001},"min":{"1min":0.63200000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.7450000000000001,"15min":1.9730000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2849999999999999,"15min":1.2569999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.79,"5min":2.0339999999999998,"15min":2.1000000000000001},"last":1.4259999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.173,"15min":1.2},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8700000000000001,"5min":2.0009999999999999,"15min":2.6539999999999999},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.3740000000000001,"15min":1.4059999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.673,"5min":2.0550000000000002,"15min":2.5779999999999998},"last":1.5389999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4650000000000001,"15min":1.498},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.913,"5min":2.0739999999999998,"15min":2.681},"last":1.645},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.496,"15min":1.5389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8919999999999999,"5min":2.1480000000000001,"15min":2.3140000000000001},"last":1.5880000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.333,"15min":1.361},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.66100000000000003},"max":{"1min":1.752,"5min":2.04,"15min":2.3130000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.341,"15min":1.3680000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.613,"5min":1.958,"15min":2.1600000000000001},"last":1.208}]},{"osd":5,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4379999999999999,"15min":1.468},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9139999999999999,"5min":2.1240000000000001,"15min":2.3610000000000002},"last":1.488},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4890000000000001,"15min":1.514},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.145,"5min":2.165,"15min":2.6850000000000001},"last":1.101}]},{"osd":6,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.5089999999999999,"15min":1.52},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.843,"5min":2.173,"15min":2.5459999999999998},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.573,"15min":1.611},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.78900000000000003},"max":{"1min":1.962,"5min":2.0859999999999999,"15min":2.5379999999999998},"last":1.5700000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.647,"15min":1.667},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.2770000000000001,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.349},{"interface":"front","average":{"1min":1.504,"5min":1.6559999999999999,"15min":1.6819999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.986,"5min":2.4649999999999999,"15min":2.6230000000000002},"last":1.8100000000000001}]}]},{"osd":0,"up_from":16,"seq":68719478211,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84943738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.091,"15min":1.099},"min":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8939999999999999,"5min":1.95,"15min":2.04},"last":1.198},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2450000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6990000000000001,"5min":2.0539999999999998,"15min":2.161},"last":1.3220000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2410000000000001,"15min":1.2869999999999999},"min":{"1min":0.75900000000000001,"5min":0.65400000000000003,"15min":0.60599999999999998},"max":{"1min":1.8149999999999999,"5min":1.95,"15min":2.3820000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4019999999999999,"15min":1.423},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.008,"5min":2.1219999999999999,"15min":2.5550000000000002},"last":1.7729999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4770000000000001,"15min":1.472},"min":{"1min":0.996,"5min":0.81100000000000005,"15min":0.53500000000000003},"max":{"1min":2.0129999999999999,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":1.629},{"interface":"front","average":{"1min":1.5,"5min":1.4890000000000001,"15min":1.512},"min":{"1min":1.1339999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9590000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.454}]},{"osd":4,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.347,"15min":1.369},"min":{"1min":0.91700000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2360000000000002,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.391},{"interface":"front","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.105,"5min":2.113,"15min":2.1600000000000001},"last":1.123}]},{"osd":5,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.3340000000000001,"15min":1.4019999999999999},"min":{"1min":0.89300000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.3420000000000001},"last":1.49},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.526,"15min":1.5409999999999999},"min":{"1min":0.80100000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.3140000000000001,"5min":2.597,"15min":2.7370000000000001},"last":1.911}]},{"osd":6,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.4350000000000001,"15min":1.4850000000000001},"min":{"1min":1.157,"5min":0.628,"15min":0.628},"max":{"1min":2.3380000000000001,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.484,"15min":1.544},"min":{"1min":0.69699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":2.407,"5min":2.407,"15min":2.4220000000000002},"last":2.1680000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.585,"15min":1.6639999999999999},"min":{"1min":0.97899999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":2.246},{"interface":"front","average":{"1min":1.7,"5min":1.667,"15min":1.6919999999999999},"min":{"1min":0.93700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3780000000000001,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":2.04}]}]},{"osd":6,"up_from":15,"seq":64424510913,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.752,"15min":0.745},"min":{"1min":0.432,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.097,"5min":1.224,"15min":1.224},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.079,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96299999999999997,"5min":1.395,"15min":1.395},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.5069999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.76100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.085,"5min":1.1120000000000001,"15min":2.1840000000000002},"last":0.98199999999999998}]},{"osd":3,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.05,"5min":1.2450000000000001,"15min":1.321},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1850000000000001,"15min":1.327},"last":0.753}]},{"osd":4,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.82699999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.67100000000000004,"15min":0.69999999999999996},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41899999999999998,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.64300000000000002,"15min":0.76200000000000001},"last":0.44},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29499999999999998},"max":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.60599999999999998,"5min":0.70099999999999996,"15min":0.85699999999999998},"last":0.46800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424510913,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114532,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257308,"statfs":{"total":96636764160,"available":96519483392,"internally_reserved":0,"allocated":52654080,"data_stored":52476546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.05,"5min":1.2,"15min":1.212},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.75},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42399999999999999},"max":{"1min":1.101,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"max":{"1min":1.105,"5min":1.2549999999999999,"15min":1.554},"last":0.875},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0489999999999999,"15min":1.419},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.264,"15min":1.3069999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2250000000000001,"5min":1.3480000000000001,"15min":2.1890000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.79900000000000004},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.518},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.51200000000000001,"5min":0.503,"15min":0.45400000000000001},"max":{"1min":1.115,"5min":1.2769999999999999,"15min":1.8480000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.67500000000000004},"last":0.251}]},{"osd":6,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.443},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.71799999999999997},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.72199999999999998},"last":0.28000000000000003}]},{"osd":7,"last update":"Sat Oct 21 18:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.70999999999999996,"15min":0.73199999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.71999999999999997,"15min":0.76300000000000001},"last":0.34100000000000003}]}]},{"osd":4,"up_from":15,"seq":64424510913,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.093,"5min":1.097,"15min":1.349},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.754},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97599999999999998,"5min":1.2929999999999999,"15min":1.355},"last":0.84599999999999997}]},{"osd":1,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.77700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.429},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.075,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.435,"15min":0.432},"max":{"1min":1.2509999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.349},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0940000000000001,"5min":1.2869999999999999,"15min":1.361},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.80800000000000005},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.23,"5min":1.893,"15min":1.893},"last":0.93000000000000005}]},{"osd":5,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.68400000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.437,"15min":0.45300000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.36499999999999999}]},{"osd":6,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58999999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.32000000000000001,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.313}]},{"osd":7,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.77700000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.30299999999999999},"max":{"1min":0.69899999999999995,"5min":0.72399999999999998,"15min":0.81499999999999995},"last":0.35099999999999998}]}]},{"osd":7,"up_from":14,"seq":60129543616,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.044,"5min":1.165,"15min":1.234},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.42299999999999999},"max":{"1min":1.054,"5min":1.159,"15min":1.2290000000000001},"last":0.82799999999999996}]},{"osd":1,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.125,"15min":1.2210000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.95099999999999996}]},{"osd":2,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.501},"max":{"1min":1.0920000000000001,"5min":1.1599999999999999,"15min":1.347},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56100000000000005,"5min":0.45600000000000002,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.333,"15min":1.333},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3100000000000001,"5min":1.411,"15min":1.411},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":0.50800000000000001,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.317}]},{"osd":5,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.52300000000000002,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33200000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51297463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:29:32.507 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:32.507 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:32.508 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:32.508 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-21T16:27:30.060379+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=16, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=21, tm_hour=18, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=294, tm_isdst=0) 2023-10-21T18:29:32.509 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-21T18:29:43.593 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:09.575 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.599 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:09.683 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.601 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:09.686 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.602 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:09.686 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.604 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:09.688 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.609 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:09.592 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.680 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:09.764 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.681 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:09.764 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:43.777 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:09.759 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.190 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:12.172 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.195 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:12.178 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.236 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:03:12.218 86968== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.258 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:12.342 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.262 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:12.346 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.262 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:12.346 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.266 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:12.351 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.276 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:03:12.360 87907== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:46.280 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:03:12.364 87906== Warning: unimplemented fcntl command: 1036 2023-10-21T18:29:52.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-21T18:29:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.736+0000 7fa145373640 1 Processor -- start 2023-10-21T18:29:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.736+0000 7fa145373640 1 -- start start 2023-10-21T18:29:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.738+0000 7fa145373640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 0x7fa14015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.738+0000 7fa145373640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14015afe0 con 0x7fa14006e0a0 2023-10-21T18:29:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.738+0000 7fa145373640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa140156e70 con 0x7fa140150ff0 2023-10-21T18:29:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.738+0000 7fa145373640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140157db0 con 0x7fa14015a610 2023-10-21T18:29:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.739+0000 7fa13ffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa140150ff0 0x7fa14006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:45270/0 (socket says 172.21.15.12:45270) 2023-10-21T18:29:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.739+0000 7fa13ffff640 1 -- 172.21.15.12:0/3533321934 learned_addr learned my addr 172.21.15.12:0/3533321934 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.739+0000 7fa144b72640 1 --2- 172.21.15.12:0/3533321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 0x7fa14015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.741+0000 7fa13f7fe640 1 -- 172.21.15.12:0/3533321934 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486691496 0 0) 0x7fa140156e70 con 0x7fa140150ff0 2023-10-21T18:29:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.741+0000 7fa13f7fe640 1 -- 172.21.15.12:0/3533321934 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c003520 con 0x7fa140150ff0 2023-10-21T18:29:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.741+0000 7fa144b72640 1 -- 172.21.15.12:0/3533321934 >> v1:172.21.15.99:6789/0 conn(0x7fa140150ff0 legacy=0x7fa14006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.741+0000 7fa144b72640 1 -- 172.21.15.12:0/3533321934 >> v1:172.21.15.12:6789/0 conn(0x7fa14006e0a0 legacy=0x7fa1400ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.741+0000 7fa144b72640 1 -- 172.21.15.12:0/3533321934 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140157130 con 0x7fa14015a610 2023-10-21T18:29:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.744+0000 7fa144b72640 1 --2- 172.21.15.12:0/3533321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 0x7fa14015aaa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1380097d0 tx=0x7fa13802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475910fdb371f18f server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.748+0000 7fa13f7fe640 1 -- 172.21.15.12:0/3533321934 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138031890 con 0x7fa14015a610 2023-10-21T18:29:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.748+0000 7fa13f7fe640 1 -- 172.21.15.12:0/3533321934 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380319f0 con 0x7fa14015a610 2023-10-21T18:29:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.748+0000 7fa13f7fe640 1 -- 172.21.15.12:0/3533321934 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138031d80 con 0x7fa14015a610 2023-10-21T18:29:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 -- 172.21.15.12:0/3533321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 msgr2=0x7fa14015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 --2- 172.21.15.12:0/3533321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 0x7fa14015aaa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1380097d0 tx=0x7fa13802b930 comp rx=0 tx=0).stop 2023-10-21T18:29:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 -- 172.21.15.12:0/3533321934 shutdown_connections 2023-10-21T18:29:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 --2- 172.21.15.12:0/3533321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14015a610 0x7fa14015aaa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 -- 172.21.15.12:0/3533321934 >> 172.21.15.12:0/3533321934 conn(0x7fa14006bac0 msgr2=0x7fa14006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 -- 172.21.15.12:0/3533321934 shutdown_connections 2023-10-21T18:29:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.749+0000 7fa145373640 1 -- 172.21.15.12:0/3533321934 wait complete. 2023-10-21T18:29:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.751+0000 7fa145373640 1 Processor -- start 2023-10-21T18:29:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.751+0000 7fa145373640 1 -- start start 2023-10-21T18:29:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa140150ff0 0x7fa140147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa14015a610 0x7fa1401479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140156180 con 0x7fa14015a610 2023-10-21T18:29:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140145ea0 con 0x7fa140150ff0 2023-10-21T18:29:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.752+0000 7fa145373640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1401430d0 con 0x7fa14006e0a0 2023-10-21T18:29:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.753+0000 7fa13ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.753+0000 7fa1377fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa140150ff0 0x7fa140147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.753+0000 7fa144b72640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa14015a610 0x7fa1401479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.753+0000 7fa13ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:51544/0 (socket says 172.21.15.12:51544) 2023-10-21T18:29:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.753+0000 7fa13ffff640 1 -- 172.21.15.12:0/2869954355 learned_addr learned my addr 172.21.15.12:0/2869954355 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.756+0000 7fa13ffff640 1 -- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa140150ff0 msgr2=0x7fa140147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.756+0000 7fa13ffff640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa140150ff0 0x7fa140147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.756+0000 7fa13ffff640 1 -- 172.21.15.12:0/2869954355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa14015a610 msgr2=0x7fa1401479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.756+0000 7fa13ffff640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa14015a610 0x7fa1401479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.756+0000 7fa13ffff640 1 -- 172.21.15.12:0/2869954355 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009400 con 0x7fa14006e0a0 2023-10-21T18:29:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.758+0000 7fa13ffff640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa13000cbf0 tx=0x7fa13000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.762+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000acf0 con 0x7fa14006e0a0 2023-10-21T18:29:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.762+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13000ae50 con 0x7fa14006e0a0 2023-10-21T18:29:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.762+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130012620 con 0x7fa14006e0a0 2023-10-21T18:29:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.762+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa140148330 con 0x7fa14006e0a0 2023-10-21T18:29:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.762+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1401558e0 con 0x7fa14006e0a0 2023-10-21T18:29:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.764+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa140142ea0 con 0x7fa14006e0a0 2023-10-21T18:29:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.785+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa130007070 con 0x7fa14006e0a0 2023-10-21T18:29:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.787+0000 7fa13d7fa640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 0x7fa12006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:52.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.787+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa130089780 con 0x7fa14006e0a0 2023-10-21T18:29:52.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.787+0000 7fa1377fe640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 0x7fa12006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:52.788+0000 7fa1377fe640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 0x7fa12006d3b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1400c5e90 tx=0x7fa128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.019+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa130054a10 con 0x7fa14006e0a0 2023-10-21T18:29:53.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.246+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 --> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1401576f0 con 0x7fa12006aef0 2023-10-21T18:29:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.255+0000 7fa13d7fa640 1 -- 172.21.15.12:0/2869954355 <== mgr.4100 v2:172.21.15.99:6800/381435415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291882 (secure 0 0 0) 0x7fa1280014a0 con 0x7fa12006aef0 2023-10-21T18:29:53.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-21T18:29:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.261+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 msgr2=0x7fa12006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.261+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 0x7fa12006d3b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1400c5e90 tx=0x7fa128009040 comp rx=0 tx=0).stop 2023-10-21T18:29:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.261+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 msgr2=0x7fa140156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.261+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa13000cbf0 tx=0x7fa13000a430 comp rx=0 tx=0).stop 2023-10-21T18:29:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 shutdown_connections 2023-10-21T18:29:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fa12006aef0 0x7fa12006d3b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa14015a610 0x7fa1401479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa140150ff0 0x7fa140147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 --2- 172.21.15.12:0/2869954355 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa14006e0a0 0x7fa140156520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 >> 172.21.15.12:0/2869954355 conn(0x7fa14006bac0 msgr2=0x7fa140071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 shutdown_connections 2023-10-21T18:29:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.262+0000 7fa145373640 1 -- 172.21.15.12:0/2869954355 wait complete. 2023-10-21T18:29:53.283 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":3704,"stamp":"2023-10-21T18:29:53.157893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":216929668,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":2670,"num_read_kb":3400356,"num_write":48793,"num_write_kb":4575230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50364,"ondisk_log_size":50364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":945872,"kb_used_data":425744,"kb_used_omap":12,"kb_used_meta":520051,"kb_avail":754028848,"statfs":{"total":773094113280,"available":772125540352,"internally_reserved":0,"allocated":435961856,"data_stored":434594192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":532532794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003021"},"pg_stats":[{"pgid":"3.3f","version":"25'409","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.035326+0000","last_change":"2023-10-21T18:29:04.035506+0000","last_active":"2023-10-21T18:29:04.035326+0000","last_peered":"2023-10-21T18:29:04.035326+0000","last_clean":"2023-10-21T18:29:04.035326+0000","last_became_active":"2023-10-21T16:27:31.933773+0000","last_became_peered":"2023-10-21T16:27:31.933773+0000","last_unstale":"2023-10-21T18:29:04.035326+0000","last_undegraded":"2023-10-21T18:29:04.035326+0000","last_fullsized":"2023-10-21T18:29:04.035326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:29:04.035110+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.035110+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:43.400496+0000","scrub_duration":0.0043130260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":57012,"num_write":374,"num_write_kb":70900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'423","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.690490+0000","last_change":"2023-10-21T18:28:49.690534+0000","last_active":"2023-10-21T18:28:49.690490+0000","last_peered":"2023-10-21T18:28:49.690490+0000","last_clean":"2023-10-21T18:28:49.690490+0000","last_became_active":"2023-10-21T16:27:31.889044+0000","last_became_peered":"2023-10-21T16:27:31.889044+0000","last_unstale":"2023-10-21T18:28:49.690490+0000","last_undegraded":"2023-10-21T18:28:49.690490+0000","last_fullsized":"2023-10-21T18:28:49.690490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:49.690405+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.690405+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:04.270503+0000","scrub_duration":0.0026678240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":71588,"num_write":395,"num_write_kb":99889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'376","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.660584+0000","last_change":"2023-10-21T18:28:46.660627+0000","last_active":"2023-10-21T18:28:46.660584+0000","last_peered":"2023-10-21T18:28:46.660584+0000","last_clean":"2023-10-21T18:28:46.660584+0000","last_became_active":"2023-10-21T16:27:31.871200+0000","last_became_peered":"2023-10-21T16:27:31.871200+0000","last_unstale":"2023-10-21T18:28:46.660584+0000","last_undegraded":"2023-10-21T18:28:46.660584+0000","last_fullsized":"2023-10-21T18:28:46.660584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'376","last_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_deep_scrub":"25'376","last_deep_scrub_stamp":"2023-10-21T18:28:46.660492+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.660492+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:04:09.387985+0000","scrub_duration":0.0021392680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":40960,"num_write":346,"num_write_kb":54415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'405","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:31.943133+0000","last_change":"2023-10-21T18:28:31.943357+0000","last_active":"2023-10-21T18:28:31.943133+0000","last_peered":"2023-10-21T18:28:31.943133+0000","last_clean":"2023-10-21T18:28:31.943133+0000","last_became_active":"2023-10-21T16:27:31.872251+0000","last_became_peered":"2023-10-21T16:27:31.872251+0000","last_unstale":"2023-10-21T18:28:31.943133+0000","last_undegraded":"2023-10-21T18:28:31.943133+0000","last_fullsized":"2023-10-21T18:28:31.943133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2023-10-21T18:28:31.942864+0000","last_clean_scrub_stamp":"2023-10-21T18:28:31.942864+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:39.601766+0000","scrub_duration":0.0053496380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":58054,"num_write":377,"num_write_kb":71317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'427","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:07.385082+0000","last_change":"2023-10-21T18:29:07.385121+0000","last_active":"2023-10-21T18:29:07.385082+0000","last_peered":"2023-10-21T18:29:07.385082+0000","last_clean":"2023-10-21T18:29:07.385082+0000","last_became_active":"2023-10-21T16:27:57.847373+0000","last_became_peered":"2023-10-21T16:27:57.847373+0000","last_unstale":"2023-10-21T18:29:07.385082+0000","last_undegraded":"2023-10-21T18:29:07.385082+0000","last_fullsized":"2023-10-21T18:29:07.385082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:29:07.384998+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:29:07.384998+0000","last_clean_scrub_stamp":"2023-10-21T18:29:07.384998+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:08:56.752861+0000","scrub_duration":0.0018450140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":65631,"num_write":399,"num_write_kb":92540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'388","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.874884+0000","last_change":"2023-10-21T18:28:29.874962+0000","last_active":"2023-10-21T18:28:29.874884+0000","last_peered":"2023-10-21T18:28:29.874884+0000","last_clean":"2023-10-21T18:28:29.874884+0000","last_became_active":"2023-10-21T16:27:31.872054+0000","last_became_peered":"2023-10-21T16:27:31.872054+0000","last_unstale":"2023-10-21T18:28:29.874884+0000","last_undegraded":"2023-10-21T18:28:29.874884+0000","last_fullsized":"2023-10-21T18:28:29.874884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'388","last_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_deep_scrub":"25'388","last_deep_scrub_stamp":"2023-10-21T18:28:29.874757+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.874757+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:03:33.858731+0000","scrub_duration":0.0039421550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":24822,"num_write":362,"num_write_kb":30093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'407","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826595+0000","last_change":"2023-10-21T18:28:43.826713+0000","last_active":"2023-10-21T18:28:43.826595+0000","last_peered":"2023-10-21T18:28:43.826595+0000","last_clean":"2023-10-21T18:28:43.826595+0000","last_became_active":"2023-10-21T16:27:31.922017+0000","last_became_peered":"2023-10-21T16:27:31.922017+0000","last_unstale":"2023-10-21T18:28:43.826595+0000","last_undegraded":"2023-10-21T18:28:43.826595+0000","last_fullsized":"2023-10-21T18:28:43.826595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'407","last_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_deep_scrub":"25'407","last_deep_scrub_stamp":"2023-10-21T18:28:43.826446+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826446+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:06:26.675534+0000","scrub_duration":0.0042928150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":55683,"num_write":377,"num_write_kb":58834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'384","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:10.554677+0000","last_change":"2023-10-21T18:29:10.554716+0000","last_active":"2023-10-21T18:29:10.554677+0000","last_peered":"2023-10-21T18:29:10.554677+0000","last_clean":"2023-10-21T18:29:10.554677+0000","last_became_active":"2023-10-21T16:27:31.922267+0000","last_became_peered":"2023-10-21T16:27:31.922267+0000","last_unstale":"2023-10-21T18:29:10.554677+0000","last_undegraded":"2023-10-21T18:29:10.554677+0000","last_fullsized":"2023-10-21T18:29:10.554677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'384","last_scrub_stamp":"2023-10-21T18:29:10.554593+0000","last_deep_scrub":"25'384","last_deep_scrub_stamp":"2023-10-21T18:29:10.554593+0000","last_clean_scrub_stamp":"2023-10-21T18:29:10.554593+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:24:21.176505+0000","scrub_duration":0.003743213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":98772,"num_write":347,"num_write_kb":108452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'428","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.034040+0000","last_change":"2023-10-21T18:28:45.034149+0000","last_active":"2023-10-21T18:28:45.034040+0000","last_peered":"2023-10-21T18:28:45.034040+0000","last_clean":"2023-10-21T18:28:45.034040+0000","last_became_active":"2023-10-21T16:27:31.915485+0000","last_became_peered":"2023-10-21T16:27:31.915485+0000","last_unstale":"2023-10-21T18:28:45.034040+0000","last_undegraded":"2023-10-21T18:28:45.034040+0000","last_fullsized":"2023-10-21T18:28:45.034040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:45.033874+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.033874+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:46.708217+0000","scrub_duration":0.0047872369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":79109,"num_write":395,"num_write_kb":66987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.942804+0000","last_change":"2023-10-21T18:28:51.942932+0000","last_active":"2023-10-21T18:28:51.942804+0000","last_peered":"2023-10-21T18:28:51.942804+0000","last_clean":"2023-10-21T18:28:51.942804+0000","last_became_active":"2023-10-21T16:27:31.928420+0000","last_became_peered":"2023-10-21T16:27:31.928420+0000","last_unstale":"2023-10-21T18:28:51.942804+0000","last_undegraded":"2023-10-21T18:28:51.942804+0000","last_fullsized":"2023-10-21T18:28:51.942804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:51.942622+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.942622+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:22.215720+0000","scrub_duration":0.0057898489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20645,"num_write":391,"num_write_kb":50894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'366","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.906474+0000","last_change":"2023-10-21T18:28:50.906600+0000","last_active":"2023-10-21T18:28:50.906474+0000","last_peered":"2023-10-21T18:28:50.906474+0000","last_clean":"2023-10-21T18:28:50.906474+0000","last_became_active":"2023-10-21T16:27:31.932583+0000","last_became_peered":"2023-10-21T16:27:31.932583+0000","last_unstale":"2023-10-21T18:28:50.906474+0000","last_undegraded":"2023-10-21T18:28:50.906474+0000","last_fullsized":"2023-10-21T18:28:50.906474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:50.906355+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.906355+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:06:07.160796+0000","scrub_duration":0.0040660480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":21617,"num_write":347,"num_write_kb":46789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'373","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:01.057082+0000","last_change":"2023-10-21T18:29:01.057312+0000","last_active":"2023-10-21T18:29:01.057082+0000","last_peered":"2023-10-21T18:29:01.057082+0000","last_clean":"2023-10-21T18:29:01.057082+0000","last_became_active":"2023-10-21T16:27:31.933224+0000","last_became_peered":"2023-10-21T16:27:31.933224+0000","last_unstale":"2023-10-21T18:29:01.057082+0000","last_undegraded":"2023-10-21T18:29:01.057082+0000","last_fullsized":"2023-10-21T18:29:01.057082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'373","last_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_deep_scrub":"25'373","last_deep_scrub_stamp":"2023-10-21T18:29:01.056873+0000","last_clean_scrub_stamp":"2023-10-21T18:29:01.056873+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:26:06.772053+0000","scrub_duration":0.0065493540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":89896,"num_write":357,"num_write_kb":101260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'411","reported_seq":504,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:43.826664+0000","last_change":"2023-10-21T18:28:43.826723+0000","last_active":"2023-10-21T18:28:43.826664+0000","last_peered":"2023-10-21T18:28:43.826664+0000","last_clean":"2023-10-21T18:28:43.826664+0000","last_became_active":"2023-10-21T16:27:31.925599+0000","last_became_peered":"2023-10-21T16:27:31.925599+0000","last_unstale":"2023-10-21T18:28:43.826664+0000","last_undegraded":"2023-10-21T18:28:43.826664+0000","last_fullsized":"2023-10-21T18:28:43.826664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2023-10-21T18:28:43.826560+0000","last_clean_scrub_stamp":"2023-10-21T18:28:43.826560+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:06.412002+0000","scrub_duration":0.0035619480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":68162,"num_write":388,"num_write_kb":51269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'409","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.746951+0000","last_change":"2023-10-21T18:28:52.746951+0000","last_active":"2023-10-21T18:28:52.746951+0000","last_peered":"2023-10-21T18:28:52.746951+0000","last_clean":"2023-10-21T18:28:52.746951+0000","last_became_active":"2023-10-21T16:27:31.896174+0000","last_became_peered":"2023-10-21T16:27:31.896174+0000","last_unstale":"2023-10-21T18:28:52.746951+0000","last_undegraded":"2023-10-21T18:28:52.746951+0000","last_fullsized":"2023-10-21T18:28:52.746951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2023-10-21T18:28:52.746784+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.746784+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:59.454717+0000","scrub_duration":0.002219937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":22684,"num_write":375,"num_write_kb":42781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'429","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.699387+0000","last_change":"2023-10-21T18:28:36.699387+0000","last_active":"2023-10-21T18:28:36.699387+0000","last_peered":"2023-10-21T18:28:36.699387+0000","last_clean":"2023-10-21T18:28:36.699387+0000","last_became_active":"2023-10-21T16:27:31.926888+0000","last_became_peered":"2023-10-21T16:27:31.926888+0000","last_unstale":"2023-10-21T18:28:36.699387+0000","last_undegraded":"2023-10-21T18:28:36.699387+0000","last_fullsized":"2023-10-21T18:28:36.699387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:36.699278+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.699278+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:43.407211+0000","scrub_duration":0.0042182460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":75565,"num_write":389,"num_write_kb":88149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'427","reported_seq":526,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.578932+0000","last_change":"2023-10-21T18:28:35.578932+0000","last_active":"2023-10-21T18:28:35.578932+0000","last_peered":"2023-10-21T18:28:35.578932+0000","last_clean":"2023-10-21T18:28:35.578932+0000","last_became_active":"2023-10-21T16:27:31.911001+0000","last_became_peered":"2023-10-21T16:27:31.911001+0000","last_unstale":"2023-10-21T18:28:35.578932+0000","last_undegraded":"2023-10-21T18:28:35.578932+0000","last_fullsized":"2023-10-21T18:28:35.578932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2023-10-21T18:28:35.578584+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.578584+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:31.224721+0000","scrub_duration":0.0053980649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":92652,"num_write":394,"num_write_kb":79692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'462","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:18.605885+0000","last_change":"2023-10-21T18:29:18.606001+0000","last_active":"2023-10-21T18:29:18.605885+0000","last_peered":"2023-10-21T18:29:18.605885+0000","last_clean":"2023-10-21T18:29:18.605885+0000","last_became_active":"2023-10-21T16:27:31.935786+0000","last_became_peered":"2023-10-21T16:27:31.935786+0000","last_unstale":"2023-10-21T18:29:18.605885+0000","last_undegraded":"2023-10-21T18:29:18.605885+0000","last_fullsized":"2023-10-21T18:29:18.605885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'462","last_scrub_stamp":"2023-10-21T18:29:18.605674+0000","last_deep_scrub":"25'462","last_deep_scrub_stamp":"2023-10-21T18:29:18.605674+0000","last_clean_scrub_stamp":"2023-10-21T18:29:18.605674+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:24:54.510094+0000","scrub_duration":0.0056319500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":118833,"num_write":428,"num_write_kb":105956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'392","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:53.416169+0000","last_change":"2023-10-21T18:28:53.416216+0000","last_active":"2023-10-21T18:28:53.416169+0000","last_peered":"2023-10-21T18:28:53.416169+0000","last_clean":"2023-10-21T18:28:53.416169+0000","last_became_active":"2023-10-21T16:27:31.907633+0000","last_became_peered":"2023-10-21T16:27:31.907633+0000","last_unstale":"2023-10-21T18:28:53.416169+0000","last_undegraded":"2023-10-21T18:28:53.416169+0000","last_fullsized":"2023-10-21T18:28:53.416169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:28:53.416093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:53.416093+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:56:19.552816+0000","scrub_duration":0.0043137169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53365,"num_write":363,"num_write_kb":63665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'404","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:29.627041+0000","last_change":"2023-10-21T18:29:29.627153+0000","last_active":"2023-10-21T18:29:29.627041+0000","last_peered":"2023-10-21T18:29:29.627041+0000","last_clean":"2023-10-21T18:29:29.627041+0000","last_became_active":"2023-10-21T16:27:31.915268+0000","last_became_peered":"2023-10-21T16:27:31.915268+0000","last_unstale":"2023-10-21T18:29:29.627041+0000","last_undegraded":"2023-10-21T18:29:29.627041+0000","last_fullsized":"2023-10-21T18:29:29.627041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'404","last_scrub_stamp":"2023-10-21T18:29:29.626859+0000","last_deep_scrub":"25'404","last_deep_scrub_stamp":"2023-10-21T18:29:29.626859+0000","last_clean_scrub_stamp":"2023-10-21T18:29:29.626859+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:34:14.426887+0000","scrub_duration":0.0040727569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29397,"num_write":366,"num_write_kb":30068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:07.070807+0000","last_change":"2023-10-21T18:29:07.070919+0000","last_active":"2023-10-21T18:29:07.070807+0000","last_peered":"2023-10-21T18:29:07.070807+0000","last_clean":"2023-10-21T18:29:07.070807+0000","last_became_active":"2023-10-21T16:27:31.933740+0000","last_became_peered":"2023-10-21T16:27:31.933740+0000","last_unstale":"2023-10-21T18:29:07.070807+0000","last_undegraded":"2023-10-21T18:29:07.070807+0000","last_fullsized":"2023-10-21T18:29:07.070807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2023-10-21T18:29:07.070615+0000","last_clean_scrub_stamp":"2023-10-21T18:29:07.070615+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:29:27.871808+0000","scrub_duration":0.0054759869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":39122,"num_write":407,"num_write_kb":67092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'400","reported_seq":497,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.966366+0000","last_change":"2023-10-21T18:28:42.966366+0000","last_active":"2023-10-21T18:28:42.966366+0000","last_peered":"2023-10-21T18:28:42.966366+0000","last_clean":"2023-10-21T18:28:42.966366+0000","last_became_active":"2023-10-21T16:27:31.875073+0000","last_became_peered":"2023-10-21T16:27:31.875073+0000","last_unstale":"2023-10-21T18:28:42.966366+0000","last_undegraded":"2023-10-21T18:28:42.966366+0000","last_fullsized":"2023-10-21T18:28:42.966366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'400","last_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_deep_scrub":"25'400","last_deep_scrub_stamp":"2023-10-21T18:28:42.966240+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.966240+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:19.952458+0000","scrub_duration":0.0031400999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54153,"num_write":364,"num_write_kb":71843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'449","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.941449+0000","last_change":"2023-10-21T18:28:36.941449+0000","last_active":"2023-10-21T18:28:36.941449+0000","last_peered":"2023-10-21T18:28:36.941449+0000","last_clean":"2023-10-21T18:28:36.941449+0000","last_became_active":"2023-10-21T16:27:31.926081+0000","last_became_peered":"2023-10-21T16:27:31.926081+0000","last_unstale":"2023-10-21T18:28:36.941449+0000","last_undegraded":"2023-10-21T18:28:36.941449+0000","last_fullsized":"2023-10-21T18:28:36.941449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:28:36.941104+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.941104+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:55:44.600005+0000","scrub_duration":0.006421108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":104447,"num_write":430,"num_write_kb":101199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'395","reported_seq":485,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:05.555080+0000","last_change":"2023-10-21T18:29:05.555176+0000","last_active":"2023-10-21T18:29:05.555080+0000","last_peered":"2023-10-21T18:29:05.555080+0000","last_clean":"2023-10-21T18:29:05.555080+0000","last_became_active":"2023-10-21T16:27:31.719059+0000","last_became_peered":"2023-10-21T16:27:31.719059+0000","last_unstale":"2023-10-21T18:29:05.555080+0000","last_undegraded":"2023-10-21T18:29:05.555080+0000","last_fullsized":"2023-10-21T18:29:05.555080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2023-10-21T18:29:05.554977+0000","last_clean_scrub_stamp":"2023-10-21T18:29:05.554977+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:28.358403+0000","scrub_duration":0.0040465589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":35447,"num_write":362,"num_write_kb":55127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'412","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.584402+0000","last_change":"2023-10-21T18:28:36.584402+0000","last_active":"2023-10-21T18:28:36.584402+0000","last_peered":"2023-10-21T18:28:36.584402+0000","last_clean":"2023-10-21T18:28:36.584402+0000","last_became_active":"2023-10-21T16:27:31.906237+0000","last_became_peered":"2023-10-21T16:27:31.906237+0000","last_unstale":"2023-10-21T18:28:36.584402+0000","last_undegraded":"2023-10-21T18:28:36.584402+0000","last_fullsized":"2023-10-21T18:28:36.584402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:36.584058+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.584058+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:42:57.833730+0000","scrub_duration":0.0042012220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33826,"num_write":382,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'408","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:22.661182+0000","last_change":"2023-10-21T18:29:22.661229+0000","last_active":"2023-10-21T18:29:22.661182+0000","last_peered":"2023-10-21T18:29:22.661182+0000","last_clean":"2023-10-21T18:29:22.661182+0000","last_became_active":"2023-10-21T16:27:31.917746+0000","last_became_peered":"2023-10-21T16:27:31.917746+0000","last_unstale":"2023-10-21T18:29:22.661182+0000","last_undegraded":"2023-10-21T18:29:22.661182+0000","last_fullsized":"2023-10-21T18:29:22.661182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2023-10-21T18:29:22.661100+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2023-10-21T18:29:22.661100+0000","last_clean_scrub_stamp":"2023-10-21T18:29:22.661100+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:22:20.716242+0000","scrub_duration":0.0037799209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":50000,"num_write":384,"num_write_kb":67699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'487","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.855941+0000","last_change":"2023-10-21T18:28:46.855941+0000","last_active":"2023-10-21T18:28:46.855941+0000","last_peered":"2023-10-21T18:28:46.855941+0000","last_clean":"2023-10-21T18:28:46.855941+0000","last_became_active":"2023-10-21T16:27:31.913175+0000","last_became_peered":"2023-10-21T16:27:31.913175+0000","last_unstale":"2023-10-21T18:28:46.855941+0000","last_undegraded":"2023-10-21T18:28:46.855941+0000","last_fullsized":"2023-10-21T18:28:46.855941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'487","last_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_deep_scrub":"25'487","last_deep_scrub_stamp":"2023-10-21T18:28:46.855612+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.855612+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:29:17.471747+0000","scrub_duration":0.0054321940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":49594,"num_write":456,"num_write_kb":81027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'417","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.740068+0000","last_change":"2023-10-21T18:28:55.740104+0000","last_active":"2023-10-21T18:28:55.740068+0000","last_peered":"2023-10-21T18:28:55.740068+0000","last_clean":"2023-10-21T18:28:55.740068+0000","last_became_active":"2023-10-21T16:27:31.896703+0000","last_became_peered":"2023-10-21T16:27:31.896703+0000","last_unstale":"2023-10-21T18:28:55.740068+0000","last_undegraded":"2023-10-21T18:28:55.740068+0000","last_fullsized":"2023-10-21T18:28:55.740068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:55.740003+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.740003+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:54.707531+0000","scrub_duration":0.0020128619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":29032,"num_write":390,"num_write_kb":63548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'406","reported_seq":506,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.820012+0000","last_change":"2023-10-21T18:28:57.820057+0000","last_active":"2023-10-21T18:28:57.820012+0000","last_peered":"2023-10-21T18:28:57.820012+0000","last_clean":"2023-10-21T18:28:57.820012+0000","last_became_active":"2023-10-21T16:27:31.927851+0000","last_became_peered":"2023-10-21T16:27:31.927851+0000","last_unstale":"2023-10-21T18:28:57.820012+0000","last_undegraded":"2023-10-21T18:28:57.820012+0000","last_fullsized":"2023-10-21T18:28:57.820012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:57.819933+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.819933+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:38.790104+0000","scrub_duration":0.0044187219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70270,"num_write":383,"num_write_kb":112587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'398","reported_seq":491,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:06.580335+0000","last_change":"2023-10-21T18:29:06.580377+0000","last_active":"2023-10-21T18:29:06.580335+0000","last_peered":"2023-10-21T18:29:06.580335+0000","last_clean":"2023-10-21T18:29:06.580335+0000","last_became_active":"2023-10-21T16:27:31.896279+0000","last_became_peered":"2023-10-21T16:27:31.896279+0000","last_unstale":"2023-10-21T18:29:06.580335+0000","last_undegraded":"2023-10-21T18:29:06.580335+0000","last_fullsized":"2023-10-21T18:29:06.580335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2023-10-21T18:29:06.580250+0000","last_clean_scrub_stamp":"2023-10-21T18:29:06.580250+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:42.050479+0000","scrub_duration":0.0021721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17702,"num_write":367,"num_write_kb":59143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'469","reported_seq":572,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:45.686249+0000","last_change":"2023-10-21T18:29:45.686367+0000","last_active":"2023-10-21T18:29:45.686249+0000","last_peered":"2023-10-21T18:29:45.686249+0000","last_clean":"2023-10-21T18:29:45.686249+0000","last_became_active":"2023-10-21T16:27:31.910279+0000","last_became_peered":"2023-10-21T16:27:31.910279+0000","last_unstale":"2023-10-21T18:29:45.686249+0000","last_undegraded":"2023-10-21T18:29:45.686249+0000","last_fullsized":"2023-10-21T18:29:45.686249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'469","last_scrub_stamp":"2023-10-21T18:29:45.686029+0000","last_deep_scrub":"25'469","last_deep_scrub_stamp":"2023-10-21T18:29:45.686029+0000","last_clean_scrub_stamp":"2023-10-21T18:29:45.686029+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:15:19.426199+0000","scrub_duration":0.0043182749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":88026,"num_write":435,"num_write_kb":108936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'457","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.523209+0000","last_change":"2023-10-21T18:28:42.523252+0000","last_active":"2023-10-21T18:28:42.523209+0000","last_peered":"2023-10-21T18:28:42.523209+0000","last_clean":"2023-10-21T18:28:42.523209+0000","last_became_active":"2023-10-21T16:27:31.911583+0000","last_became_peered":"2023-10-21T16:27:31.911583+0000","last_unstale":"2023-10-21T18:28:42.523209+0000","last_undegraded":"2023-10-21T18:28:42.523209+0000","last_fullsized":"2023-10-21T18:28:42.523209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'457","last_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_deep_scrub":"25'457","last_deep_scrub_stamp":"2023-10-21T18:28:42.523122+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.523122+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:32:34.806713+0000","scrub_duration":0.003821732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":59269,"num_write":420,"num_write_kb":71944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'423","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.898803+0000","last_change":"2023-10-21T18:28:30.898913+0000","last_active":"2023-10-21T18:28:30.898803+0000","last_peered":"2023-10-21T18:28:30.898803+0000","last_clean":"2023-10-21T18:28:30.898803+0000","last_became_active":"2023-10-21T16:27:31.889904+0000","last_became_peered":"2023-10-21T16:27:31.889904+0000","last_unstale":"2023-10-21T18:28:30.898803+0000","last_undegraded":"2023-10-21T18:28:30.898803+0000","last_fullsized":"2023-10-21T18:28:30.898803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'423","last_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_deep_scrub":"25'423","last_deep_scrub_stamp":"2023-10-21T18:28:30.898643+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.898643+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:43:54.121212+0000","scrub_duration":0.004221242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24682,"num_write":404,"num_write_kb":27591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'417","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.983813+0000","last_change":"2023-10-21T18:28:30.983860+0000","last_active":"2023-10-21T18:28:30.983813+0000","last_peered":"2023-10-21T18:28:30.983813+0000","last_clean":"2023-10-21T18:28:30.983813+0000","last_became_active":"2023-10-21T16:27:31.911594+0000","last_became_peered":"2023-10-21T16:27:31.911594+0000","last_unstale":"2023-10-21T18:28:30.983813+0000","last_undegraded":"2023-10-21T18:28:30.983813+0000","last_fullsized":"2023-10-21T18:28:30.983813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:30.983725+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.983725+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:00:54.743691+0000","scrub_duration":0.0040209740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":84948,"num_write":389,"num_write_kb":92102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'223","reported_seq":294,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.693077+0000","last_change":"2023-10-21T18:28:35.693118+0000","last_active":"2023-10-21T18:28:35.693077+0000","last_peered":"2023-10-21T18:28:35.693077+0000","last_clean":"2023-10-21T18:28:35.693077+0000","last_became_active":"2023-10-21T16:27:30.318680+0000","last_became_peered":"2023-10-21T16:27:30.318680+0000","last_unstale":"2023-10-21T18:28:35.693077+0000","last_undegraded":"2023-10-21T18:28:35.693077+0000","last_fullsized":"2023-10-21T18:28:35.693077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'223","last_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_deep_scrub":"25'223","last_deep_scrub_stamp":"2023-10-21T18:28:35.693006+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.693006+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:12:26.846010+0000","scrub_duration":0.011849706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'378","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:52.110876+0000","last_change":"2023-10-21T18:28:52.110911+0000","last_active":"2023-10-21T18:28:52.110876+0000","last_peered":"2023-10-21T18:28:52.110876+0000","last_clean":"2023-10-21T18:28:52.110876+0000","last_became_active":"2023-10-21T16:27:31.925503+0000","last_became_peered":"2023-10-21T16:27:31.925503+0000","last_unstale":"2023-10-21T18:28:52.110876+0000","last_undegraded":"2023-10-21T18:28:52.110876+0000","last_fullsized":"2023-10-21T18:28:52.110876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'378","last_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_deep_scrub":"25'378","last_deep_scrub_stamp":"2023-10-21T18:28:52.110809+0000","last_clean_scrub_stamp":"2023-10-21T18:28:52.110809+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:11:36.694729+0000","scrub_duration":0.0036171549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":62871,"num_write":358,"num_write_kb":104359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1321","reported_seq":1392,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.687023+0000","last_change":"2023-10-21T18:29:03.687154+0000","last_active":"2023-10-21T18:29:03.687023+0000","last_peered":"2023-10-21T18:29:03.687023+0000","last_clean":"2023-10-21T18:29:03.687023+0000","last_became_active":"2023-10-21T16:27:30.344021+0000","last_became_peered":"2023-10-21T16:27:30.344021+0000","last_unstale":"2023-10-21T18:29:03.687023+0000","last_undegraded":"2023-10-21T18:29:03.687023+0000","last_fullsized":"2023-10-21T18:29:03.687023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1321","last_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_deep_scrub":"25'1321","last_deep_scrub_stamp":"2023-10-21T18:29:03.686852+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.686852+0000","objects_scrubbed":4,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:32:23.455573+0000","scrub_duration":0.107670841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":16994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'776","reported_seq":849,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.858788+0000","last_change":"2023-10-21T18:28:36.858788+0000","last_active":"2023-10-21T18:28:36.858788+0000","last_peered":"2023-10-21T18:28:36.858788+0000","last_clean":"2023-10-21T18:28:36.858788+0000","last_became_active":"2023-10-21T16:27:30.333040+0000","last_became_peered":"2023-10-21T16:27:30.333040+0000","last_unstale":"2023-10-21T18:28:36.858788+0000","last_undegraded":"2023-10-21T18:28:36.858788+0000","last_fullsized":"2023-10-21T18:28:36.858788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'776","last_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_deep_scrub":"25'776","last_deep_scrub_stamp":"2023-10-21T18:28:36.858682+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.858682+0000","objects_scrubbed":1,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:38.533026+0000","scrub_duration":0.035982591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":4425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'464","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:11.563173+0000","last_change":"2023-10-21T18:29:11.563241+0000","last_active":"2023-10-21T18:29:11.563173+0000","last_peered":"2023-10-21T18:29:11.563173+0000","last_clean":"2023-10-21T18:29:11.563173+0000","last_became_active":"2023-10-21T16:27:31.889013+0000","last_became_peered":"2023-10-21T16:27:31.889013+0000","last_unstale":"2023-10-21T18:29:11.563173+0000","last_undegraded":"2023-10-21T18:29:11.563173+0000","last_fullsized":"2023-10-21T18:29:11.563173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'464","last_scrub_stamp":"2023-10-21T18:29:11.563095+0000","last_deep_scrub":"25'464","last_deep_scrub_stamp":"2023-10-21T18:29:11.563095+0000","last_clean_scrub_stamp":"2023-10-21T18:29:11.563095+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:15:51.661868+0000","scrub_duration":0.0023160500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":61440,"num_write":435,"num_write_kb":46687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'907","reported_seq":980,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.562864+0000","last_change":"2023-10-21T18:28:47.563062+0000","last_active":"2023-10-21T18:28:47.562864+0000","last_peered":"2023-10-21T18:28:47.562864+0000","last_clean":"2023-10-21T18:28:47.562864+0000","last_became_active":"2023-10-21T16:27:30.340203+0000","last_became_peered":"2023-10-21T16:27:30.340203+0000","last_unstale":"2023-10-21T18:28:47.562864+0000","last_undegraded":"2023-10-21T18:28:47.562864+0000","last_fullsized":"2023-10-21T18:28:47.562864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'907","last_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_deep_scrub":"25'907","last_deep_scrub_stamp":"2023-10-21T18:28:47.562685+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.562685+0000","objects_scrubbed":3,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:36:48.077046+0000","scrub_duration":0.083295784999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":12730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'415","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:54.115025+0000","last_change":"2023-10-21T18:28:54.115025+0000","last_active":"2023-10-21T18:28:54.115025+0000","last_peered":"2023-10-21T18:28:54.115025+0000","last_clean":"2023-10-21T18:28:54.115025+0000","last_became_active":"2023-10-21T16:27:31.915489+0000","last_became_peered":"2023-10-21T16:27:31.915489+0000","last_unstale":"2023-10-21T18:28:54.115025+0000","last_undegraded":"2023-10-21T18:28:54.115025+0000","last_fullsized":"2023-10-21T18:28:54.115025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'415","last_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_deep_scrub":"25'415","last_deep_scrub_stamp":"2023-10-21T18:28:54.114810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:54.114810+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:43.902447+0000","scrub_duration":0.0042339600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":53929,"num_write":384,"num_write_kb":71242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'53","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.944245+0000","last_change":"2023-10-21T18:28:28.944434+0000","last_active":"2023-10-21T18:28:28.944245+0000","last_peered":"2023-10-21T18:28:28.944245+0000","last_clean":"2023-10-21T18:28:28.944245+0000","last_became_active":"2023-10-21T16:27:30.323558+0000","last_became_peered":"2023-10-21T16:27:30.323558+0000","last_unstale":"2023-10-21T18:28:28.944245+0000","last_undegraded":"2023-10-21T18:28:28.944245+0000","last_fullsized":"2023-10-21T18:28:28.944245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2023-10-21T18:28:28.944008+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.944008+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:47:21.203623+0000","scrub_duration":0.0041208629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'419","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.845991+0000","last_change":"2023-10-21T18:28:45.846105+0000","last_active":"2023-10-21T18:28:45.845991+0000","last_peered":"2023-10-21T18:28:45.845991+0000","last_clean":"2023-10-21T18:28:45.845991+0000","last_became_active":"2023-10-21T16:27:31.912691+0000","last_became_peered":"2023-10-21T16:27:31.912691+0000","last_unstale":"2023-10-21T18:28:45.845991+0000","last_undegraded":"2023-10-21T18:28:45.845991+0000","last_fullsized":"2023-10-21T18:28:45.845991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'419","last_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_deep_scrub":"25'419","last_deep_scrub_stamp":"2023-10-21T18:28:45.845733+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.845733+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:45:21.778624+0000","scrub_duration":0.0052853249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":41264,"num_write":390,"num_write_kb":54487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1390","reported_seq":1463,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.894216+0000","last_change":"2023-10-21T18:28:36.894345+0000","last_active":"2023-10-21T18:28:36.894216+0000","last_peered":"2023-10-21T18:28:36.894216+0000","last_clean":"2023-10-21T18:28:36.894216+0000","last_became_active":"2023-10-21T16:27:30.337162+0000","last_became_peered":"2023-10-21T16:27:30.337162+0000","last_unstale":"2023-10-21T18:28:36.894216+0000","last_undegraded":"2023-10-21T18:28:36.894216+0000","last_fullsized":"2023-10-21T18:28:36.894216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1390","last_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_deep_scrub":"25'1390","last_deep_scrub_stamp":"2023-10-21T18:28:36.894015+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.894015+0000","objects_scrubbed":4,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:10.544242+0000","scrub_duration":0.093137905000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13548657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1323,"num_write_kb":13905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'410","reported_seq":510,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:24.612586+0000","last_change":"2023-10-21T18:29:24.612629+0000","last_active":"2023-10-21T18:29:24.612586+0000","last_peered":"2023-10-21T18:29:24.612586+0000","last_clean":"2023-10-21T18:29:24.612586+0000","last_became_active":"2023-10-21T16:27:31.910481+0000","last_became_peered":"2023-10-21T16:27:31.910481+0000","last_unstale":"2023-10-21T18:29:24.612586+0000","last_undegraded":"2023-10-21T18:29:24.612586+0000","last_fullsized":"2023-10-21T18:29:24.612586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:29:24.612510+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:29:24.612510+0000","last_clean_scrub_stamp":"2023-10-21T18:29:24.612510+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:29:13.690931+0000","scrub_duration":0.003804263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":96297,"num_write":380,"num_write_kb":103972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'1996","reported_seq":2069,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:29.442457+0000","last_change":"2023-10-21T18:28:29.442502+0000","last_active":"2023-10-21T18:28:29.442457+0000","last_peered":"2023-10-21T18:28:29.442457+0000","last_clean":"2023-10-21T18:28:29.442457+0000","last_became_active":"2023-10-21T16:27:30.320974+0000","last_became_peered":"2023-10-21T16:27:30.320974+0000","last_unstale":"2023-10-21T18:28:29.442457+0000","last_undegraded":"2023-10-21T18:28:29.442457+0000","last_fullsized":"2023-10-21T18:28:29.442457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1996","last_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_deep_scrub":"25'1996","last_deep_scrub_stamp":"2023-10-21T18:28:29.442390+0000","last_clean_scrub_stamp":"2023-10-21T18:28:29.442390+0000","objects_scrubbed":4,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:49.487666+0000","scrub_duration":0.022358660999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1943,"num_write_kb":9724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'398","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:23.677839+0000","last_change":"2023-10-21T18:29:23.677952+0000","last_active":"2023-10-21T18:29:23.677839+0000","last_peered":"2023-10-21T18:29:23.677839+0000","last_clean":"2023-10-21T18:29:23.677839+0000","last_became_active":"2023-10-21T16:27:31.916068+0000","last_became_peered":"2023-10-21T16:27:31.916068+0000","last_unstale":"2023-10-21T18:29:23.677839+0000","last_undegraded":"2023-10-21T18:29:23.677839+0000","last_fullsized":"2023-10-21T18:29:23.677839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2023-10-21T18:29:23.677669+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2023-10-21T18:29:23.677669+0000","last_clean_scrub_stamp":"2023-10-21T18:29:23.677669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:38:57.855764+0000","scrub_duration":0.005510081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":35771,"num_write":365,"num_write_kb":47094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'1724","reported_seq":1799,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:25.859284+0000","last_change":"2023-10-21T18:28:25.859284+0000","last_active":"2023-10-21T18:28:25.859284+0000","last_peered":"2023-10-21T18:28:25.859284+0000","last_clean":"2023-10-21T18:28:25.859284+0000","last_became_active":"2023-10-21T16:27:30.334957+0000","last_became_peered":"2023-10-21T16:27:30.334957+0000","last_unstale":"2023-10-21T18:28:25.859284+0000","last_undegraded":"2023-10-21T18:28:25.859284+0000","last_fullsized":"2023-10-21T18:28:25.859284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1724","last_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_deep_scrub":"25'1724","last_deep_scrub_stamp":"2023-10-21T18:28:25.859118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:25.859118+0000","objects_scrubbed":6,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:52:33.368476+0000","scrub_duration":0.057169405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1664,"num_write_kb":13327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.829056+0000","last_change":"2023-10-21T18:28:44.829224+0000","last_active":"2023-10-21T18:28:44.829056+0000","last_peered":"2023-10-21T18:28:44.829056+0000","last_clean":"2023-10-21T18:28:44.829056+0000","last_became_active":"2023-10-21T16:27:31.928277+0000","last_became_peered":"2023-10-21T16:27:31.928277+0000","last_unstale":"2023-10-21T18:28:44.829056+0000","last_undegraded":"2023-10-21T18:28:44.829056+0000","last_fullsized":"2023-10-21T18:28:44.829056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:44.828875+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.828875+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:31:15.215270+0000","scrub_duration":0.0040916859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":48104,"num_write":366,"num_write_kb":83548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'326","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.607328+0000","last_change":"2023-10-21T18:28:37.607328+0000","last_active":"2023-10-21T18:28:37.607328+0000","last_peered":"2023-10-21T18:28:37.607328+0000","last_clean":"2023-10-21T18:28:37.607328+0000","last_became_active":"2023-10-21T16:27:30.333463+0000","last_became_peered":"2023-10-21T16:27:30.333463+0000","last_unstale":"2023-10-21T18:28:37.607328+0000","last_undegraded":"2023-10-21T18:28:37.607328+0000","last_fullsized":"2023-10-21T18:28:37.607328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'326","last_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_deep_scrub":"25'326","last_deep_scrub_stamp":"2023-10-21T18:28:37.607192+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.607192+0000","objects_scrubbed":4,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:24:31.987420+0000","scrub_duration":0.043194149000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":8327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'385","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.850205+0000","last_change":"2023-10-21T18:28:39.850205+0000","last_active":"2023-10-21T18:28:39.850205+0000","last_peered":"2023-10-21T18:28:39.850205+0000","last_clean":"2023-10-21T18:28:39.850205+0000","last_became_active":"2023-10-21T16:27:31.914723+0000","last_became_peered":"2023-10-21T16:27:31.914723+0000","last_unstale":"2023-10-21T18:28:39.850205+0000","last_undegraded":"2023-10-21T18:28:39.850205+0000","last_fullsized":"2023-10-21T18:28:39.850205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'385","last_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_deep_scrub":"25'385","last_deep_scrub_stamp":"2023-10-21T18:28:39.850078+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.850078+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:10.961936+0000","scrub_duration":0.0039236139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33702,"num_write":356,"num_write_kb":54809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'63","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:14.603885+0000","last_change":"2023-10-21T18:29:14.604027+0000","last_active":"2023-10-21T18:29:14.603885+0000","last_peered":"2023-10-21T18:29:14.603885+0000","last_clean":"2023-10-21T18:29:14.603885+0000","last_became_active":"2023-10-21T16:27:30.344325+0000","last_became_peered":"2023-10-21T16:27:30.344325+0000","last_unstale":"2023-10-21T18:29:14.603885+0000","last_undegraded":"2023-10-21T18:29:14.603885+0000","last_fullsized":"2023-10-21T18:29:14.603885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-21T18:29:14.603702+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-21T18:29:14.603702+0000","last_clean_scrub_stamp":"2023-10-21T18:29:14.603702+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:10:52.888900+0000","scrub_duration":0.0031561390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'428","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:19.626994+0000","last_change":"2023-10-21T18:29:19.627250+0000","last_active":"2023-10-21T18:29:19.626994+0000","last_peered":"2023-10-21T18:29:19.626994+0000","last_clean":"2023-10-21T18:29:19.626994+0000","last_became_active":"2023-10-21T16:27:31.932642+0000","last_became_peered":"2023-10-21T16:27:31.932642+0000","last_unstale":"2023-10-21T18:29:19.626994+0000","last_undegraded":"2023-10-21T18:29:19.626994+0000","last_fullsized":"2023-10-21T18:29:19.626994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:29:19.626781+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:29:19.626781+0000","last_clean_scrub_stamp":"2023-10-21T18:29:19.626781+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:52:34.907998+0000","scrub_duration":0.005731295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":103413,"num_write":403,"num_write_kb":71796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'45","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:41.866112+0000","last_change":"2023-10-21T18:28:41.866112+0000","last_active":"2023-10-21T18:28:41.866112+0000","last_peered":"2023-10-21T18:28:41.866112+0000","last_clean":"2023-10-21T18:28:41.866112+0000","last_became_active":"2023-10-21T16:27:30.345703+0000","last_became_peered":"2023-10-21T16:27:30.345703+0000","last_unstale":"2023-10-21T18:28:41.866112+0000","last_undegraded":"2023-10-21T18:28:41.866112+0000","last_fullsized":"2023-10-21T18:28:41.866112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'45","last_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_deep_scrub":"25'45","last_deep_scrub_stamp":"2023-10-21T18:28:41.865799+0000","last_clean_scrub_stamp":"2023-10-21T18:28:41.865799+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:22.835970+0000","scrub_duration":0.0037365559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'429","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.001247+0000","last_change":"2023-10-21T18:28:44.001247+0000","last_active":"2023-10-21T18:28:44.001247+0000","last_peered":"2023-10-21T18:28:44.001247+0000","last_clean":"2023-10-21T18:28:44.001247+0000","last_became_active":"2023-10-21T16:27:31.911638+0000","last_became_peered":"2023-10-21T16:27:31.911638+0000","last_unstale":"2023-10-21T18:28:44.001247+0000","last_undegraded":"2023-10-21T18:28:44.001247+0000","last_fullsized":"2023-10-21T18:28:44.001247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-21T18:28:44.000789+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.000789+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:21.675243+0000","scrub_duration":0.0042857920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":36572,"num_write":397,"num_write_kb":63106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'819","reported_seq":894,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.888008+0000","last_change":"2023-10-21T18:28:28.888008+0000","last_active":"2023-10-21T18:28:28.888008+0000","last_peered":"2023-10-21T18:28:28.888008+0000","last_clean":"2023-10-21T18:28:28.888008+0000","last_became_active":"2023-10-21T16:27:30.326692+0000","last_became_peered":"2023-10-21T16:27:30.326692+0000","last_unstale":"2023-10-21T18:28:28.888008+0000","last_undegraded":"2023-10-21T18:28:28.888008+0000","last_fullsized":"2023-10-21T18:28:28.888008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'819","last_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_deep_scrub":"25'819","last_deep_scrub_stamp":"2023-10-21T18:28:28.887893+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.887893+0000","objects_scrubbed":6,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T06:22:30.562236+0000","scrub_duration":0.023693352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'488","reported_seq":584,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.598988+0000","last_change":"2023-10-21T18:28:34.598988+0000","last_active":"2023-10-21T18:28:34.598988+0000","last_peered":"2023-10-21T18:28:34.598988+0000","last_clean":"2023-10-21T18:28:34.598988+0000","last_became_active":"2023-10-21T16:27:31.910788+0000","last_became_peered":"2023-10-21T16:27:31.910788+0000","last_unstale":"2023-10-21T18:28:34.598988+0000","last_undegraded":"2023-10-21T18:28:34.598988+0000","last_fullsized":"2023-10-21T18:28:34.598988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'488","last_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_deep_scrub":"25'488","last_deep_scrub_stamp":"2023-10-21T18:28:34.598552+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.598552+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:03:57.326046+0000","scrub_duration":0.005866652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":75860,"num_write":449,"num_write_kb":96337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'738","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:40.939120+0000","last_change":"2023-10-21T18:28:40.939120+0000","last_active":"2023-10-21T18:28:40.939120+0000","last_peered":"2023-10-21T18:28:40.939120+0000","last_clean":"2023-10-21T18:28:40.939120+0000","last_became_active":"2023-10-21T16:27:30.338735+0000","last_became_peered":"2023-10-21T16:27:30.338735+0000","last_unstale":"2023-10-21T18:28:40.939120+0000","last_undegraded":"2023-10-21T18:28:40.939120+0000","last_fullsized":"2023-10-21T18:28:40.939120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'738","last_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_deep_scrub":"25'738","last_deep_scrub_stamp":"2023-10-21T18:28:40.938810+0000","last_clean_scrub_stamp":"2023-10-21T18:28:40.938810+0000","objects_scrubbed":2,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:31:39.906339+0000","scrub_duration":0.037421380999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'366","reported_seq":454,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.859351+0000","last_change":"2023-10-21T18:28:47.859351+0000","last_active":"2023-10-21T18:28:47.859351+0000","last_peered":"2023-10-21T18:28:47.859351+0000","last_clean":"2023-10-21T18:28:47.859351+0000","last_became_active":"2023-10-21T16:27:31.934336+0000","last_became_peered":"2023-10-21T16:27:31.934336+0000","last_unstale":"2023-10-21T18:28:47.859351+0000","last_undegraded":"2023-10-21T18:28:47.859351+0000","last_fullsized":"2023-10-21T18:28:47.859351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'366","last_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_deep_scrub":"25'366","last_deep_scrub_stamp":"2023-10-21T18:28:47.858872+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.858872+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:54:00.525695+0000","scrub_duration":0.0059569339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":49152,"num_write":333,"num_write_kb":59089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'782","reported_seq":859,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:36.969679+0000","last_change":"2023-10-21T18:28:36.969679+0000","last_active":"2023-10-21T18:28:36.969679+0000","last_peered":"2023-10-21T18:28:36.969679+0000","last_clean":"2023-10-21T18:28:36.969679+0000","last_became_active":"2023-10-21T16:27:30.321097+0000","last_became_peered":"2023-10-21T16:27:30.321097+0000","last_unstale":"2023-10-21T18:28:36.969679+0000","last_undegraded":"2023-10-21T18:28:36.969679+0000","last_fullsized":"2023-10-21T18:28:36.969679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'782","last_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_deep_scrub":"25'782","last_deep_scrub_stamp":"2023-10-21T18:28:36.969514+0000","last_clean_scrub_stamp":"2023-10-21T18:28:36.969514+0000","objects_scrubbed":2,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:42.170333+0000","scrub_duration":0.012547963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'358","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:57.006906+0000","last_change":"2023-10-21T18:28:57.006906+0000","last_active":"2023-10-21T18:28:57.006906+0000","last_peered":"2023-10-21T18:28:57.006906+0000","last_clean":"2023-10-21T18:28:57.006906+0000","last_became_active":"2023-10-21T16:27:31.932323+0000","last_became_peered":"2023-10-21T16:27:31.932323+0000","last_unstale":"2023-10-21T18:28:57.006906+0000","last_undegraded":"2023-10-21T18:28:57.006906+0000","last_fullsized":"2023-10-21T18:28:57.006906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'358","last_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_deep_scrub":"25'358","last_deep_scrub_stamp":"2023-10-21T18:28:57.006561+0000","last_clean_scrub_stamp":"2023-10-21T18:28:57.006561+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:19.809987+0000","scrub_duration":0.0048299759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12682,"num_write":317,"num_write_kb":34400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'245","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.794916+0000","last_change":"2023-10-21T18:28:28.794916+0000","last_active":"2023-10-21T18:28:28.794916+0000","last_peered":"2023-10-21T18:28:28.794916+0000","last_clean":"2023-10-21T18:28:28.794916+0000","last_became_active":"2023-10-21T16:27:30.319791+0000","last_became_peered":"2023-10-21T16:27:30.319791+0000","last_unstale":"2023-10-21T18:28:28.794916+0000","last_undegraded":"2023-10-21T18:28:28.794916+0000","last_fullsized":"2023-10-21T18:28:28.794916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'245","last_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_deep_scrub":"25'245","last_deep_scrub_stamp":"2023-10-21T18:28:28.794791+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.794791+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.380233+0000","scrub_duration":0.016721482999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'442","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:04.004451+0000","last_change":"2023-10-21T18:29:04.004451+0000","last_active":"2023-10-21T18:29:04.004451+0000","last_peered":"2023-10-21T18:29:04.004451+0000","last_clean":"2023-10-21T18:29:04.004451+0000","last_became_active":"2023-10-21T16:27:57.700250+0000","last_became_peered":"2023-10-21T16:27:57.700250+0000","last_unstale":"2023-10-21T18:29:04.004451+0000","last_undegraded":"2023-10-21T18:29:04.004451+0000","last_fullsized":"2023-10-21T18:29:04.004451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2023-10-21T18:29:04.004313+0000","last_clean_scrub_stamp":"2023-10-21T18:29:04.004313+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:23:26.807739+0000","scrub_duration":0.0029157160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":33787,"num_write":407,"num_write_kb":46903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"25'367","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.863423+0000","last_change":"2023-10-21T18:28:38.863423+0000","last_active":"2023-10-21T18:28:38.863423+0000","last_peered":"2023-10-21T18:28:38.863423+0000","last_clean":"2023-10-21T18:28:38.863423+0000","last_became_active":"2023-10-21T16:27:30.333072+0000","last_became_peered":"2023-10-21T16:27:30.333072+0000","last_unstale":"2023-10-21T18:28:38.863423+0000","last_undegraded":"2023-10-21T18:28:38.863423+0000","last_fullsized":"2023-10-21T18:28:38.863423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'367","last_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_deep_scrub":"25'367","last_deep_scrub_stamp":"2023-10-21T18:28:38.863261+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.863261+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:58:19.348721+0000","scrub_duration":0.025519416999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'400","reported_seq":490,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:36.663117+0000","last_change":"2023-10-21T18:29:36.663374+0000","last_active":"2023-10-21T18:29:36.663117+0000","last_peered":"2023-10-21T18:29:36.663117+0000","last_clean":"2023-10-21T18:29:36.663117+0000","last_became_active":"2023-10-21T16:27:31.916574+0000","last_became_peered":"2023-10-21T16:27:31.916574+0000","last_unstale":"2023-10-21T18:29:36.663117+0000","last_undegraded":"2023-10-21T18:29:36.663117+0000","last_fullsized":"2023-10-21T18:29:36.663117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'400","last_scrub_stamp":"2023-10-21T18:29:36.662898+0000","last_deep_scrub":"25'400","last_deep_scrub_stamp":"2023-10-21T18:29:36.662898+0000","last_clean_scrub_stamp":"2023-10-21T18:29:36.662898+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:24.141856+0000","scrub_duration":0.0053206249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":50234,"num_write":374,"num_write_kb":50660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":239,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.997829+0000","last_change":"2023-10-21T18:28:27.997829+0000","last_active":"2023-10-21T18:28:27.997829+0000","last_peered":"2023-10-21T18:28:27.997829+0000","last_clean":"2023-10-21T18:28:27.997829+0000","last_became_active":"2023-10-21T16:27:11.157384+0000","last_became_peered":"2023-10-21T16:27:11.157384+0000","last_unstale":"2023-10-21T18:28:27.997829+0000","last_undegraded":"2023-10-21T18:28:27.997829+0000","last_fullsized":"2023-10-21T18:28:27.997829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-21T18:28:27.997532+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.997532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:28:43.552482+0000","scrub_duration":0.009368375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'329","reported_seq":411,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:49.485285+0000","last_change":"2023-10-21T18:28:49.485402+0000","last_active":"2023-10-21T18:28:49.485285+0000","last_peered":"2023-10-21T18:28:49.485285+0000","last_clean":"2023-10-21T18:28:49.485285+0000","last_became_active":"2023-10-21T16:27:30.341075+0000","last_became_peered":"2023-10-21T16:27:30.341075+0000","last_unstale":"2023-10-21T18:28:49.485285+0000","last_undegraded":"2023-10-21T18:28:49.485285+0000","last_fullsized":"2023-10-21T18:28:49.485285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'329","last_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_deep_scrub":"25'329","last_deep_scrub_stamp":"2023-10-21T18:28:49.485085+0000","last_clean_scrub_stamp":"2023-10-21T18:28:49.485085+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:01:12.425342+0000","scrub_duration":0.030119357999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'406","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:50.048575+0000","last_change":"2023-10-21T18:28:50.048622+0000","last_active":"2023-10-21T18:28:50.048575+0000","last_peered":"2023-10-21T18:28:50.048575+0000","last_clean":"2023-10-21T18:28:50.048575+0000","last_became_active":"2023-10-21T16:27:31.875002+0000","last_became_peered":"2023-10-21T16:27:31.875002+0000","last_unstale":"2023-10-21T18:28:50.048575+0000","last_undegraded":"2023-10-21T18:28:50.048575+0000","last_fullsized":"2023-10-21T18:28:50.048575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'406","last_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_deep_scrub":"25'406","last_deep_scrub_stamp":"2023-10-21T18:28:50.048504+0000","last_clean_scrub_stamp":"2023-10-21T18:28:50.048504+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:34:45.694640+0000","scrub_duration":0.0038304010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":29169,"num_write":368,"num_write_kb":63039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'726","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:45.574076+0000","last_change":"2023-10-21T18:28:45.574076+0000","last_active":"2023-10-21T18:28:45.574076+0000","last_peered":"2023-10-21T18:28:45.574076+0000","last_clean":"2023-10-21T18:28:45.574076+0000","last_became_active":"2023-10-21T16:27:30.336450+0000","last_became_peered":"2023-10-21T16:27:30.336450+0000","last_unstale":"2023-10-21T18:28:45.574076+0000","last_undegraded":"2023-10-21T18:28:45.574076+0000","last_fullsized":"2023-10-21T18:28:45.574076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'726","last_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_deep_scrub":"25'726","last_deep_scrub_stamp":"2023-10-21T18:28:45.573759+0000","last_clean_scrub_stamp":"2023-10-21T18:28:45.573759+0000","objects_scrubbed":3,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:35:02.509083+0000","scrub_duration":0.061729854000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":12636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'417","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:51.751201+0000","last_change":"2023-10-21T18:28:51.751288+0000","last_active":"2023-10-21T18:28:51.751201+0000","last_peered":"2023-10-21T18:28:51.751201+0000","last_clean":"2023-10-21T18:28:51.751201+0000","last_became_active":"2023-10-21T16:27:31.891969+0000","last_became_peered":"2023-10-21T16:27:31.891969+0000","last_unstale":"2023-10-21T18:28:51.751201+0000","last_undegraded":"2023-10-21T18:28:51.751201+0000","last_fullsized":"2023-10-21T18:28:51.751201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'417","last_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_deep_scrub":"25'417","last_deep_scrub_stamp":"2023-10-21T18:28:51.751118+0000","last_clean_scrub_stamp":"2023-10-21T18:28:51.751118+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:25.401345+0000","scrub_duration":0.0042027590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85161,"num_write":383,"num_write_kb":93207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'1496","reported_seq":3018,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.592629+0000","last_change":"2023-10-21T18:28:34.592678+0000","last_active":"2023-10-21T18:28:34.592629+0000","last_peered":"2023-10-21T18:28:34.592629+0000","last_clean":"2023-10-21T18:28:34.592629+0000","last_became_active":"2023-10-21T16:27:30.321618+0000","last_became_peered":"2023-10-21T16:27:30.321618+0000","last_unstale":"2023-10-21T18:28:34.592629+0000","last_undegraded":"2023-10-21T18:28:34.592629+0000","last_fullsized":"2023-10-21T18:28:34.592629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1496","last_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_deep_scrub":"25'1496","last_deep_scrub_stamp":"2023-10-21T18:28:34.592545+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.592545+0000","objects_scrubbed":1,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:50:54.878023+0000","scrub_duration":0.0053032239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462581,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":1442,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'381","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.665936+0000","last_change":"2023-10-21T18:28:37.665972+0000","last_active":"2023-10-21T18:28:37.665936+0000","last_peered":"2023-10-21T18:28:37.665936+0000","last_clean":"2023-10-21T18:28:37.665936+0000","last_became_active":"2023-10-21T16:27:31.896210+0000","last_became_peered":"2023-10-21T16:27:31.896210+0000","last_unstale":"2023-10-21T18:28:37.665936+0000","last_undegraded":"2023-10-21T18:28:37.665936+0000","last_fullsized":"2023-10-21T18:28:37.665936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'381","last_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_deep_scrub":"25'381","last_deep_scrub_stamp":"2023-10-21T18:28:37.665867+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.665867+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:44:14.652085+0000","scrub_duration":0.00173624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":39696,"num_write":351,"num_write_kb":46257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'394","reported_seq":475,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:58.665539+0000","last_change":"2023-10-21T18:28:58.665660+0000","last_active":"2023-10-21T18:28:58.665539+0000","last_peered":"2023-10-21T18:28:58.665539+0000","last_clean":"2023-10-21T18:28:58.665539+0000","last_became_active":"2023-10-21T16:27:30.342053+0000","last_became_peered":"2023-10-21T16:27:30.342053+0000","last_unstale":"2023-10-21T18:28:58.665539+0000","last_undegraded":"2023-10-21T18:28:58.665539+0000","last_fullsized":"2023-10-21T18:28:58.665539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'394","last_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_deep_scrub":"25'394","last_deep_scrub_stamp":"2023-10-21T18:28:58.665360+0000","last_clean_scrub_stamp":"2023-10-21T18:28:58.665360+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:22:38.030747+0000","scrub_duration":0.038550477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'392","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.062134+0000","last_change":"2023-10-21T18:29:00.062351+0000","last_active":"2023-10-21T18:29:00.062134+0000","last_peered":"2023-10-21T18:29:00.062134+0000","last_clean":"2023-10-21T18:29:00.062134+0000","last_became_active":"2023-10-21T16:27:31.934912+0000","last_became_peered":"2023-10-21T16:27:31.934912+0000","last_unstale":"2023-10-21T18:29:00.062134+0000","last_undegraded":"2023-10-21T18:29:00.062134+0000","last_fullsized":"2023-10-21T18:29:00.062134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2023-10-21T18:29:00.061847+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.061847+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T18:48:35.532076+0000","scrub_duration":0.0059602409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":23834,"num_write":360,"num_write_kb":26289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'412","reported_seq":493,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:27.803226+0000","last_change":"2023-10-21T18:28:27.803298+0000","last_active":"2023-10-21T18:28:27.803226+0000","last_peered":"2023-10-21T18:28:27.803226+0000","last_clean":"2023-10-21T18:28:27.803226+0000","last_became_active":"2023-10-21T16:27:30.318692+0000","last_became_peered":"2023-10-21T16:27:30.318692+0000","last_unstale":"2023-10-21T18:28:27.803226+0000","last_undegraded":"2023-10-21T18:28:27.803226+0000","last_fullsized":"2023-10-21T18:28:27.803226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2023-10-21T18:28:27.803157+0000","last_clean_scrub_stamp":"2023-10-21T18:28:27.803157+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:26:58.915015+0000","scrub_duration":0.013419940999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'410","reported_seq":501,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:42.790738+0000","last_change":"2023-10-21T18:28:42.790738+0000","last_active":"2023-10-21T18:28:42.790738+0000","last_peered":"2023-10-21T18:28:42.790738+0000","last_clean":"2023-10-21T18:28:42.790738+0000","last_became_active":"2023-10-21T16:27:31.890149+0000","last_became_peered":"2023-10-21T16:27:31.890149+0000","last_unstale":"2023-10-21T18:28:42.790738+0000","last_undegraded":"2023-10-21T18:28:42.790738+0000","last_fullsized":"2023-10-21T18:28:42.790738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2023-10-21T18:28:42.790342+0000","last_clean_scrub_stamp":"2023-10-21T18:28:42.790342+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T03:48:47.994060+0000","scrub_duration":0.0044279569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20259,"num_write":358,"num_write_kb":63079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'590","reported_seq":671,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:15.628519+0000","last_change":"2023-10-21T18:29:15.628647+0000","last_active":"2023-10-21T18:29:15.628519+0000","last_peered":"2023-10-21T18:29:15.628519+0000","last_clean":"2023-10-21T18:29:15.628519+0000","last_became_active":"2023-10-21T16:27:30.338931+0000","last_became_peered":"2023-10-21T16:27:30.338931+0000","last_unstale":"2023-10-21T18:29:15.628519+0000","last_undegraded":"2023-10-21T18:29:15.628519+0000","last_fullsized":"2023-10-21T18:29:15.628519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'590","last_scrub_stamp":"2023-10-21T18:29:15.628361+0000","last_deep_scrub":"25'590","last_deep_scrub_stamp":"2023-10-21T18:29:15.628361+0000","last_clean_scrub_stamp":"2023-10-21T18:29:15.628361+0000","objects_scrubbed":2,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T19:58:24.880560+0000","scrub_duration":0.054942662000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":8456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'377","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.799414+0000","last_change":"2023-10-21T18:28:48.799478+0000","last_active":"2023-10-21T18:28:48.799414+0000","last_peered":"2023-10-21T18:28:48.799414+0000","last_clean":"2023-10-21T18:28:48.799414+0000","last_became_active":"2023-10-21T16:27:31.888722+0000","last_became_peered":"2023-10-21T16:27:31.888722+0000","last_unstale":"2023-10-21T18:28:48.799414+0000","last_undegraded":"2023-10-21T18:28:48.799414+0000","last_fullsized":"2023-10-21T18:28:48.799414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'377","last_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_deep_scrub":"25'377","last_deep_scrub_stamp":"2023-10-21T18:28:48.799323+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.799323+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:42:35.602039+0000","scrub_duration":0.002269002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10908,"num_write":342,"num_write_kb":26076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1346","reported_seq":1425,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.973398+0000","last_change":"2023-10-21T18:28:38.973398+0000","last_active":"2023-10-21T18:28:38.973398+0000","last_peered":"2023-10-21T18:28:38.973398+0000","last_clean":"2023-10-21T18:28:38.973398+0000","last_became_active":"2023-10-21T16:27:30.322782+0000","last_became_peered":"2023-10-21T16:27:30.322782+0000","last_unstale":"2023-10-21T18:28:38.973398+0000","last_undegraded":"2023-10-21T18:28:38.973398+0000","last_fullsized":"2023-10-21T18:28:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1346","last_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_deep_scrub":"25'1346","last_deep_scrub_stamp":"2023-10-21T18:28:38.973260+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.973260+0000","objects_scrubbed":1,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:25:12.623488+0000","scrub_duration":0.016535959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3534,"num_write_kb":2340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'364","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:55.154590+0000","last_change":"2023-10-21T18:28:55.154631+0000","last_active":"2023-10-21T18:28:55.154590+0000","last_peered":"2023-10-21T18:28:55.154590+0000","last_clean":"2023-10-21T18:28:55.154590+0000","last_became_active":"2023-10-21T16:27:31.889328+0000","last_became_peered":"2023-10-21T16:27:31.889328+0000","last_unstale":"2023-10-21T18:28:55.154590+0000","last_undegraded":"2023-10-21T18:28:55.154590+0000","last_fullsized":"2023-10-21T18:28:55.154590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'364","last_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_deep_scrub":"25'364","last_deep_scrub_stamp":"2023-10-21T18:28:55.154507+0000","last_clean_scrub_stamp":"2023-10-21T18:28:55.154507+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:01:25.427604+0000","scrub_duration":0.0015667109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32080,"num_write":339,"num_write_kb":38579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'322","reported_seq":401,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:44.530044+0000","last_change":"2023-10-21T18:28:44.530044+0000","last_active":"2023-10-21T18:28:44.530044+0000","last_peered":"2023-10-21T18:28:44.530044+0000","last_clean":"2023-10-21T18:28:44.530044+0000","last_became_active":"2023-10-21T16:27:30.346396+0000","last_became_peered":"2023-10-21T16:27:30.346396+0000","last_unstale":"2023-10-21T18:28:44.530044+0000","last_undegraded":"2023-10-21T18:28:44.530044+0000","last_fullsized":"2023-10-21T18:28:44.530044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'322","last_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_deep_scrub":"25'322","last_deep_scrub_stamp":"2023-10-21T18:28:44.529753+0000","last_clean_scrub_stamp":"2023-10-21T18:28:44.529753+0000","objects_scrubbed":2,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:22:36.717064+0000","scrub_duration":0.032510153999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'463","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:39.982468+0000","last_change":"2023-10-21T18:28:39.982468+0000","last_active":"2023-10-21T18:28:39.982468+0000","last_peered":"2023-10-21T18:28:39.982468+0000","last_clean":"2023-10-21T18:28:39.982468+0000","last_became_active":"2023-10-21T16:27:31.896798+0000","last_became_peered":"2023-10-21T16:27:31.896798+0000","last_unstale":"2023-10-21T18:28:39.982468+0000","last_undegraded":"2023-10-21T18:28:39.982468+0000","last_fullsized":"2023-10-21T18:28:39.982468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'463","last_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_deep_scrub":"25'463","last_deep_scrub_stamp":"2023-10-21T18:28:39.982361+0000","last_clean_scrub_stamp":"2023-10-21T18:28:39.982361+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:46.690293+0000","scrub_duration":0.0022391640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":97285,"num_write":428,"num_write_kb":152212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'262","reported_seq":341,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:28.764488+0000","last_change":"2023-10-21T18:28:28.764488+0000","last_active":"2023-10-21T18:28:28.764488+0000","last_peered":"2023-10-21T18:28:28.764488+0000","last_clean":"2023-10-21T18:28:28.764488+0000","last_became_active":"2023-10-21T16:27:30.331331+0000","last_became_peered":"2023-10-21T16:27:30.331331+0000","last_unstale":"2023-10-21T18:28:28.764488+0000","last_undegraded":"2023-10-21T18:28:28.764488+0000","last_fullsized":"2023-10-21T18:28:28.764488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'262","last_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_deep_scrub":"25'262","last_deep_scrub_stamp":"2023-10-21T18:28:28.764322+0000","last_clean_scrub_stamp":"2023-10-21T18:28:28.764322+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:51:51.349764+0000","scrub_duration":0.017180768999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'421","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:37.628656+0000","last_change":"2023-10-21T18:28:37.628656+0000","last_active":"2023-10-21T18:28:37.628656+0000","last_peered":"2023-10-21T18:28:37.628656+0000","last_clean":"2023-10-21T18:28:37.628656+0000","last_became_active":"2023-10-21T16:27:31.909030+0000","last_became_peered":"2023-10-21T16:27:31.909030+0000","last_unstale":"2023-10-21T18:28:37.628656+0000","last_undegraded":"2023-10-21T18:28:37.628656+0000","last_fullsized":"2023-10-21T18:28:37.628656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:37.628358+0000","last_clean_scrub_stamp":"2023-10-21T18:28:37.628358+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T22:43:36.552484+0000","scrub_duration":0.0042654920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18616,"num_write":385,"num_write_kb":13854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'421","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:33.920158+0000","last_change":"2023-10-21T18:28:33.920158+0000","last_active":"2023-10-21T18:28:33.920158+0000","last_peered":"2023-10-21T18:28:33.920158+0000","last_clean":"2023-10-21T18:28:33.920158+0000","last_became_active":"2023-10-21T16:27:30.330688+0000","last_became_peered":"2023-10-21T16:27:30.330688+0000","last_unstale":"2023-10-21T18:28:33.920158+0000","last_undegraded":"2023-10-21T18:28:33.920158+0000","last_fullsized":"2023-10-21T18:28:33.920158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2023-10-21T18:28:33.919990+0000","last_clean_scrub_stamp":"2023-10-21T18:28:33.919990+0000","objects_scrubbed":1,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T23:02:20.582216+0000","scrub_duration":0.031339309000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'402","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:46.008047+0000","last_change":"2023-10-21T18:28:46.008047+0000","last_active":"2023-10-21T18:28:46.008047+0000","last_peered":"2023-10-21T18:28:46.008047+0000","last_clean":"2023-10-21T18:28:46.008047+0000","last_became_active":"2023-10-21T16:27:31.897614+0000","last_became_peered":"2023-10-21T16:27:31.897614+0000","last_unstale":"2023-10-21T18:28:46.008047+0000","last_undegraded":"2023-10-21T18:28:46.008047+0000","last_fullsized":"2023-10-21T18:28:46.008047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2023-10-21T18:28:46.007918+0000","last_clean_scrub_stamp":"2023-10-21T18:28:46.007918+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:19:26.978090+0000","scrub_duration":0.0024174869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":25448,"num_write":373,"num_write_kb":34211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1150","reported_seq":1229,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.872930+0000","last_change":"2023-10-21T18:28:35.872930+0000","last_active":"2023-10-21T18:28:35.872930+0000","last_peered":"2023-10-21T18:28:35.872930+0000","last_clean":"2023-10-21T18:28:35.872930+0000","last_became_active":"2023-10-21T16:27:30.321211+0000","last_became_peered":"2023-10-21T16:27:30.321211+0000","last_unstale":"2023-10-21T18:28:35.872930+0000","last_undegraded":"2023-10-21T18:28:35.872930+0000","last_fullsized":"2023-10-21T18:28:35.872930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1150","last_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_deep_scrub":"25'1150","last_deep_scrub_stamp":"2023-10-21T18:28:35.872800+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.872800+0000","objects_scrubbed":2,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:29:13.547254+0000","scrub_duration":0.023641031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":8734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'428","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:48.375757+0000","last_change":"2023-10-21T18:28:48.375757+0000","last_active":"2023-10-21T18:28:48.375757+0000","last_peered":"2023-10-21T18:28:48.375757+0000","last_clean":"2023-10-21T18:28:48.375757+0000","last_became_active":"2023-10-21T16:27:31.900641+0000","last_became_peered":"2023-10-21T16:27:31.900641+0000","last_unstale":"2023-10-21T18:28:48.375757+0000","last_undegraded":"2023-10-21T18:28:48.375757+0000","last_fullsized":"2023-10-21T18:28:48.375757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2023-10-21T18:28:48.375634+0000","last_clean_scrub_stamp":"2023-10-21T18:28:48.375634+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T01:27:22.872575+0000","scrub_duration":0.0018102509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":31194,"num_write":404,"num_write_kb":59042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1141","reported_seq":1218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:00.697327+0000","last_change":"2023-10-21T18:29:00.697460+0000","last_active":"2023-10-21T18:29:00.697327+0000","last_peered":"2023-10-21T18:29:00.697327+0000","last_clean":"2023-10-21T18:29:00.697327+0000","last_became_active":"2023-10-21T16:27:30.339071+0000","last_became_peered":"2023-10-21T16:27:30.339071+0000","last_unstale":"2023-10-21T18:29:00.697327+0000","last_undegraded":"2023-10-21T18:29:00.697327+0000","last_fullsized":"2023-10-21T18:29:00.697327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1141","last_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_deep_scrub":"25'1141","last_deep_scrub_stamp":"2023-10-21T18:29:00.697114+0000","last_clean_scrub_stamp":"2023-10-21T18:29:00.697114+0000","objects_scrubbed":4,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T21:28:47.299927+0000","scrub_duration":0.078786130999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":12790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'449","reported_seq":549,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:16.535433+0000","last_change":"2023-10-21T18:29:16.535558+0000","last_active":"2023-10-21T18:29:16.535433+0000","last_peered":"2023-10-21T18:29:16.535433+0000","last_clean":"2023-10-21T18:29:16.535433+0000","last_became_active":"2023-10-21T16:27:31.916258+0000","last_became_peered":"2023-10-21T16:27:31.916258+0000","last_unstale":"2023-10-21T18:29:16.535433+0000","last_undegraded":"2023-10-21T18:29:16.535433+0000","last_fullsized":"2023-10-21T18:29:16.535433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'449","last_scrub_stamp":"2023-10-21T18:29:16.535255+0000","last_deep_scrub":"25'449","last_deep_scrub_stamp":"2023-10-21T18:29:16.535255+0000","last_clean_scrub_stamp":"2023-10-21T18:29:16.535255+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:55:08.227715+0000","scrub_duration":0.0058660509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64632,"num_write":413,"num_write_kb":76013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'451","reported_seq":548,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:37.658679+0000","last_change":"2023-10-21T18:29:37.658871+0000","last_active":"2023-10-21T18:29:37.658679+0000","last_peered":"2023-10-21T18:29:37.658679+0000","last_clean":"2023-10-21T18:29:37.658679+0000","last_became_active":"2023-10-21T16:27:31.926823+0000","last_became_peered":"2023-10-21T16:27:31.926823+0000","last_unstale":"2023-10-21T18:29:37.658679+0000","last_undegraded":"2023-10-21T18:29:37.658679+0000","last_fullsized":"2023-10-21T18:29:37.658679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'451","last_scrub_stamp":"2023-10-21T18:29:37.658487+0000","last_deep_scrub":"25'451","last_deep_scrub_stamp":"2023-10-21T18:29:37.658487+0000","last_clean_scrub_stamp":"2023-10-21T18:29:37.658487+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:01:36.644058+0000","scrub_duration":0.0060235100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":75948,"num_write":410,"num_write_kb":125825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'767","reported_seq":838,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:38.901291+0000","last_change":"2023-10-21T18:28:38.901414+0000","last_active":"2023-10-21T18:28:38.901291+0000","last_peered":"2023-10-21T18:28:38.901291+0000","last_clean":"2023-10-21T18:28:38.901291+0000","last_became_active":"2023-10-21T16:27:30.336350+0000","last_became_peered":"2023-10-21T16:27:30.336350+0000","last_unstale":"2023-10-21T18:28:38.901291+0000","last_undegraded":"2023-10-21T18:28:38.901291+0000","last_fullsized":"2023-10-21T18:28:38.901291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'767","last_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_deep_scrub":"25'767","last_deep_scrub_stamp":"2023-10-21T18:28:38.901093+0000","last_clean_scrub_stamp":"2023-10-21T18:28:38.901093+0000","objects_scrubbed":2,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T02:12:45.609026+0000","scrub_duration":0.038403093999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'370","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:47.970215+0000","last_change":"2023-10-21T18:28:47.970410+0000","last_active":"2023-10-21T18:28:47.970215+0000","last_peered":"2023-10-21T18:28:47.970215+0000","last_clean":"2023-10-21T18:28:47.970215+0000","last_became_active":"2023-10-21T16:27:31.928118+0000","last_became_peered":"2023-10-21T16:27:31.928118+0000","last_unstale":"2023-10-21T18:28:47.970215+0000","last_undegraded":"2023-10-21T18:28:47.970215+0000","last_fullsized":"2023-10-21T18:28:47.970215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'370","last_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_deep_scrub":"25'370","last_deep_scrub_stamp":"2023-10-21T18:28:47.969971+0000","last_clean_scrub_stamp":"2023-10-21T18:28:47.969971+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T00:27:19.081829+0000","scrub_duration":0.0057846690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36409,"num_write":341,"num_write_kb":54834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1576","reported_seq":1647,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:34.953119+0000","last_change":"2023-10-21T18:28:34.953300+0000","last_active":"2023-10-21T18:28:34.953119+0000","last_peered":"2023-10-21T18:28:34.953119+0000","last_clean":"2023-10-21T18:28:34.953119+0000","last_became_active":"2023-10-21T16:27:30.336206+0000","last_became_peered":"2023-10-21T16:27:30.336206+0000","last_unstale":"2023-10-21T18:28:34.953119+0000","last_undegraded":"2023-10-21T18:28:34.953119+0000","last_fullsized":"2023-10-21T18:28:34.953119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1576","last_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_deep_scrub":"25'1576","last_deep_scrub_stamp":"2023-10-21T18:28:34.952989+0000","last_clean_scrub_stamp":"2023-10-21T18:28:34.952989+0000","objects_scrubbed":5,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T04:17:40.153808+0000","scrub_duration":0.10868122500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1513,"num_write_kb":17143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'358","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:19.649842+0000","last_change":"2023-10-21T18:29:19.649910+0000","last_active":"2023-10-21T18:29:19.649842+0000","last_peered":"2023-10-21T18:29:19.649842+0000","last_clean":"2023-10-21T18:29:19.649842+0000","last_became_active":"2023-10-21T16:27:31.917726+0000","last_became_peered":"2023-10-21T16:27:31.917726+0000","last_unstale":"2023-10-21T18:29:19.649842+0000","last_undegraded":"2023-10-21T18:29:19.649842+0000","last_fullsized":"2023-10-21T18:29:19.649842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'358","last_scrub_stamp":"2023-10-21T18:29:19.649731+0000","last_deep_scrub":"25'358","last_deep_scrub_stamp":"2023-10-21T18:29:19.649731+0000","last_clean_scrub_stamp":"2023-10-21T18:29:19.649731+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-22T20:31:36.734701+0000","scrub_duration":0.0031332920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":49291,"num_write":334,"num_write_kb":58650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'570","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:30.761823+0000","last_change":"2023-10-21T18:28:30.761864+0000","last_active":"2023-10-21T18:28:30.761823+0000","last_peered":"2023-10-21T18:28:30.761823+0000","last_clean":"2023-10-21T18:28:30.761823+0000","last_became_active":"2023-10-21T16:27:30.318727+0000","last_became_peered":"2023-10-21T16:27:30.318727+0000","last_unstale":"2023-10-21T18:28:30.761823+0000","last_undegraded":"2023-10-21T18:28:30.761823+0000","last_fullsized":"2023-10-21T18:28:30.761823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'570","last_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_deep_scrub":"25'570","last_deep_scrub_stamp":"2023-10-21T18:28:30.761761+0000","last_clean_scrub_stamp":"2023-10-21T18:28:30.761761+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:43.428584+0000","scrub_duration":0.020968085000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'382","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:29:03.636179+0000","last_change":"2023-10-21T18:29:03.636219+0000","last_active":"2023-10-21T18:29:03.636179+0000","last_peered":"2023-10-21T18:29:03.636179+0000","last_clean":"2023-10-21T18:29:03.636179+0000","last_became_active":"2023-10-21T16:27:31.718954+0000","last_became_peered":"2023-10-21T16:27:31.718954+0000","last_unstale":"2023-10-21T18:29:03.636179+0000","last_undegraded":"2023-10-21T18:29:03.636179+0000","last_fullsized":"2023-10-21T18:29:03.636179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'382","last_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_deep_scrub":"25'382","last_deep_scrub_stamp":"2023-10-21T18:29:03.636095+0000","last_clean_scrub_stamp":"2023-10-21T18:29:03.636095+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:24:17.188213+0000","scrub_duration":0.0043045710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":77824,"num_write":342,"num_write_kb":79470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'611","reported_seq":692,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-21T18:28:35.955503+0000","last_change":"2023-10-21T18:28:35.955562+0000","last_active":"2023-10-21T18:28:35.955503+0000","last_peered":"2023-10-21T18:28:35.955503+0000","last_clean":"2023-10-21T18:28:35.955503+0000","last_became_active":"2023-10-21T16:27:30.343267+0000","last_became_peered":"2023-10-21T16:27:30.343267+0000","last_unstale":"2023-10-21T18:28:35.955503+0000","last_undegraded":"2023-10-21T18:28:35.955503+0000","last_fullsized":"2023-10-21T18:28:35.955503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'611","last_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_deep_scrub":"25'611","last_deep_scrub_stamp":"2023-10-21T18:28:35.955427+0000","last_clean_scrub_stamp":"2023-10-21T18:28:35.955427+0000","objects_scrubbed":4,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-23T05:53:48.622250+0000","scrub_duration":0.046963560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":8491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1113,"num_read_kb":3397797,"num_write":24388,"num_write_kb":4347776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26357,"ondisk_log_size":26357,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216339300,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1441,"num_read_kb":2459,"num_write":24246,"num_write_kb":225038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":432742400,"data_stored":432678600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23888,"ondisk_log_size":23888,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719478213,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161860,"kb_used_data":86268,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94209980,"statfs":{"total":96636764160,"available":96471019520,"internally_reserved":0,"allocated":88338432,"data_stored":88172823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77396424},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0669999999999999,"15min":1.0940000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4850000000000001,"5min":1.704,"15min":2.2519999999999998},"last":0.999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2390000000000001,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.67100000000000004,"15min":0.64900000000000002},"max":{"1min":1.7629999999999999,"5min":2.0960000000000001,"15min":3.1429999999999998},"last":0.82799999999999996}]},{"osd":1,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2749999999999999,"15min":1.274},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.978,"5min":2.25,"15min":2.25},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8859999999999999,"5min":1.9450000000000001,"15min":3.7919999999999998},"last":1.268}]},{"osd":2,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.508,"15min":1.522},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.093,"5min":2.367,"15min":2.367},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.6669999999999998},"last":1.639}]},{"osd":4,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2929999999999999,"15min":1.325},"min":{"1min":0.84099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.782},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3480000000000001,"15min":1.373},"min":{"1min":0.877,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9430000000000001,"5min":2.1240000000000001,"15min":2.319},"last":1.391}]},{"osd":5,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4379999999999999,"15min":1.4710000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.70099999999999996},"max":{"1min":2.0070000000000001,"5min":2.3460000000000001,"15min":2.4630000000000001},"last":1.609},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4910000000000001,"15min":1.5269999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.395,"5min":2.395,"15min":2.423},"last":1.468}]},{"osd":6,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.514},"min":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.9249999999999998},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.6220000000000001,"15min":1.633},"min":{"1min":0.97899999999999998,"5min":0.86799999999999999,"15min":0.746},"max":{"1min":2.331,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5169999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:29:07 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.6319999999999999,"15min":1.671},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.496,"5min":2.496,"15min":2.5169999999999999},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.6040000000000001,"15min":1.645},"min":{"1min":0.96499999999999997,"5min":0.85199999999999998,"15min":0.80600000000000005},"max":{"1min":2.1600000000000001,"5min":2.2400000000000002,"15min":3.0449999999999999},"last":1.575}]}]},{"osd":2,"up_from":16,"seq":68719478214,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78088,"kb_used_data":33024,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293752,"statfs":{"total":96636764160,"available":96556802048,"internally_reserved":0,"allocated":33816576,"data_stored":33646961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.99099999999999999,"15min":1.044},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.439},"max":{"1min":1.6399999999999999,"5min":1.7430000000000001,"15min":3.153},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.254,"15min":1.2350000000000001},"min":{"1min":0.72299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.9970000000000001,"5min":2.0609999999999999,"15min":2.1560000000000001},"last":1.4730000000000001}]},{"osd":1,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.339,"15min":1.3680000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8500000000000001,"5min":2.198,"15min":2.7480000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.63400000000000001},"max":{"1min":1.8400000000000001,"5min":2.335,"15min":2.621},"last":1.5389999999999999}]},{"osd":3,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3660000000000001,"15min":1.391},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.746,"5min":2.3100000000000001,"15min":3.5070000000000001},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5840000000000001,"15min":1.6180000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.79600000000000004},"max":{"1min":2.2200000000000002,"5min":2.3130000000000002,"15min":3.867},"last":1.6160000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":0.91600000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.895},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.319,"15min":1.355},"min":{"1min":0.84899999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":1.9730000000000001,"15min":2.3929999999999998},"last":1.073}]},{"osd":5,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.411,"15min":1.4379999999999999},"min":{"1min":1.0089999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9690000000000001,"5min":2.2320000000000002,"15min":2.524},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.3560000000000001,"15min":1.351},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.59899999999999998},"max":{"1min":2.319,"5min":2.319,"15min":2.7360000000000002},"last":1.304}]},{"osd":6,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4510000000000001,"15min":1.4530000000000001},"min":{"1min":0.84199999999999997,"5min":0.77100000000000002,"15min":0.64400000000000002},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.9689999999999999},"last":1.506},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.452,"15min":1.514},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.84099999999999997},"max":{"1min":2.0619999999999998,"5min":2.1360000000000001,"15min":3.0259999999999998},"last":1.4390000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5900000000000001,"15min":1.591},"min":{"1min":1.099,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1000000000000001,"5min":2.2200000000000002,"15min":2.8029999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.571,"15min":1.5700000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.622},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.8620000000000001},"last":1.639}]}]},{"osd":1,"up_from":16,"seq":68719478214,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":50928,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":52150272,"data_stored":51979688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0389999999999999,"15min":1.0580000000000001},"min":{"1min":0.63200000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.7450000000000001,"15min":1.9730000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2849999999999999,"15min":1.2569999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.79,"5min":2.0339999999999998,"15min":2.1000000000000001},"last":1.3200000000000001}]},{"osd":2,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.173,"15min":1.2},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8700000000000001,"5min":2.0009999999999999,"15min":2.6539999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.29,"5min":1.3740000000000001,"15min":1.4059999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.673,"5min":2.0550000000000002,"15min":2.5779999999999998},"last":1.794}]},{"osd":3,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4650000000000001,"15min":1.498},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.913,"5min":2.0739999999999998,"15min":2.681},"last":1.619},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.496,"15min":1.5389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8919999999999999,"5min":2.1480000000000001,"15min":2.3140000000000001},"last":1.748}]},{"osd":4,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.333,"15min":1.361},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.66100000000000003},"max":{"1min":1.752,"5min":2.04,"15min":2.3130000000000002},"last":1.147},{"interface":"front","average":{"1min":1.292,"5min":1.341,"15min":1.3680000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.613,"5min":1.958,"15min":2.1600000000000001},"last":1.109}]},{"osd":5,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4379999999999999,"15min":1.468},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9139999999999999,"5min":2.1240000000000001,"15min":2.3610000000000002},"last":1.381},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4890000000000001,"15min":1.514},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.145,"5min":2.165,"15min":2.6850000000000001},"last":1.879}]},{"osd":6,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.5089999999999999,"15min":1.52},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.843,"5min":2.173,"15min":2.5459999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.573,"15min":1.611},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.78900000000000003},"max":{"1min":1.962,"5min":2.0859999999999999,"15min":2.5379999999999998},"last":1.5229999999999999}]},{"osd":7,"last update":"Sat Oct 21 18:29:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.647,"15min":1.667},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.2770000000000001,"5min":2.3319999999999999,"15min":2.7570000000000001},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.6559999999999999,"15min":1.6819999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.986,"5min":2.4649999999999999,"15min":2.6230000000000002},"last":1.5700000000000001}]}]},{"osd":0,"up_from":16,"seq":68719478215,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172600,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94199240,"statfs":{"total":96636764160,"available":96460021760,"internally_reserved":0,"allocated":85114880,"data_stored":84943738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.091,"15min":1.099},"min":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8939999999999999,"5min":1.95,"15min":2.04},"last":1.429},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2450000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6990000000000001,"5min":2.0539999999999998,"15min":2.161},"last":0.86699999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2410000000000001,"15min":1.2869999999999999},"min":{"1min":0.75900000000000001,"5min":0.65400000000000003,"15min":0.60599999999999998},"max":{"1min":1.8149999999999999,"5min":1.95,"15min":2.3820000000000001},"last":1.617},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4019999999999999,"15min":1.423},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.008,"5min":2.1219999999999999,"15min":2.5550000000000002},"last":1.514}]},{"osd":3,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4770000000000001,"15min":1.472},"min":{"1min":0.996,"5min":0.81100000000000005,"15min":0.53500000000000003},"max":{"1min":2.0129999999999999,"5min":2.2480000000000002,"15min":2.4140000000000001},"last":1.651},{"interface":"front","average":{"1min":1.5,"5min":1.4890000000000001,"15min":1.512},"min":{"1min":1.1339999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9590000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.6910000000000001}]},{"osd":4,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.347,"15min":1.369},"min":{"1min":0.91700000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2360000000000002,"5min":2.3929999999999998,"15min":2.6230000000000002},"last":1.26},{"interface":"front","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.105,"5min":2.113,"15min":2.1600000000000001},"last":1.351}]},{"osd":5,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.3340000000000001,"15min":1.4019999999999999},"min":{"1min":0.89300000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.3420000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.526,"15min":1.5409999999999999},"min":{"1min":0.80100000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.3140000000000001,"5min":2.597,"15min":2.7370000000000001},"last":1.5680000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.4350000000000001,"15min":1.4850000000000001},"min":{"1min":1.157,"5min":0.628,"15min":0.628},"max":{"1min":2.3380000000000001,"5min":2.3660000000000001,"15min":2.4649999999999999},"last":1.474},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.484,"15min":1.544},"min":{"1min":0.69699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":2.407,"5min":2.407,"15min":2.4220000000000002},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.585,"15min":1.6639999999999999},"min":{"1min":0.97899999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.3},{"interface":"front","average":{"1min":1.7,"5min":1.667,"15min":1.6919999999999999},"min":{"1min":0.93700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3780000000000001,"5min":2.6829999999999998,"15min":2.8969999999999998},"last":1.129}]}]},{"osd":6,"up_from":15,"seq":64424510918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78080,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94293760,"statfs":{"total":96636764160,"available":96556810240,"internally_reserved":0,"allocated":33808384,"data_stored":33646289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.752,"15min":0.745},"min":{"1min":0.432,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.097,"5min":1.224,"15min":1.224},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":1.079,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.385},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96299999999999997,"5min":1.395,"15min":1.395},"last":0.86599999999999999}]},{"osd":2,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.5069999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.76100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.085,"5min":1.1120000000000001,"15min":2.1840000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.05,"5min":1.2450000000000001,"15min":1.321},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1850000000000001,"15min":1.327},"last":0.90700000000000003}]},{"osd":4,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.82699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.67100000000000004,"15min":0.69999999999999996},"last":0.436}]},{"osd":5,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41899999999999998,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.64300000000000002,"15min":0.76200000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.45400000000000001,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29499999999999998},"max":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.80200000000000005},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.60599999999999998,"5min":0.70099999999999996,"15min":0.85699999999999998},"last":0.45600000000000002}]}]},{"osd":5,"up_from":15,"seq":64424510918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114532,"kb_used_data":51420,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94257308,"statfs":{"total":96636764160,"available":96519483392,"internally_reserved":0,"allocated":52654080,"data_stored":52476546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.077,"5min":1.1020000000000001,"15min":1.212},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.44,"5min":0.44,"15min":0.42399999999999999},"max":{"1min":1.109,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.554},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0489999999999999,"15min":1.419},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.59599999999999997,"5min":0.40699999999999997,"15min":0.39300000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.264},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.101,"5min":1.2250000000000001,"15min":2.1890000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.095,"5min":1.379,"15min":1.446},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.628,"5min":0.51200000000000001,"15min":0.45400000000000001},"max":{"1min":1.1220000000000001,"5min":1.2769999999999999,"15min":1.405},"last":0.627}]},{"osd":4,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42199999999999999,"15min":0.43099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.63200000000000001,"15min":0.68799999999999994},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.67500000000000004},"last":0.25900000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26200000000000001},"max":{"1min":0.63500000000000001,"5min":0.66100000000000003,"15min":0.68200000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.72199999999999998},"last":0.317}]},{"osd":7,"last update":"Sat Oct 21 18:29:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.73199999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76300000000000001},"last":0.33500000000000002}]}]},{"osd":4,"up_from":15,"seq":64424510918,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120784,"kb_used_data":53512,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94251056,"statfs":{"total":96636764160,"available":96513081344,"internally_reserved":0,"allocated":54796288,"data_stored":54619153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.093,"5min":1.097,"15min":1.349},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.754},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97599999999999998,"5min":1.2929999999999999,"15min":1.355},"last":0.73899999999999999}]},{"osd":1,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.77700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.429},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.075,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.435,"15min":0.432},"max":{"1min":1.2509999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.349},"last":0.94099999999999995}]},{"osd":3,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0940000000000001,"5min":1.2869999999999999,"15min":1.361},"last":0.879},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.80800000000000005},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.23,"5min":1.893,"15min":1.893},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.68400000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.437,"15min":0.45300000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.89100000000000001},"last":0.39000000000000001}]},{"osd":6,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58999999999999997,"5min":0.76400000000000001,"15min":0.94099999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.46300000000000002},"min":{"1min":0.32000000000000001,"5min":0.314,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":0.74399999999999999,"15min":0.77300000000000002},"last":0.32300000000000001}]},{"osd":7,"last update":"Sat Oct 21 18:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.77700000000000002},"last":0.375},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.30299999999999999},"max":{"1min":0.69899999999999995,"5min":0.72399999999999998,"15min":0.81499999999999995},"last":0.36299999999999999}]}]},{"osd":7,"up_from":14,"seq":60129543621,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101728,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94270112,"statfs":{"total":96636764160,"available":96532594688,"internally_reserved":0,"allocated":35282944,"data_stored":35108994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":68876747},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":1.044,"5min":1.165,"15min":1.234},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.42299999999999999},"max":{"1min":1.054,"5min":1.159,"15min":1.2290000000000001},"last":0.87}]},{"osd":1,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.125,"15min":1.2210000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.274},"last":0.90800000000000003}]},{"osd":2,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.501},"max":{"1min":1.0920000000000001,"5min":1.1599999999999999,"15min":1.347},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56100000000000005,"5min":0.45600000000000002,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.333,"15min":1.333},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3100000000000001,"5min":1.411,"15min":1.411},"last":1.1599999999999999}]},{"osd":4,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":0.50800000000000001,"5min":0.58699999999999997,"15min":0.73799999999999999},"last":0.378},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.63800000000000001,"15min":0.70899999999999996},"last":0.435}]},{"osd":5,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.52300000000000002,"5min":0.65400000000000003,"15min":0.70799999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 21 18:29:15 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.80700000000000005},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84860928,"data_stored":84851881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":51297463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54542336,"data_stored":54527296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51794321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":35017137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-21T18:29:53.291 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-21T18:29:53.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.532+0000 7f7ca2c1f640 1 Processor -- start 2023-10-21T18:29:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.533+0000 7f7ca2c1f640 1 -- start start 2023-10-21T18:29:53.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.534+0000 7f7ca2c1f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.534+0000 7f7ca2c1f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c9c15aa20 0x7f7c9c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.534+0000 7f7ca2c1f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c06d210 con 0x7f7c9c06e150 2023-10-21T18:29:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.534+0000 7f7ca2c1f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c157930 con 0x7f7c9c15aa20 2023-10-21T18:29:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.534+0000 7f7ca2c1f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c157dc0 con 0x7f7c9c1511a0 2023-10-21T18:29:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.535+0000 7f7ca09bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.535+0000 7f7ca09bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34176/0 (socket says 172.21.15.12:34176) 2023-10-21T18:29:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.535+0000 7f7ca09bb640 1 -- 172.21.15.12:0/1148154872 learned_addr learned my addr 172.21.15.12:0/1148154872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.536+0000 7f7c9bfff640 1 --2- 172.21.15.12:0/1148154872 >> v2:172.21.15.99:3300/0 conn(0x7f7c9c15aa20 0x7f7c9c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.538+0000 7f7ca09bb640 1 -- 172.21.15.12:0/1148154872 >> v2:172.21.15.99:3300/0 conn(0x7f7c9c15aa20 msgr2=0x7f7c9c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.538+0000 7f7ca09bb640 1 --2- 172.21.15.12:0/1148154872 >> v2:172.21.15.99:3300/0 conn(0x7f7c9c15aa20 0x7f7c9c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.538+0000 7f7ca09bb640 1 -- 172.21.15.12:0/1148154872 >> v1:172.21.15.99:6789/0 conn(0x7f7c9c06e150 legacy=0x7f7c9c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.538+0000 7f7ca09bb640 1 -- 172.21.15.12:0/1148154872 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0c5380 con 0x7f7c9c1511a0 2023-10-21T18:29:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.541+0000 7f7ca09bb640 1 --2- 172.21.15.12:0/1148154872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009e80 tx=0x7f7c8c02bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e3bcd629797148 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.543+0000 7f7c9b7fe640 1 -- 172.21.15.12:0/1148154872 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02cb70 con 0x7f7c9c1511a0 2023-10-21T18:29:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.545+0000 7f7c9b7fe640 1 -- 172.21.15.12:0/1148154872 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02ccd0 con 0x7f7c9c1511a0 2023-10-21T18:29:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.545+0000 7f7c9b7fe640 1 -- 172.21.15.12:0/1148154872 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c034610 con 0x7f7c9c1511a0 2023-10-21T18:29:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.545+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1148154872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 msgr2=0x7f7c9c15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.545+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1148154872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009e80 tx=0x7f7c8c02bfd0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.545+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1148154872 shutdown_connections 2023-10-21T18:29:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.546+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1148154872 >> v2:172.21.15.99:3300/0 conn(0x7f7c9c15aa20 0x7f7c9c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.546+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1148154872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c1511a0 0x7f7c9c15a4e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.546+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1148154872 >> 172.21.15.12:0/1148154872 conn(0x7f7c9c069de0 msgr2=0x7f7c9c06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.546+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1148154872 shutdown_connections 2023-10-21T18:29:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.546+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1148154872 wait complete. 2023-10-21T18:29:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.547+0000 7f7ca2c1f640 1 Processor -- start 2023-10-21T18:29:53.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.548+0000 7f7ca2c1f640 1 -- start start 2023-10-21T18:29:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 0x7f7c9c149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 0x7f7c9c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 0x7f7c9c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0c9490 con 0x7f7c9c1511a0 2023-10-21T18:29:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c147930 con 0x7f7c9c06e150 2023-10-21T18:29:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.549+0000 7f7ca2c1f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0c9730 con 0x7f7c9c15aa20 2023-10-21T18:29:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7ca11bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 0x7f7c9c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7ca09bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 0x7f7c9c149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 0x7f7c9c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7ca09bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 0x7f7c9c149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:36100/0 (socket says 172.21.15.12:36100) 2023-10-21T18:29:53.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7ca11bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 0x7f7c9c1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34178/0 (socket says 172.21.15.12:34178) 2023-10-21T18:29:53.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.550+0000 7f7ca09bb640 1 -- 172.21.15.12:0/1402902328 learned_addr learned my addr 172.21.15.12:0/1402902328 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:53.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.554+0000 7f7c9bfff640 1 -- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 msgr2=0x7f7c9c1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.554+0000 7f7c9bfff640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 0x7f7c9c1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.554+0000 7f7c9bfff640 1 -- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 msgr2=0x7f7c9c149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:53.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.554+0000 7f7c9bfff640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 0x7f7c9c149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:53.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.554+0000 7f7c9bfff640 1 -- 172.21.15.12:0/1402902328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009b30 con 0x7f7c9c1511a0 2023-10-21T18:29:53.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.557+0000 7f7c9bfff640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 0x7f7c9c158c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e840 tx=0x7f7c9000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.561+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000c730 con 0x7f7c9c1511a0 2023-10-21T18:29:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.561+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000c890 con 0x7f7c9c1511a0 2023-10-21T18:29:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.561+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c0c9a10 con 0x7f7c9c1511a0 2023-10-21T18:29:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.561+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000cc20 con 0x7f7c9c1511a0 2023-10-21T18:29:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.561+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c0c9fd0 con 0x7f7c9c1511a0 2023-10-21T18:29:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.563+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c067560 con 0x7f7c9c1511a0 2023-10-21T18:29:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.587+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c90013470 con 0x7f7c9c1511a0 2023-10-21T18:29:53.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.589+0000 7f7c997fa640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 0x7f7c8806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.589+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7c90058b30 con 0x7f7c9c1511a0 2023-10-21T18:29:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.589+0000 7f7ca09bb640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 0x7f7c8806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:53.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.590+0000 7f7ca09bb640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 0x7f7c8806d380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009e80 tx=0x7f7c8c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:53.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:53.894+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c90054e70 con 0x7f7c9c1511a0 2023-10-21T18:29:54.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.102+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f7c9c0c1140 con 0x7f7c9c1511a0 2023-10-21T18:29:54.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.254+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7c90021020 con 0x7f7c9c1511a0 2023-10-21T18:29:54.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.254+0000 7f7c997fa640 1 -- 172.21.15.12:0/1402902328 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c90054e70 con 0x7f7c9c1511a0 2023-10-21T18:29:54.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 msgr2=0x7f7c8806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 0x7f7c8806d380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009e80 tx=0x7f7c8c030000 comp rx=0 tx=0).stop 2023-10-21T18:29:54.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 msgr2=0x7f7c9c158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 0x7f7c9c158c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e840 tx=0x7f7c9000ed00 comp rx=0 tx=0).stop 2023-10-21T18:29:54.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 shutdown_connections 2023-10-21T18:29:54.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f7c8806aec0 0x7f7c8806d380 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c9c15aa20 0x7f7c9c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c9c1511a0 0x7f7c9c158c60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 --2- 172.21.15.12:0/1402902328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c9c06e150 0x7f7c9c149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.257+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 >> 172.21.15.12:0/1402902328 conn(0x7f7c9c069de0 msgr2=0x7f7c9c14cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:54.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.258+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 shutdown_connections 2023-10-21T18:29:54.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.258+0000 7f7ca2c1f640 1 -- 172.21.15.12:0/1402902328 wait complete. 2023-10-21T18:29:54.282 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-21T18:29:54.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T18:29:54.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.538+0000 7fb112209640 1 Processor -- start 2023-10-21T18:29:54.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.539+0000 7fb112209640 1 -- start start 2023-10-21T18:29:54.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.540+0000 7fb112209640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 0x7fb10c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.540+0000 7fb112209640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 0x7fb10c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.540+0000 7fb112209640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0c7700 con 0x7fb10c156680 2023-10-21T18:29:54.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.540+0000 7fb112209640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0c9020 con 0x7fb10c0c7150 2023-10-21T18:29:54.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.540+0000 7fb112209640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c06b9a0 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.541+0000 7fb10b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb10c156680 0x7fb10c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43146/0 (socket says 172.21.15.12:43146) 2023-10-21T18:29:54.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.541+0000 7fb10b7fe640 1 -- 172.21.15.12:0/1949587771 learned_addr learned my addr 172.21.15.12:0/1949587771 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:54.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.541+0000 7fb10affd640 1 --2- 172.21.15.12:0/1949587771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 0x7fb10c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.541+0000 7fb10bfff640 1 --2- 172.21.15.12:0/1949587771 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 0x7fb10c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.543+0000 7fb10affd640 1 -- 172.21.15.12:0/1949587771 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 msgr2=0x7fb10c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:54.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.543+0000 7fb10affd640 1 --2- 172.21.15.12:0/1949587771 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 0x7fb10c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.544+0000 7fb10affd640 1 -- 172.21.15.12:0/1949587771 >> v1:172.21.15.12:6789/0 conn(0x7fb10c156680 legacy=0x7fb10c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.544+0000 7fb10affd640 1 -- 172.21.15.12:0/1949587771 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c06bc80 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.544+0000 7fb10bfff640 1 --2- 172.21.15.12:0/1949587771 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 0x7fb10c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:29:54.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.546+0000 7fb10affd640 1 --2- 172.21.15.12:0/1949587771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 0x7fb10c06aef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb81fcd237f6a078 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:54.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.549+0000 7fb10a7fc640 1 -- 172.21.15.12:0/1949587771 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100030800 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb10a7fc640 1 -- 172.21.15.12:0/1949587771 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb100030960 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb10a7fc640 1 -- 172.21.15.12:0/1949587771 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100030d10 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 -- 172.21.15.12:0/1949587771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 msgr2=0x7fb10c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 --2- 172.21.15.12:0/1949587771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 0x7fb10c06aef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b940 comp rx=0 tx=0).stop 2023-10-21T18:29:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 -- 172.21.15.12:0/1949587771 shutdown_connections 2023-10-21T18:29:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 --2- 172.21.15.12:0/1949587771 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0c7150 0x7fb10c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 --2- 172.21.15.12:0/1949587771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c9bf0 0x7fb10c06aef0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 -- 172.21.15.12:0/1949587771 >> 172.21.15.12:0/1949587771 conn(0x7fb10c065ab0 msgr2=0x7fb10c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:54.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 -- 172.21.15.12:0/1949587771 shutdown_connections 2023-10-21T18:29:54.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.550+0000 7fb112209640 1 -- 172.21.15.12:0/1949587771 wait complete. 2023-10-21T18:29:54.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.552+0000 7fb112209640 1 Processor -- start 2023-10-21T18:29:54.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.552+0000 7fb112209640 1 -- start start 2023-10-21T18:29:54.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c156680 0x7fb10c1f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c151aa0 con 0x7fb10c156680 2023-10-21T18:29:54.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1514b0 con 0x7fb10c0c9bf0 2023-10-21T18:29:54.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.553+0000 7fb112209640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c150a70 con 0x7fb10c0c7150 2023-10-21T18:29:54.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:36130/0 (socket says 172.21.15.12:36130) 2023-10-21T18:29:54.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34198/0 (socket says 172.21.15.12:34198) 2023-10-21T18:29:54.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10affd640 1 -- 172.21.15.12:0/639732031 learned_addr learned my addr 172.21.15.12:0/639732031 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:54.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.554+0000 7fb10bfff640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c156680 0x7fb10c1f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.557+0000 7fb10b7fe640 1 -- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 msgr2=0x7fb10c1eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.557+0000 7fb10b7fe640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.557+0000 7fb10b7fe640 1 -- 172.21.15.12:0/639732031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c156680 msgr2=0x7fb10c1f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:54.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.557+0000 7fb10b7fe640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c156680 0x7fb10c1f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:54.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.557+0000 7fb10b7fe640 1 -- 172.21.15.12:0/639732031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104009400 con 0x7fb10c0c7150 2023-10-21T18:29:54.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.558+0000 7fb10affd640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-21T18:29:54.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.560+0000 7fb10b7fe640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cb10 tx=0x7fb0fc00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:54.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.563+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00abb0 con 0x7fb10c0c7150 2023-10-21T18:29:54.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.563+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb0fc00ad10 con 0x7fb10c0c7150 2023-10-21T18:29:54.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.563+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc012620 con 0x7fb10c0c7150 2023-10-21T18:29:54.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.563+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100009400 con 0x7fb10c0c7150 2023-10-21T18:29:54.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.564+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c150d20 con 0x7fb10c0c7150 2023-10-21T18:29:54.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.565+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c06cc30 con 0x7fb10c0c7150 2023-10-21T18:29:54.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.583+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0fc007070 con 0x7fb10c0c7150 2023-10-21T18:29:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.584+0000 7fb0f3fff640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 0x7fb0f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:54.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.584+0000 7fb10affd640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 0x7fb0f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:54.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.585+0000 7fb10affd640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 0x7fb0f806d380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb10002b980 tx=0x7fb100008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:54.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.809+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb0fc013e70 con 0x7fb10c0c7150 2023-10-21T18:29:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:54.819+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0fc054a00 con 0x7fb10c0c7150 2023-10-21T18:29:55.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.063+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb10c06b250 con 0x7fb10c0c7150 2023-10-21T18:29:55.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.088+0000 7fb0f3fff640 1 -- 172.21.15.12:0/639732031 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6489 (secure 0 0 0) 0x7fb0fc017090 con 0x7fb10c0c7150 2023-10-21T18:29:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:55.091 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T17:32:57.679602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":974,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T18:29:55.091 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2023-10-21T18:29:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 msgr2=0x7fb0f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 0x7fb0f806d380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb10002b980 tx=0x7fb100008030 comp rx=0 tx=0).stop 2023-10-21T18:29:55.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 msgr2=0x7fb10c159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cb10 tx=0x7fb0fc00cf10 comp rx=0 tx=0).stop 2023-10-21T18:29:55.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 shutdown_connections 2023-10-21T18:29:55.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fb0f806aec0 0x7fb0f806d380 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c156680 0x7fb10c1f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb10c0c9bf0 0x7fb10c1eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 --2- 172.21.15.12:0/639732031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb10c0c7150 0x7fb10c159cf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 >> 172.21.15.12:0/639732031 conn(0x7fb10c065ab0 msgr2=0x7fb10c06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:55.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 shutdown_connections 2023-10-21T18:29:55.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.091+0000 7fb112209640 1 -- 172.21.15.12:0/639732031 wait complete. 2023-10-21T18:29:55.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-21T18:29:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.338+0000 7ff2deaaf640 1 Processor -- start 2023-10-21T18:29:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.339+0000 7ff2deaaf640 1 -- start start 2023-10-21T18:29:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.340+0000 7ff2deaaf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2d815e100 0x7ff2d80c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.340+0000 7ff2deaaf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d815d560 con 0x7ff2d80c8670 2023-10-21T18:29:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.341+0000 7ff2deaaf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d8157bd0 con 0x7ff2d80c81b0 2023-10-21T18:29:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.341+0000 7ff2deaaf640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d80c8f90 con 0x7ff2d815e100 2023-10-21T18:29:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.341+0000 7ff2cffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2d815e100 0x7ff2d80c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.341+0000 7ff2dc84b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff2d80c8670 0x7ff2d815d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43150/0 (socket says 172.21.15.12:43150) 2023-10-21T18:29:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.341+0000 7ff2dc84b640 1 -- 172.21.15.12:0/147390061 learned_addr learned my addr 172.21.15.12:0/147390061 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:55.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.344+0000 7ff2cffff640 1 -- 172.21.15.12:0/147390061 >> v1:172.21.15.99:6789/0 conn(0x7ff2d80c81b0 legacy=0x7ff2d8167dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.344+0000 7ff2cffff640 1 -- 172.21.15.12:0/147390061 >> v1:172.21.15.12:6789/0 conn(0x7ff2d80c8670 legacy=0x7ff2d815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.344+0000 7ff2cffff640 1 -- 172.21.15.12:0/147390061 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d806b0f0 con 0x7ff2d815e100 2023-10-21T18:29:55.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.349+0000 7ff2cffff640 1 --2- 172.21.15.12:0/147390061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d815e100 0x7ff2d80c8a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097a0 tx=0x7ff2c802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a57175f8622cb894 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:55.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.352+0000 7ff2cf7fe640 1 -- 172.21.15.12:0/147390061 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c802f810 con 0x7ff2d815e100 2023-10-21T18:29:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.352+0000 7ff2cf7fe640 1 -- 172.21.15.12:0/147390061 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff2c802f970 con 0x7ff2d815e100 2023-10-21T18:29:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.352+0000 7ff2cf7fe640 1 -- 172.21.15.12:0/147390061 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c802fd20 con 0x7ff2d815e100 2023-10-21T18:29:55.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 -- 172.21.15.12:0/147390061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d815e100 msgr2=0x7ff2d80c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/147390061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d815e100 0x7ff2d80c8a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097a0 tx=0x7ff2c802b9f0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 -- 172.21.15.12:0/147390061 shutdown_connections 2023-10-21T18:29:55.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/147390061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d815e100 0x7ff2d80c8a50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 -- 172.21.15.12:0/147390061 >> 172.21.15.12:0/147390061 conn(0x7ff2d8065ab0 msgr2=0x7ff2d8065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 -- 172.21.15.12:0/147390061 shutdown_connections 2023-10-21T18:29:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.353+0000 7ff2deaaf640 1 -- 172.21.15.12:0/147390061 wait complete. 2023-10-21T18:29:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.355+0000 7ff2deaaf640 1 Processor -- start 2023-10-21T18:29:55.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.355+0000 7ff2deaaf640 1 -- start start 2023-10-21T18:29:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.356+0000 7ff2deaaf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2d80c81b0 0x7ff2d81f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.356+0000 7ff2deaaf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 0x7ff2d8155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.356+0000 7ff2deaaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 0x7ff2d81f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.357+0000 7ff2deaaf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81f75b0 con 0x7ff2d815e100 2023-10-21T18:29:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.357+0000 7ff2deaaf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81f34d0 con 0x7ff2d80c8670 2023-10-21T18:29:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.357+0000 7ff2deaaf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81e68f0 con 0x7ff2d80c81b0 2023-10-21T18:29:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.358+0000 7ff2dd04c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 0x7ff2d81f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.358+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 0x7ff2d8155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.358+0000 7ff2dd04c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 0x7ff2d81f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48558/0 (socket says 172.21.15.12:48558) 2023-10-21T18:29:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.358+0000 7ff2dd04c640 1 -- 172.21.15.12:0/3762872377 learned_addr learned my addr 172.21.15.12:0/3762872377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:55.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.360+0000 7ff2dc84b640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2d80c81b0 0x7ff2d81f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:55.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.362+0000 7ff2cffff640 1 -- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2d80c81b0 msgr2=0x7ff2d81f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.362+0000 7ff2cffff640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2d80c81b0 0x7ff2d81f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.362+0000 7ff2cffff640 1 -- 172.21.15.12:0/3762872377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 msgr2=0x7ff2d81f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.362+0000 7ff2cffff640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 0x7ff2d81f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.362+0000 7ff2cffff640 1 -- 172.21.15.12:0/3762872377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009400 con 0x7ff2d80c8670 2023-10-21T18:29:55.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.365+0000 7ff2cffff640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 0x7ff2d8155320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8033000 tx=0x7ff2c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.368+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8046070 con 0x7ff2d80c8670 2023-10-21T18:29:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.368+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff2c80379c0 con 0x7ff2d80c8670 2023-10-21T18:29:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.368+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c803b040 con 0x7ff2d80c8670 2023-10-21T18:29:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.368+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80b2860 con 0x7ff2d80c8670 2023-10-21T18:29:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.369+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81e6e70 con 0x7ff2d80c8670 2023-10-21T18:29:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.370+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d80619f0 con 0x7ff2d80c8670 2023-10-21T18:29:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.389+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff2c8042480 con 0x7ff2d80c8670 2023-10-21T18:29:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.391+0000 7ff2cd7fa640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 0x7ff2c406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.391+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff2c80ac910 con 0x7ff2d80c8670 2023-10-21T18:29:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.391+0000 7ff2dc84b640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 0x7ff2c406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.392+0000 7ff2dc84b640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 0x7ff2c406d3b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.629+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2c8077b10 con 0x7ff2d80c8670 2023-10-21T18:29:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.878+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d81f3610 con 0x7ff2d80c8670 2023-10-21T18:29:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.892+0000 7ff2cd7fa640 1 -- 172.21.15.12:0/3762872377 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6489 (secure 0 0 0) 0x7ff2c8079a40 con 0x7ff2d80c8670 2023-10-21T18:29:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:55.895 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/4030734614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4030734614},{"type":"v1","addr":"172.21.15.99:6837","nonce":4030734614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4252,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/251516708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":251516708},{"type":"v1","addr":"172.21.15.99:6839","nonce":251516708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1277170460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1277170460},{"type":"v1","addr":"172.21.15.12:6833","nonce":1277170460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6838/2228356358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2228356358},{"type":"v1","addr":"172.21.15.99:6838","nonce":2228356358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4271,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2311704592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2311704592},{"type":"v1","addr":"172.21.15.12:6835","nonce":2311704592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-21T16:27:31.345236+0000","modified":"2023-10-21T17:32:57.679602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4274":{"gid":4274,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":974,"addr":"172.21.15.12:6837/1211628710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1211628710},{"type":"v1","addr":"172.21.15.12:6837","nonce":1211628710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-21T18:29:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2023-10-21T18:29:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 msgr2=0x7ff2c406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 0x7ff2c406d3b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4007e80 comp rx=0 tx=0).stop 2023-10-21T18:29:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 msgr2=0x7ff2d8155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 0x7ff2d8155320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8033000 tx=0x7ff2c80046c0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 shutdown_connections 2023-10-21T18:29:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7ff2c406aef0 0x7ff2c406d3b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d815e100 0x7ff2d81f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2d80c8670 0x7ff2d8155320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 --2- 172.21.15.12:0/3762872377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2d80c81b0 0x7ff2d81f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 >> 172.21.15.12:0/3762872377 conn(0x7ff2d8065ab0 msgr2=0x7ff2d815b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 shutdown_connections 2023-10-21T18:29:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:55.895+0000 7ff2deaaf640 1 -- 172.21.15.12:0/3762872377 wait complete. 2023-10-21T18:29:55.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-21T18:29:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.152+0000 7fc3b8178640 1 Processor -- start 2023-10-21T18:29:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.153+0000 7fc3b8178640 1 -- start start 2023-10-21T18:29:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.154+0000 7fc3b8178640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 0x7fc3b00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.154+0000 7fc3b8178640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00c3d50 con 0x7fc3b0071ed0 2023-10-21T18:29:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.154+0000 7fc3b8178640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b0070a30 con 0x7fc3b00c1a00 2023-10-21T18:29:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.154+0000 7fc3b8178640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0071ab0 con 0x7fc3b014f940 2023-10-21T18:29:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.155+0000 7fc3b5713640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc3b0071ed0 0x7fc3b00c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43158/0 (socket says 172.21.15.12:43158) 2023-10-21T18:29:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.155+0000 7fc3b5713640 1 -- 172.21.15.12:0/3519685723 learned_addr learned my addr 172.21.15.12:0/3519685723 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:56.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.159+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477717409 0 0) 0x7fc3b00c3d50 con 0x7fc3b0071ed0 2023-10-21T18:29:56.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.160+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c003520 con 0x7fc3b0071ed0 2023-10-21T18:29:56.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3158752255 0 0) 0x7fc39c003520 con 0x7fc3b0071ed0 2023-10-21T18:29:56.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 msgr2=0x7fc3b00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 0x7fc3b00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 >> v1:172.21.15.99:6789/0 conn(0x7fc3b00c1a00 legacy=0x7fc3b006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00c34b0 con 0x7fc3b0071ed0 2023-10-21T18:29:56.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2259354253 0 0) 0x7fc3a0001670 con 0x7fc3b0071ed0 2023-10-21T18:29:56.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 >> v1:172.21.15.12:6789/0 conn(0x7fc3b0071ed0 legacy=0x7fc3b00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc39c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 0x7fc39c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c004e20 0x7fc39c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0071ab0 con 0x7fc39c0039a0 2023-10-21T18:29:56.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0054d0 con 0x7fc39c004e20 2023-10-21T18:29:56.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.165+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c005690 con 0x7fc3b014f940 2023-10-21T18:29:56.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.168+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc39c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.172+0000 7fc3b5f14640 1 -- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 msgr2=0x7fc39c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.172+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b014f940 0x7fc39c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.172+0000 7fc3b5f14640 1 -- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c004e20 msgr2=0x7fc39c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.172+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c004e20 0x7fc39c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.172+0000 7fc3b5f14640 1 -- 172.21.15.12:0/3519685723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c003520 con 0x7fc39c0039a0 2023-10-21T18:29:56.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.176+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc39c003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009860 tx=0x7fc39c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3782e5bb0765d54b server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.184+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac032600 con 0x7fc39c0039a0 2023-10-21T18:29:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.184+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3ac02e050 con 0x7fc39c0039a0 2023-10-21T18:29:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.184+0000 7fc3b4f12640 1 -- 172.21.15.12:0/3519685723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0329e0 con 0x7fc39c0039a0 2023-10-21T18:29:56.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 -- 172.21.15.12:0/3519685723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 msgr2=0x7fc39c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 --2- 172.21.15.12:0/3519685723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc39c003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009860 tx=0x7fc39c0057f0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b6715640 1 -- 172.21.15.12:0/3519685723 reap_dead start 2023-10-21T18:29:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 -- 172.21.15.12:0/3519685723 shutdown_connections 2023-10-21T18:29:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 -- 172.21.15.12:0/3519685723 >> 172.21.15.12:0/3519685723 conn(0x7fc3b0069de0 msgr2=0x7fc3b006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 -- 172.21.15.12:0/3519685723 shutdown_connections 2023-10-21T18:29:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.185+0000 7fc3b8178640 1 -- 172.21.15.12:0/3519685723 wait complete. 2023-10-21T18:29:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.188+0000 7fc3b8178640 1 Processor -- start 2023-10-21T18:29:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.189+0000 7fc3b8178640 1 -- start start 2023-10-21T18:29:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.190+0000 7fc3b8178640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc3b0144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.190+0000 7fc3b8178640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b8178640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b013f720 0x7fc3b01f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b8178640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b014ea60 con 0x7fc39c0039a0 2023-10-21T18:29:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b8178640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01ee750 con 0x7fc3b013f720 2023-10-21T18:29:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b8178640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01df960 con 0x7fc3b0148a30 2023-10-21T18:29:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b5713640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b6715640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b013f720 0x7fc3b01f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b5f14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc3b0144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b5713640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34234/0 (socket says 172.21.15.12:34234) 2023-10-21T18:29:56.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.191+0000 7fc3b5713640 1 -- 172.21.15.12:0/1423756580 learned_addr learned my addr 172.21.15.12:0/1423756580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:56.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.195+0000 7fc3b5713640 1 -- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b013f720 msgr2=0x7fc3b01f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.195+0000 7fc3b5713640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b013f720 0x7fc3b01f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.195+0000 7fc3b5713640 1 -- 172.21.15.12:0/1423756580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 msgr2=0x7fc3b0144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.195+0000 7fc3b5713640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc3b0144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.195+0000 7fc3b5713640 1 -- 172.21.15.12:0/1423756580 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b014e4a0 con 0x7fc3b0148a30 2023-10-21T18:29:56.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.198+0000 7fc3b5713640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c7d0 tx=0x7fc3a000cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:56.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.201+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00074e0 con 0x7fc3b0148a30 2023-10-21T18:29:56.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.201+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3a0007640 con 0x7fc3b0148a30 2023-10-21T18:29:56.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.202+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0004a40 con 0x7fc3b0148a30 2023-10-21T18:29:56.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.202+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b014e780 con 0x7fc3b0148a30 2023-10-21T18:29:56.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.202+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b01f1df0 con 0x7fc3b0148a30 2023-10-21T18:29:56.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.203+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00619f0 con 0x7fc3b0148a30 2023-10-21T18:29:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.221+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3a000a5e0 con 0x7fc3b0148a30 2023-10-21T18:29:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.223+0000 7fc3a67fc640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 0x7fc39406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.223+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 0x7fc39406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.224+0000 7fc3b5f14640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 0x7fc39406d3b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac034000 tx=0x7fc3ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.446+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc3a0058090 con 0x7fc3b0148a30 2023-10-21T18:29:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.456+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3a00543d0 con 0x7fc3b0148a30 2023-10-21T18:29:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.670+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3b00c6ba0 con 0x7fc3b0148a30 2023-10-21T18:29:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.706+0000 7fc3a67fc640 1 -- 172.21.15.12:0/1423756580 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16520 (secure 0 0 0) 0x7fc3a0018020 con 0x7fc3b0148a30 2023-10-21T18:29:56.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-21T18:29:56.709 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"31504b75-3b00-4d04-9abc-c2f1cbe20b72","created":"2023-10-21T16:26:48.475707+0000","modified":"2023-10-21T16:27:57.353629+0000","last_up_change":"2023-10-21T16:27:08.039132+0000","last_in_change":"2023-10-21T16:26:57.296744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-21T16:27:08.552678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-21T16:27:27.920466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-21T16:27:29.996993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7575ad2a-98af-459b-8c14-52cc33d181ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6801","nonce":669872713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6803","nonce":669872713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6807","nonce":669872713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":669872713},{"type":"v1","addr":"172.21.15.12:6805","nonce":669872713}]},"public_addr":"172.21.15.12:6801/669872713","cluster_addr":"172.21.15.12:6803/669872713","heartbeat_back_addr":"172.21.15.12:6807/669872713","heartbeat_front_addr":"172.21.15.12:6805/669872713","state":["exists","up"]},{"osd":1,"uuid":"aebb3aef-a029-4635-8dc6-0ba4f65e2d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6814","nonce":2520400743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6818","nonce":2520400743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6823","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6825","nonce":2520400743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":2520400743},{"type":"v1","addr":"172.21.15.12:6821","nonce":2520400743}]},"public_addr":"172.21.15.12:6814/2520400743","cluster_addr":"172.21.15.12:6818/2520400743","heartbeat_back_addr":"172.21.15.12:6825/2520400743","heartbeat_front_addr":"172.21.15.12:6821/2520400743","state":["exists","up"]},{"osd":2,"uuid":"c9ac73d3-272d-4f34-a81e-d9c3932b185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6809","nonce":369793798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6811","nonce":369793798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6820","nonce":369793798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":369793798},{"type":"v1","addr":"172.21.15.12:6815","nonce":369793798}]},"public_addr":"172.21.15.12:6809/369793798","cluster_addr":"172.21.15.12:6811/369793798","heartbeat_back_addr":"172.21.15.12:6820/369793798","heartbeat_front_addr":"172.21.15.12:6815/369793798","state":["exists","up"]},{"osd":3,"uuid":"37a14876-5214-46f1-9297-6343b877e3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6824","nonce":514838318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6827","nonce":514838318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6831","nonce":514838318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514838318},{"type":"v1","addr":"172.21.15.12:6829","nonce":514838318}]},"public_addr":"172.21.15.12:6824/514838318","cluster_addr":"172.21.15.12:6827/514838318","heartbeat_back_addr":"172.21.15.12:6831/514838318","heartbeat_front_addr":"172.21.15.12:6829/514838318","state":["exists","up"]},{"osd":4,"uuid":"f1664a67-35e2-4203-adc3-a2bd755cea53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6811","nonce":585893738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6813","nonce":585893738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6817","nonce":585893738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":585893738},{"type":"v1","addr":"172.21.15.99:6815","nonce":585893738}]},"public_addr":"172.21.15.99:6811/585893738","cluster_addr":"172.21.15.99:6813/585893738","heartbeat_back_addr":"172.21.15.99:6817/585893738","heartbeat_front_addr":"172.21.15.99:6815/585893738","state":["exists","up"]},{"osd":5,"uuid":"760f1bc6-c39e-46f1-963f-e13af4e31d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6819","nonce":3348201712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6821","nonce":3348201712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6825","nonce":3348201712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3348201712},{"type":"v1","addr":"172.21.15.99:6823","nonce":3348201712}]},"public_addr":"172.21.15.99:6819/3348201712","cluster_addr":"172.21.15.99:6821/3348201712","heartbeat_back_addr":"172.21.15.99:6825/3348201712","heartbeat_front_addr":"172.21.15.99:6823/3348201712","state":["exists","up"]},{"osd":6,"uuid":"473b4fb5-cf27-4ab6-b827-519fb7726953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6827","nonce":2547717838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6829","nonce":2547717838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6833","nonce":2547717838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2547717838},{"type":"v1","addr":"172.21.15.99:6831","nonce":2547717838}]},"public_addr":"172.21.15.99:6827/2547717838","cluster_addr":"172.21.15.99:6829/2547717838","heartbeat_back_addr":"172.21.15.99:6833/2547717838","heartbeat_front_addr":"172.21.15.99:6831/2547717838","state":["exists","up"]},{"osd":7,"uuid":"4c75a210-8336-4730-a63a-a2d8afc4d4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6803","nonce":2053185906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6805","nonce":2053185906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6809","nonce":2053185906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2053185906},{"type":"v1","addr":"172.21.15.99:6807","nonce":2053185906}]},"public_addr":"172.21.15.99:6803/2053185906","cluster_addr":"172.21.15.99:6805/2053185906","heartbeat_back_addr":"172.21.15.99:6809/2053185906","heartbeat_front_addr":"172.21.15.99:6807/2053185906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.048152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.146943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.469077+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.392963+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:03.024940+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.960376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.971119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-21T16:27:02.979397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-21T18:29:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 msgr2=0x7fc39406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 0x7fc39406d3b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac034000 tx=0x7fc3ac008030 comp rx=0 tx=0).stop 2023-10-21T18:29:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 msgr2=0x7fc3b01f2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c7d0 tx=0x7fc3a000cc90 comp rx=0 tx=0).stop 2023-10-21T18:29:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 shutdown_connections 2023-10-21T18:29:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fc39406aef0 0x7fc39406d3b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b013f720 0x7fc3b01f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3b0148a30 0x7fc3b01f2310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 --2- 172.21.15.12:0/1423756580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc39c0039a0 0x7fc3b0144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.710+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 >> 172.21.15.12:0/1423756580 conn(0x7fc3b0069de0 msgr2=0x7fc3b00c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.711+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 shutdown_connections 2023-10-21T18:29:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.711+0000 7fc3b8178640 1 -- 172.21.15.12:0/1423756580 wait complete. 2023-10-21T18:29:56.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-21T18:29:56.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.945+0000 7f0cd6547640 1 Processor -- start 2023-10-21T18:29:56.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.945+0000 7f0cd6547640 1 -- start start 2023-10-21T18:29:56.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cd014fec0 0x7f0cd006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 0x7f0cd00708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd00c38e0 con 0x7f0cd014fec0 2023-10-21T18:29:56.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd006d450 con 0x7f0cd006e100 2023-10-21T18:29:56.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.947+0000 7f0cd6547640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01562a0 con 0x7f0cd0155cf0 2023-10-21T18:29:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd4d44640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 0x7f0cd00708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd5d46640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd5545640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cd014fec0 0x7f0cd006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd4d44640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 0x7f0cd00708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:36190/0 (socket says 172.21.15.12:36190) 2023-10-21T18:29:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd4d44640 1 -- 172.21.15.12:0/1459550031 learned_addr learned my addr 172.21.15.12:0/1459550031 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.948+0000 7f0cd5d46640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34244/0 (socket says 172.21.15.12:34244) 2023-10-21T18:29:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.950+0000 7f0cd5d46640 1 -- 172.21.15.12:0/1459550031 >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 msgr2=0x7f0cd00708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.950+0000 7f0cd5d46640 1 --2- 172.21.15.12:0/1459550031 >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 0x7f0cd00708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.950+0000 7f0cd5d46640 1 -- 172.21.15.12:0/1459550031 >> v2:172.21.15.12:3300/0 conn(0x7f0cd014fec0 msgr2=0x7f0cd006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:56.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.950+0000 7f0cd5d46640 1 --2- 172.21.15.12:0/1459550031 >> v2:172.21.15.12:3300/0 conn(0x7f0cd014fec0 0x7f0cd006dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.950+0000 7f0cd5d46640 1 -- 172.21.15.12:0/1459550031 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0156560 con 0x7f0cd0155cf0 2023-10-21T18:29:56.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.952+0000 7f0cd5d46640 1 --2- 172.21.15.12:0/1459550031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0cd015a380 tx=0x7f0cc802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc47d17a6cfd120 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.956+0000 7f0cc7fff640 1 -- 172.21.15.12:0/1459550031 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802cbc0 con 0x7f0cd0155cf0 2023-10-21T18:29:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.956+0000 7f0cc7fff640 1 -- 172.21.15.12:0/1459550031 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cc802cd20 con 0x7f0cd0155cf0 2023-10-21T18:29:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.956+0000 7f0cc7fff640 1 -- 172.21.15.12:0/1459550031 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8034680 con 0x7f0cd0155cf0 2023-10-21T18:29:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.956+0000 7f0cd6547640 1 -- 172.21.15.12:0/1459550031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 msgr2=0x7f0cd0070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.956+0000 7f0cd6547640 1 --2- 172.21.15.12:0/1459550031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0cd015a380 tx=0x7f0cc802be10 comp rx=0 tx=0).stop 2023-10-21T18:29:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 -- 172.21.15.12:0/1459550031 shutdown_connections 2023-10-21T18:29:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 --2- 172.21.15.12:0/1459550031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd0070df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 --2- 172.21.15.12:0/1459550031 >> v2:172.21.15.99:3300/0 conn(0x7f0cd006e100 0x7f0cd00708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 --2- 172.21.15.12:0/1459550031 >> v2:172.21.15.12:3300/0 conn(0x7f0cd014fec0 0x7f0cd006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 -- 172.21.15.12:0/1459550031 >> 172.21.15.12:0/1459550031 conn(0x7f0cd006bac0 msgr2=0x7f0cd006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 -- 172.21.15.12:0/1459550031 shutdown_connections 2023-10-21T18:29:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.957+0000 7f0cd6547640 1 -- 172.21.15.12:0/1459550031 wait complete. 2023-10-21T18:29:56.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.959+0000 7f0cd6547640 1 Processor -- start 2023-10-21T18:29:56.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.959+0000 7f0cd6547640 1 -- start start 2023-10-21T18:29:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cd006e100 0x7f0cd01482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 0x7f0cd014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0147ec0 con 0x7f0cd006e100 2023-10-21T18:29:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd014a200 con 0x7f0cd014fec0 2023-10-21T18:29:56.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd6547640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd014c1d0 con 0x7f0cd0155cf0 2023-10-21T18:29:56.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd5d46640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd4d44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 0x7f0cd014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd5d46640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd014cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34258/0 (socket says 172.21.15.12:34258) 2023-10-21T18:29:56.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.960+0000 7f0cd5d46640 1 -- 172.21.15.12:0/2457340800 learned_addr learned my addr 172.21.15.12:0/2457340800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:56.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.961+0000 7f0cd5545640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cd006e100 0x7f0cd01482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:56.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.964+0000 7f0cd4d44640 1 -- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 msgr2=0x7f0cd014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.964+0000 7f0cd4d44640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.964+0000 7f0cd4d44640 1 -- 172.21.15.12:0/2457340800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cd006e100 msgr2=0x7f0cd01482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:56.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.964+0000 7f0cd4d44640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cd006e100 0x7f0cd01482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:56.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.964+0000 7f0cd4d44640 1 -- 172.21.15.12:0/2457340800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009a70 con 0x7f0cd014fec0 2023-10-21T18:29:56.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.968+0000 7f0cd4d44640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 0x7f0cd014c630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e7d0 tx=0x7f0cc000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:56.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.972+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000eee0 con 0x7f0cd014fec0 2023-10-21T18:29:56.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.972+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cc000c940 con 0x7f0cd014fec0 2023-10-21T18:29:56.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.972+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000ccf0 con 0x7f0cd014fec0 2023-10-21T18:29:56.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.972+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd014a4c0 con 0x7f0cd014fec0 2023-10-21T18:29:56.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.972+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd014b9d0 con 0x7f0cd014fec0 2023-10-21T18:29:56.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:56.973+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd00619f0 con 0x7f0cd014fec0 2023-10-21T18:29:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.223+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cc0013470 con 0x7f0cd014fec0 2023-10-21T18:29:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.225+0000 7f0cc5ffb640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 0x7f0cb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.226+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0cc0089f00 con 0x7f0cd014fec0 2023-10-21T18:29:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.226+0000 7f0cd5545640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 0x7f0cb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.227+0000 7f0cd5545640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 0x7f0cb406d360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b40 tx=0x7f0ccc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.234+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cc0055070 con 0x7f0cd014fec0 2023-10-21T18:29:57.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.481+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0cd006d670 con 0x7f0cd014fec0 2023-10-21T18:29:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.780+0000 7f0cc5ffb640 1 -- 172.21.15.12:0/2457340800 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cc0021090 con 0x7f0cd014fec0 2023-10-21T18:29:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-21T18:29:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 msgr2=0x7f0cb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 0x7f0cb406d360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b40 tx=0x7f0ccc009190 comp rx=0 tx=0).stop 2023-10-21T18:29:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 msgr2=0x7f0cd014c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 0x7f0cd014c630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e7d0 tx=0x7f0cc000ec90 comp rx=0 tx=0).stop 2023-10-21T18:29:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 shutdown_connections 2023-10-21T18:29:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f0cb406aea0 0x7f0cb406d360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cd0155cf0 0x7f0cd014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cd014fec0 0x7f0cd014c630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 --2- 172.21.15.12:0/2457340800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cd006e100 0x7f0cd01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.784+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 >> 172.21.15.12:0/2457340800 conn(0x7f0cd006bac0 msgr2=0x7f0cd00c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.785+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 shutdown_connections 2023-10-21T18:29:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:57.785+0000 7f0cd6547640 1 -- 172.21.15.12:0/2457340800 wait complete. 2023-10-21T18:29:57.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-21T18:29:58.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.023+0000 7f8521a75640 1 Processor -- start 2023-10-21T18:29:58.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.023+0000 7f8521a75640 1 -- start start 2023-10-21T18:29:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.025+0000 7f8521a75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c1c70 0x7f851c159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.025+0000 7f8521a75640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f851c0c2050 0x7f851c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.025+0000 7f8521a75640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c1599a0 con 0x7f851c0c5900 2023-10-21T18:29:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.025+0000 7f8521a75640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c156e00 con 0x7f851c0c2050 2023-10-21T18:29:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.025+0000 7f8521a75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c159bf0 con 0x7f851c0c1c70 2023-10-21T18:29:58.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.026+0000 7f8512ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f851c0c2050 0x7f851c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:58.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.026+0000 7f8512ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f851c0c2050 0x7f851c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48598/0 (socket says 172.21.15.12:48598) 2023-10-21T18:29:58.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.026+0000 7f8512ffd640 1 -- 172.21.15.12:0/3248322094 learned_addr learned my addr 172.21.15.12:0/3248322094 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.029+0000 7f8512ffd640 1 -- 172.21.15.12:0/3248322094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c1c70 msgr2=0x7f851c159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.029+0000 7f8512ffd640 1 --2- 172.21.15.12:0/3248322094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c1c70 0x7f851c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.029+0000 7f8512ffd640 1 -- 172.21.15.12:0/3248322094 >> v1:172.21.15.99:6789/0 conn(0x7f851c0c5900 legacy=0x7f851c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.029+0000 7f8512ffd640 1 -- 172.21.15.12:0/3248322094 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c159ed0 con 0x7f851c0c2050 2023-10-21T18:29:58.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.032+0000 7f8512ffd640 1 --2- 172.21.15.12:0/3248322094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c2050 0x7f851c1568c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8504009870 tx=0x7f850402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4219d88e557bca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.036+0000 7f851affd640 1 -- 172.21.15.12:0/3248322094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504030840 con 0x7f851c0c2050 2023-10-21T18:29:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.036+0000 7f851affd640 1 -- 172.21.15.12:0/3248322094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f85040309a0 con 0x7f851c0c2050 2023-10-21T18:29:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.036+0000 7f851affd640 1 -- 172.21.15.12:0/3248322094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504030d50 con 0x7f851c0c2050 2023-10-21T18:29:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 -- 172.21.15.12:0/3248322094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c2050 msgr2=0x7f851c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 --2- 172.21.15.12:0/3248322094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c2050 0x7f851c1568c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8504009870 tx=0x7f850402b980 comp rx=0 tx=0).stop 2023-10-21T18:29:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 -- 172.21.15.12:0/3248322094 shutdown_connections 2023-10-21T18:29:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 --2- 172.21.15.12:0/3248322094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c2050 0x7f851c1568c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 --2- 172.21.15.12:0/3248322094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c1c70 0x7f851c159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.037+0000 7f8521a75640 1 -- 172.21.15.12:0/3248322094 >> 172.21.15.12:0/3248322094 conn(0x7f851c069de0 msgr2=0x7f851c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.038+0000 7f8521a75640 1 -- 172.21.15.12:0/3248322094 shutdown_connections 2023-10-21T18:29:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.038+0000 7f8521a75640 1 -- 172.21.15.12:0/3248322094 wait complete. 2023-10-21T18:29:58.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.039+0000 7f8521a75640 1 Processor -- start 2023-10-21T18:29:58.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.040+0000 7f8521a75640 1 -- start start 2023-10-21T18:29:58.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.040+0000 7f8521a75640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.040+0000 7f8521a75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c5900 0x7f851c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.041+0000 7f8521a75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f851c1f21a0 0x7f851c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.041+0000 7f8521a75640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0caa40 con 0x7f851c0c1c70 2023-10-21T18:29:58.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.041+0000 7f8521a75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1f1a30 con 0x7f851c1f21a0 2023-10-21T18:29:58.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.041+0000 7f8521a75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1ef9a0 con 0x7f851c0c5900 2023-10-21T18:29:58.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.041+0000 7f851b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.042+0000 7f851b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48612/0 (socket says 172.21.15.12:48612) 2023-10-21T18:29:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.042+0000 7f851b7fe640 1 -- 172.21.15.12:0/827366261 learned_addr learned my addr 172.21.15.12:0/827366261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:58.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.045+0000 7f851b7fe640 1 -- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c5900 msgr2=0x7f851c157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:58.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.045+0000 7f851b7fe640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c5900 0x7f851c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:58.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.045+0000 7f851b7fe640 1 -- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f851c1f21a0 msgr2=0x7f851c1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:58.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.045+0000 7f851b7fe640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f851c1f21a0 0x7f851c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:58.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.045+0000 7f851b7fe640 1 -- 172.21.15.12:0/827366261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040094d0 con 0x7f851c0c1c70 2023-10-21T18:29:58.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.048+0000 7f851b7fe640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f850c00ba50 tx=0x7f850c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:58.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.050+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00cbe0 con 0x7f851c0c1c70 2023-10-21T18:29:58.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.051+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c0cac90 con 0x7f851c0c1c70 2023-10-21T18:29:58.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.051+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0cb250 con 0x7f851c0c1c70 2023-10-21T18:29:58.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.052+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c0cb490 con 0x7f851c0c1c70 2023-10-21T18:29:58.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.053+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f850c009930 con 0x7f851c0c1c70 2023-10-21T18:29:58.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.053+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c01e440 con 0x7f851c0c1c70 2023-10-21T18:29:58.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.404+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f850c01d3b0 con 0x7f851c0c1c70 2023-10-21T18:29:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.406+0000 7f8518ff9640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 0x7f84fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.407+0000 7f8512ffd640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 0x7f84fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.408+0000 7f8512ffd640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 0x7f84fc06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8504036000 tx=0x7f850403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:58.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.447+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f850c058890 con 0x7f851c0c1c70 2023-10-21T18:29:58.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.448+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f850c054b40 con 0x7f851c0c1c70 2023-10-21T18:29:58.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:58.692+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f851c067560 con 0x7f851c0c1c70 2023-10-21T18:29:59.138 INFO:tasks.ceph.mds.c.smithi012.stderr:==00:02:02:43.055 92579== 2023-10-21T18:29:59.138 INFO:tasks.ceph.mds.c.smithi012.stderr:==00:02:02:43.055 92579== Exit program on first error (--exit-on-first-error=yes) 2023-10-21T18:29:59.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.187+0000 7f8518ff9640 1 -- 172.21.15.12:0/827366261 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f850c0230a0 con 0x7f851c0c1c70 2023-10-21T18:29:59.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 msgr2=0x7f84fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 0x7f84fc06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8504036000 tx=0x7f850403b040 comp rx=0 tx=0).stop 2023-10-21T18:29:59.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 msgr2=0x7f851c1620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f850c00ba50 tx=0x7f850c00bf10 comp rx=0 tx=0).stop 2023-10-21T18:29:59.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 shutdown_connections 2023-10-21T18:29:59.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f84fc06ae70 0x7f84fc06d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f851c1f21a0 0x7f851c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f851c0c5900 0x7f851c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 --2- 172.21.15.12:0/827366261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f851c0c1c70 0x7f851c1620a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 >> 172.21.15.12:0/827366261 conn(0x7f851c069de0 msgr2=0x7f851c154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:59.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 shutdown_connections 2023-10-21T18:29:59.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.190+0000 7f8521a75640 1 -- 172.21.15.12:0/827366261 wait complete. 2023-10-21T18:29:59.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-21T18:29:59.402 INFO:tasks.ceph.mds.c.smithi012.stderr:daemon-helper: command failed with exit status 42 2023-10-21T18:29:59.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:29:59.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:29:59.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.414+0000 7f1c18b33640 1 Processor -- start 2023-10-21T18:29:59.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.414+0000 7f1c18b33640 1 -- start start 2023-10-21T18:29:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c18b33640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c14153490 0x7f1c1415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c18b33640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c140cbe40 0x7f1c14159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c18b33640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140cc250 con 0x7f1c140c97e0 2023-10-21T18:29:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c18b33640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c14153870 con 0x7f1c140cbe40 2023-10-21T18:29:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c18b33640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c140cb0a0 con 0x7f1c14153490 2023-10-21T18:29:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.416+0000 7f1c1259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c14153490 0x7f1c1415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.417+0000 7f1c11d9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1c140c97e0 0x7f1c140ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.12:53978/0 (socket says 172.21.15.12:53978) 2023-10-21T18:29:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.417+0000 7f1c11d9b640 1 -- 172.21.15.12:0/1489735244 learned_addr learned my addr 172.21.15.12:0/1489735244 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-21T18:29:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.418+0000 7f1c12d9d640 1 --2- 172.21.15.12:0/1489735244 >> v2:172.21.15.12:3300/0 conn(0x7f1c140cbe40 0x7f1c14159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.421+0000 7f1c1259c640 1 -- 172.21.15.12:0/1489735244 >> v2:172.21.15.12:3300/0 conn(0x7f1c140cbe40 msgr2=0x7f1c14159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:29:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.421+0000 7f1c1259c640 1 --2- 172.21.15.12:0/1489735244 >> v2:172.21.15.12:3300/0 conn(0x7f1c140cbe40 0x7f1c14159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.421+0000 7f1c1259c640 1 -- 172.21.15.12:0/1489735244 >> v1:172.21.15.99:6789/0 conn(0x7f1c140c97e0 legacy=0x7f1c140ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.421+0000 7f1c1259c640 1 -- 172.21.15.12:0/1489735244 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14159cf0 con 0x7f1c14153490 2023-10-21T18:29:59.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.424+0000 7f1c1259c640 1 --2- 172.21.15.12:0/1489735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c14153490 0x7f1c1415a600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c140cf7a0 tx=0x7f1c0402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba46bfaf0c8cc1d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:59.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.428+0000 7f1c1159a640 1 -- 172.21.15.12:0/1489735244 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031830 con 0x7f1c14153490 2023-10-21T18:29:59.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.428+0000 7f1c1159a640 1 -- 172.21.15.12:0/1489735244 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c04031990 con 0x7f1c14153490 2023-10-21T18:29:59.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.428+0000 7f1c1159a640 1 -- 172.21.15.12:0/1489735244 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031d40 con 0x7f1c14153490 2023-10-21T18:29:59.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 -- 172.21.15.12:0/1489735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c14153490 msgr2=0x7f1c1415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1489735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c14153490 0x7f1c1415a600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c140cf7a0 tx=0x7f1c0402b8d0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 -- 172.21.15.12:0/1489735244 shutdown_connections 2023-10-21T18:29:59.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1489735244 >> v2:172.21.15.12:3300/0 conn(0x7f1c140cbe40 0x7f1c14159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1489735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c14153490 0x7f1c1415a600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 -- 172.21.15.12:0/1489735244 >> 172.21.15.12:0/1489735244 conn(0x7f1c140716f0 msgr2=0x7f1c1406aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:29:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 -- 172.21.15.12:0/1489735244 shutdown_connections 2023-10-21T18:29:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.429+0000 7f1c18b33640 1 -- 172.21.15.12:0/1489735244 wait complete. 2023-10-21T18:29:59.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.431+0000 7f1c18b33640 1 Processor -- start 2023-10-21T18:29:59.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.431+0000 7f1c18b33640 1 -- start start 2023-10-21T18:29:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c140cbe40 0x7f1c140c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14153490 0x7f1c141f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141f2940 con 0x7f1c14153490 2023-10-21T18:29:59.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c2260 con 0x7f1c140c97e0 2023-10-21T18:29:59.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c18b33640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141f2660 con 0x7f1c140cbe40 2023-10-21T18:29:59.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c1259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.433+0000 7f1c11d9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c140cbe40 0x7f1c140c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.434+0000 7f1c1259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.12:36224/0 (socket says 172.21.15.12:36224) 2023-10-21T18:29:59.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.434+0000 7f1c1259c640 1 -- 172.21.15.12:0/1634450831 learned_addr learned my addr 172.21.15.12:0/1634450831 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:29:59.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.434+0000 7f1c12d9d640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14153490 0x7f1c141f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.437+0000 7f1c1259c640 1 -- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c140cbe40 msgr2=0x7f1c140c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.437+0000 7f1c1259c640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c140cbe40 0x7f1c140c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.437+0000 7f1c1259c640 1 -- 172.21.15.12:0/1634450831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14153490 msgr2=0x7f1c141f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:29:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.437+0000 7f1c1259c640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14153490 0x7f1c141f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:29:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.437+0000 7f1c1259c640 1 -- 172.21.15.12:0/1634450831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04009400 con 0x7f1c140c97e0 2023-10-21T18:29:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.439+0000 7f1c1259c640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.443+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0403a9e0 con 0x7f1c140c97e0 2023-10-21T18:29:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.443+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c0403ab60 con 0x7f1c140c97e0 2023-10-21T18:29:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.443+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040443f0 con 0x7f1c140c97e0 2023-10-21T18:29:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.443+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c141f1580 con 0x7f1c140c97e0 2023-10-21T18:29:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.444+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c140b3f20 con 0x7f1c140c97e0 2023-10-21T18:29:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.445+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1415c4d0 con 0x7f1c140c97e0 2023-10-21T18:29:59.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.465+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c0404d450 con 0x7f1c140c97e0 2023-10-21T18:29:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.465+0000 7f1c02ffd640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 0x7f1bf406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:29:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.466+0000 7f1c11d9b640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 0x7f1bf406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:29:59.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.466+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1c04045c90 con 0x7f1c140c97e0 2023-10-21T18:29:59.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.467+0000 7f1c11d9b640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 0x7f1bf406d3b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c1415b680 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:29:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.701+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c04076d20 con 0x7f1c140c97e0 2023-10-21T18:29:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:29:59.913+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c140619f0 con 0x7f1c140c97e0 2023-10-21T18:30:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.404+0000 7f1c02ffd640 1 -- 172.21.15.12:0/1634450831 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c04035020 con 0x7f1c140c97e0 2023-10-21T18:30:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-21T18:30:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 msgr2=0x7f1bf406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 0x7f1bf406d3b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c1415b680 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2023-10-21T18:30:00.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 msgr2=0x7f1c1414d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c040046c0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 shutdown_connections 2023-10-21T18:30:00.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7f1bf406aef0 0x7f1bf406d3b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14153490 0x7f1c141f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c140cbe40 0x7f1c140c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 --2- 172.21.15.12:0/1634450831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c140c97e0 0x7f1c1414d730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.412+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 >> 172.21.15.12:0/1634450831 conn(0x7f1c140716f0 msgr2=0x7f1c1415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:30:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.415+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 shutdown_connections 2023-10-21T18:30:00.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.416+0000 7f1c18b33640 1 -- 172.21.15.12:0/1634450831 wait complete. 2023-10-21T18:30:00.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-21T18:30:00.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.642+0000 7fded22ec640 1 Processor -- start 2023-10-21T18:30:00.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.643+0000 7fded22ec640 1 -- start start 2023-10-21T18:30:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.644+0000 7fded22ec640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdecc0c55f0 0x7fdecc157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.644+0000 7fded22ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.644+0000 7fded22ec640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0c23f0 con 0x7fdecc157cc0 2023-10-21T18:30:00.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.644+0000 7fded22ec640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc156fa0 con 0x7fdecc0c55f0 2023-10-21T18:30:00.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.644+0000 7fded22ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc15aaf0 con 0x7fdecc0c59d0 2023-10-21T18:30:00.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.645+0000 7fded0889640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.645+0000 7fded0889640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.12:34294/0 (socket says 172.21.15.12:34294) 2023-10-21T18:30:00.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.645+0000 7fded0889640 1 -- 172.21.15.12:0/1005322277 learned_addr learned my addr 172.21.15.12:0/1005322277 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:30:00.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.645+0000 7fdecbfff640 1 --2- 172.21.15.12:0/1005322277 >> v2:172.21.15.12:3300/0 conn(0x7fdecc0c55f0 0x7fdecc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.648+0000 7fded0889640 1 -- 172.21.15.12:0/1005322277 >> v2:172.21.15.12:3300/0 conn(0x7fdecc0c55f0 msgr2=0x7fdecc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-21T18:30:00.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.648+0000 7fded0889640 1 --2- 172.21.15.12:0/1005322277 >> v2:172.21.15.12:3300/0 conn(0x7fdecc0c55f0 0x7fdecc157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.648+0000 7fded0889640 1 -- 172.21.15.12:0/1005322277 >> v1:172.21.15.12:6789/0 conn(0x7fdecc157cc0 legacy=0x7fdecc150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.648+0000 7fded0889640 1 -- 172.21.15.12:0/1005322277 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc15add0 con 0x7fdecc0c59d0 2023-10-21T18:30:00.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.650+0000 7fded0889640 1 --2- 172.21.15.12:0/1005322277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009e50 tx=0x7fdec402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2edb32ea366b2900 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:30:00.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.653+0000 7fdecb7fe640 1 -- 172.21.15.12:0/1005322277 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec402cb90 con 0x7fdecc0c59d0 2023-10-21T18:30:00.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.653+0000 7fdecb7fe640 1 -- 172.21.15.12:0/1005322277 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdec402ccf0 con 0x7fdecc0c59d0 2023-10-21T18:30:00.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.653+0000 7fdecb7fe640 1 -- 172.21.15.12:0/1005322277 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4034630 con 0x7fdecc0c59d0 2023-10-21T18:30:00.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 -- 172.21.15.12:0/1005322277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 msgr2=0x7fdecc0c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 --2- 172.21.15.12:0/1005322277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009e50 tx=0x7fdec402bff0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 -- 172.21.15.12:0/1005322277 shutdown_connections 2023-10-21T18:30:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 --2- 172.21.15.12:0/1005322277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc0c7020 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 --2- 172.21.15.12:0/1005322277 >> v2:172.21.15.12:3300/0 conn(0x7fdecc0c55f0 0x7fdecc157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 -- 172.21.15.12:0/1005322277 >> 172.21.15.12:0/1005322277 conn(0x7fdecc069de0 msgr2=0x7fdecc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:30:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 -- 172.21.15.12:0/1005322277 shutdown_connections 2023-10-21T18:30:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.654+0000 7fded22ec640 1 -- 172.21.15.12:0/1005322277 wait complete. 2023-10-21T18:30:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.656+0000 7fded22ec640 1 Processor -- start 2023-10-21T18:30:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.656+0000 7fded22ec640 1 -- start start 2023-10-21T18:30:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdecc0c55f0 0x7fdecc070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1485e0 con 0x7fdecc157cc0 2023-10-21T18:30:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1ef6a0 con 0x7fdecc0c55f0 2023-10-21T18:30:00.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.657+0000 7fded22ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1efbd0 con 0x7fdecc0c59d0 2023-10-21T18:30:00.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.658+0000 7fded0889640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.658+0000 7fdec3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.658+0000 7fdecbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdecc0c55f0 0x7fdecc070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.658+0000 7fded0889640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48658/0 (socket says 172.21.15.12:48658) 2023-10-21T18:30:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.658+0000 7fded0889640 1 -- 172.21.15.12:0/2222030730 learned_addr learned my addr 172.21.15.12:0/2222030730 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-21T18:30:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.663+0000 7fded0889640 1 -- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 msgr2=0x7fdecc149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.663+0000 7fded0889640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.663+0000 7fded0889640 1 -- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdecc0c55f0 msgr2=0x7fdecc070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.663+0000 7fded0889640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdecc0c55f0 0x7fdecc070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.663+0000 7fded0889640 1 -- 172.21.15.12:0/2222030730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009b30 con 0x7fdecc157cc0 2023-10-21T18:30:00.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.666+0000 7fded0889640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009e50 tx=0x7fdec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:30:00.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.670+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4007ea0 con 0x7fdecc157cc0 2023-10-21T18:30:00.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.670+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdec403e450 con 0x7fdecc157cc0 2023-10-21T18:30:00.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.670+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec403e820 con 0x7fdecc157cc0 2023-10-21T18:30:00.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.670+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0704f0 con 0x7fdecc157cc0 2023-10-21T18:30:00.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.670+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc06fea0 con 0x7fdecc157cc0 2023-10-21T18:30:00.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.671+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc070680 con 0x7fdecc157cc0 2023-10-21T18:30:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.693+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdec403e980 con 0x7fdecc157cc0 2023-10-21T18:30:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.696+0000 7fdec97fa640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 0x7fdeac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-21T18:30:00.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.696+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fdec407b350 con 0x7fdecc157cc0 2023-10-21T18:30:00.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.696+0000 7fdecbfff640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 0x7fdeac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-21T18:30:00.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:00.697+0000 7fdecbfff640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 0x7fdeac06d380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009b40 tx=0x7fdebc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-21T18:30:00.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-21T18:30:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:01.066+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdec4077690 con 0x7fdecc157cc0 2023-10-21T18:30:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:01.263+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdecc156850 con 0x7fdecc157cc0 2023-10-21T18:30:02.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.352+0000 7fdec97fa640 1 -- 172.21.15.12:0/2222030730 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdec4043020 con 0x7fdecc157cc0 2023-10-21T18:30:02.355 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-21T18:30:02.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 msgr2=0x7fdeac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:02.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 0x7fdeac06d380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009b40 tx=0x7fdebc009190 comp rx=0 tx=0).stop 2023-10-21T18:30:02.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 msgr2=0x7fdecc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-21T18:30:02.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009e50 tx=0x7fdec4004a40 comp rx=0 tx=0).stop 2023-10-21T18:30:02.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 shutdown_connections 2023-10-21T18:30:02.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:6800/381435415,v1:172.21.15.99:6801/381435415] conn(0x7fdeac06aec0 0x7fdeac06d380 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:02.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdecc157cc0 0x7fdecc159630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:02.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdecc0c59d0 0x7fdecc149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:02.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 --2- 172.21.15.12:0/2222030730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdecc0c55f0 0x7fdecc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-21T18:30:02.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 >> 172.21.15.12:0/2222030730 conn(0x7fdecc069de0 msgr2=0x7fdecc154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-21T18:30:02.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 shutdown_connections 2023-10-21T18:30:02.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-21T18:30:02.356+0000 7fded22ec640 1 -- 172.21.15.12:0/2222030730 wait complete. 2023-10-21T18:30:02.380 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-21T18:30:02.381 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-21T18:30:02.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:02.418 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-21T18:30:02.389+0000 b5af640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 92568) UID: 0 2023-10-21T18:30:02.420 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-21T18:30:02.393+0000 b5af640 -1 mds.a *** got signal Terminated *** 2023-10-21T18:30:07.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-21T18:30:07.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-10-21T18:30:08.490 INFO:tasks.ceph.mds.a:Stopped 2023-10-21T18:30:08.490 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-21T18:30:08.490 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:08.491 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-21T18:30:08.491 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2023-10-21T18:30:08.492 INFO:tasks.ceph.mds.c:Stopped 2023-10-21T18:30:08.492 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-10-21T18:30:08.493 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:08.536 INFO:tasks.ceph.mds.e.smithi012.stderr:2023-10-21T18:30:08.502+0000 b5af640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 92573) UID: 0 2023-10-21T18:30:08.537 INFO:tasks.ceph.mds.e.smithi012.stderr:2023-10-21T18:30:08.506+0000 b5af640 -1 mds.e *** got signal Terminated *** 2023-10-21T18:30:14.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-10-21T18:30:14.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-21T18:30:14.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-21T18:30:14.595 INFO:tasks.ceph.mds.e:Stopped 2023-10-21T18:30:14.595 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-21T18:30:14.596 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:14.608 INFO:tasks.ceph.mds.b.smithi099.stderr:2023-10-21T18:30:14.599+0000 b5af640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 93902) UID: 0 2023-10-21T18:30:14.609 INFO:tasks.ceph.mds.b.smithi099.stderr:2023-10-21T18:30:14.600+0000 b5af640 -1 mds.b *** got signal Terminated *** 2023-10-21T18:30:20.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-21T18:30:20.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-10-21T18:30:20.697 INFO:tasks.ceph.mds.b:Stopped 2023-10-21T18:30:20.698 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-21T18:30:20.698 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:20.713 INFO:tasks.ceph.mds.d.smithi099.stderr:2023-10-21T18:30:20.702+0000 b5af640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 93903) UID: 0 2023-10-21T18:30:20.714 INFO:tasks.ceph.mds.d.smithi099.stderr:2023-10-21T18:30:20.703+0000 b5af640 -1 mds.d *** got signal Terminated *** 2023-10-21T18:30:26.800 INFO:tasks.ceph.mds.d:Stopped 2023-10-21T18:30:26.801 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-10-21T18:30:26.801 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:26.816 INFO:tasks.ceph.mds.f.smithi099.stderr:2023-10-21T18:30:26.804+0000 b5af640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 93906) UID: 0 2023-10-21T18:30:26.817 INFO:tasks.ceph.mds.f.smithi099.stderr:2023-10-21T18:30:26.806+0000 b5af640 -1 mds.f *** got signal Terminated *** 2023-10-21T18:30:27.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-21T18:30:27.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-21T18:30:29.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:30:29.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:30:32.904 INFO:tasks.ceph.mds.f:Stopped 2023-10-21T18:30:32.904 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-21T18:30:32.905 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-21T18:30:32.905 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:32.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T18:30:32.905+0000 7f175779c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 87235) UID: 0 2023-10-21T18:30:32.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-21T18:30:32.905+0000 7f175779c640 -1 osd.0 33 *** Got signal Terminated *** 2023-10-21T18:30:33.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-21T18:30:39.008 INFO:tasks.ceph.osd.0:Stopped 2023-10-21T18:30:39.009 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-21T18:30:39.009 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:39.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T18:30:39.008+0000 7f09c60bc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 87237) UID: 0 2023-10-21T18:30:39.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-21T18:30:39.008+0000 7f09c60bc640 -1 osd.1 34 *** Got signal Terminated *** 2023-10-21T18:30:39.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-21T18:30:45.111 INFO:tasks.ceph.osd.1:Stopped 2023-10-21T18:30:45.112 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-21T18:30:45.112 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:45.113 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T18:30:45.111+0000 7f7e658b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 87243) UID: 0 2023-10-21T18:30:45.114 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-21T18:30:45.111+0000 7f7e658b0640 -1 osd.2 36 *** Got signal Terminated *** 2023-10-21T18:30:45.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-21T18:30:45.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-21T18:30:51.215 INFO:tasks.ceph.osd.2:Stopped 2023-10-21T18:30:51.215 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-21T18:30:51.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:51.217 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T18:30:51.215+0000 7fbcfe8c2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 87246) UID: 0 2023-10-21T18:30:51.217 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-21T18:30:51.215+0000 7fbcfe8c2640 -1 osd.3 37 *** Got signal Terminated *** 2023-10-21T18:30:51.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-21T18:30:51.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-21T18:30:57.318 INFO:tasks.ceph.osd.3:Stopped 2023-10-21T18:30:57.319 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-21T18:30:57.319 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:30:57.320 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T18:30:57.318+0000 7f6e2b932640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 88576) UID: 0 2023-10-21T18:30:57.320 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-10-21T18:30:57.318+0000 7f6e2b932640 -1 osd.4 38 *** Got signal Terminated *** 2023-10-21T18:30:57.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-21T18:30:57.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-21T18:30:59.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:30:59.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:31:03.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-21T18:31:03.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-21T18:31:03.420 INFO:tasks.ceph.osd.4:Stopped 2023-10-21T18:31:03.421 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-21T18:31:03.421 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:03.422 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T18:31:03.420+0000 7fa92f24b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 88578) UID: 0 2023-10-21T18:31:03.422 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-10-21T18:31:03.420+0000 7fa92f24b640 -1 osd.5 39 *** Got signal Terminated *** 2023-10-21T18:31:09.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-21T18:31:09.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-21T18:31:09.523 INFO:tasks.ceph.osd.5:Stopped 2023-10-21T18:31:09.523 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-21T18:31:09.524 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:09.525 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T18:31:09.523+0000 7f119ad67640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 88581) UID: 0 2023-10-21T18:31:09.525 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-10-21T18:31:09.523+0000 7f119ad67640 -1 osd.6 40 *** Got signal Terminated *** 2023-10-21T18:31:14.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-21T18:31:14.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-21T18:31:15.626 INFO:tasks.ceph.osd.6:Stopped 2023-10-21T18:31:15.627 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-21T18:31:15.627 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:15.628 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T18:31:15.626+0000 7ff70d58b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 88583) UID: 0 2023-10-21T18:31:15.628 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-10-21T18:31:15.626+0000 7ff70d58b640 -1 osd.7 40 *** Got signal Terminated *** 2023-10-21T18:31:20.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-21T18:31:20.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-21T18:31:21.729 INFO:tasks.ceph.osd.7:Stopped 2023-10-21T18:31:21.730 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-21T18:31:21.730 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-21T18:31:21.731 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:21.827 INFO:tasks.ceph.mgr.y:Stopped 2023-10-21T18:31:21.828 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-21T18:31:21.828 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:21.829 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-10-21T18:31:21.827+0000 7ffb8e9dc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 87904) UID: 0 2023-10-21T18:31:21.856 INFO:tasks.ceph.mgr.x:Stopped 2023-10-21T18:31:21.857 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-21T18:31:21.857 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-21T18:31:21.858 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:21.975 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-21T18:31:21.940+0000 9f5f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 86961) UID: 0 2023-10-21T18:31:21.977 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-21T18:31:21.944+0000 9f5f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-21T18:31:22.976 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:04:48.958 86968== 2023-10-21T18:31:22.977 INFO:tasks.ceph.mon.a.smithi012.stderr:==00:02:04:48.958 86968== Exit program on first error (--exit-on-first-error=yes) 2023-10-21T18:31:23.036 INFO:tasks.ceph.mon.a.smithi012.stderr:daemon-helper: command failed with exit status 42 2023-10-21T18:31:25.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-21T18:31:25.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-21T18:31:27.959 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-21T18:31:27.960 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-10-21T18:31:27.960 INFO:tasks.ceph.mon.a:Stopped 2023-10-21T18:31:27.961 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-21T18:31:27.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:27.977 INFO:tasks.ceph.mon.b.smithi099.stderr:2023-10-21T18:31:27.964+0000 9f5f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 87892) UID: 0 2023-10-21T18:31:27.977 INFO:tasks.ceph.mon.b.smithi099.stderr:2023-10-21T18:31:27.965+0000 9f5f640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-21T18:31:28.480 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:04:54.564 87906== 2023-10-21T18:31:28.480 INFO:tasks.ceph.mon.b.smithi099.stderr:==00:02:04:54.564 87906== Exit program on first error (--exit-on-first-error=yes) 2023-10-21T18:31:28.491 INFO:tasks.ceph.mon.b.smithi099.stderr:daemon-helper: command failed with exit status 42 2023-10-21T18:31:30.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:31:30.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:31:30.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-21T18:31:30.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-21T18:31:34.063 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-21T18:31:34.063 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-10-21T18:31:34.064 INFO:tasks.ceph.mon.b:Stopped 2023-10-21T18:31:34.064 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-21T18:31:34.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-21T18:31:34.081 INFO:tasks.ceph.mon.c.smithi099.stderr:2023-10-21T18:31:34.067+0000 9f5f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 87899) UID: 0 2023-10-21T18:31:34.082 INFO:tasks.ceph.mon.c.smithi099.stderr:2023-10-21T18:31:34.068+0000 9f5f640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-10-21T18:31:35.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-21T18:31:58.883 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:05:24.966 87907== 2023-10-21T18:31:58.883 INFO:tasks.ceph.mon.c.smithi099.stderr:==00:02:05:24.966 87907== Exit program on first error (--exit-on-first-error=yes) 2023-10-21T18:31:58.894 INFO:tasks.ceph.mon.c.smithi099.stderr:daemon-helper: command failed with exit status 42 2023-10-21T18:32:00.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:00.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:01.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-21T18:32:04.573 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-21T18:32:04.573 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-10-21T18:32:04.574 INFO:tasks.ceph.mon.c:Stopped 2023-10-21T18:32:04.574 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-21T18:32:04.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-21T18:32:04.691 INFO:teuthology.orchestra.run.smithi012.stdout:2023-10-21T17:31:46.557104+0000 mds.c (mds.0) 26 : cluster [WRN] client.4573 isn't responding to mclientcaps(revoke), ino 0x100000035ab pending pAsLsXs issued pAsLsXsFsxc, sent 301.405456 seconds ago 2023-10-21T18:32:04.693 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-21T18:32:04.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-21T18:32:04.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-21T18:32:04.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-21T18:32:04.956 INFO:teuthology.orchestra.run.smithi012.stdout:2023-10-21T17:31:46.557104+0000 mds.c (mds.0) 26 : cluster [WRN] client.4573 isn't responding to mclientcaps(revoke), ino 0x100000035ab pending pAsLsXs issued pAsLsXsFsxc, sent 301.405456 seconds ago 2023-10-21T18:32:04.957 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:32:04.957 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-21T18:32:05.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:32:05.153 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-21T18:32:05.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:32:05.320 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-21T18:32:05.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:32:05.495 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-21T18:32:05.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T18:32:05.664 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-21T18:32:05.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T18:32:05.756 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-21T18:32:05.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T18:32:05.860 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-21T18:32:05.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T18:32:05.924 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-21T18:32:05.984 INFO:tasks.ceph:Archiving mon data... 2023-10-21T18:32:05.986 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/data/mon.a.tgz 2023-10-21T18:32:05.987 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-21T18:32:06.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-21T18:32:06.050 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.F6thzFLLsv 2023-10-21T18:32:06.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.F6thzFLLsv 2023-10-21T18:32:06.238 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.F6thzFLLsv 2023-10-21T18:32:06.400 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.F6thzFLLsv is 389KB 2023-10-21T18:32:06.513 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.F6thzFLLsv 2023-10-21T18:32:06.576 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/data/mon.b.tgz 2023-10-21T18:32:06.577 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-10-21T18:32:06.594 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.XF1dNeZ3lt 2023-10-21T18:32:06.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XF1dNeZ3lt 2023-10-21T18:32:06.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.XF1dNeZ3lt 2023-10-21T18:32:06.845 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.XF1dNeZ3lt is 405KB 2023-10-21T18:32:06.943 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.XF1dNeZ3lt 2023-10-21T18:32:06.957 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/data/mon.c.tgz 2023-10-21T18:32:06.958 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-10-21T18:32:07.011 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.MdnubLDI6q 2023-10-21T18:32:07.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MdnubLDI6q 2023-10-21T18:32:07.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.MdnubLDI6q 2023-10-21T18:32:07.229 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.MdnubLDI6q is 405KB 2023-10-21T18:32:07.328 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.MdnubLDI6q 2023-10-21T18:32:07.346 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-21T18:32:07.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-21T18:32:07.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-21T18:32:07.461 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-21T18:32:07.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-21T18:32:07.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-21T18:32:07.511 INFO:teuthology.orchestra.run.smithi099.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-10-21T18:32:07.511 INFO:teuthology.orchestra.run.smithi099.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-10-21T18:32:07.604 INFO:teuthology.orchestra.run.smithi012.stdout:/var/log/ceph/valgrind/mds.c.log: Leak_PossiblyLost 2023-10-21T18:32:07.604 INFO:teuthology.orchestra.run.smithi012.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-10-21T18:32:07.605 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.c.log kind Leak_PossiblyLost 2023-10-21T18:32:07.606 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-10-21T18:32:07.606 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-10-21T18:32:07.606 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-10-21T18:32:07.606 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-10-21T18:32:07.607 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-10-21T18:32:07.607 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-10-21T18:32:07.607 INFO:tasks.ceph:Archiving crash dumps... 2023-10-21T18:32:07.675 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi012/crash 2023-10-21T18:32:07.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-21T18:32:07.932 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi099/crash 2023-10-21T18:32:07.999 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-21T18:32:08.026 INFO:tasks.ceph:Shutting down logrotate 2023-10-21T18:32:08.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:08.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:08.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:08.282 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-21T18:32:08.312 INFO:tasks.ceph:Compressing logs... 2023-10-21T18:32:08.312 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-21T18:32:08.321 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-21T18:32:08.379 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-21T18:32:08.379 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88196.log 2023-10-21T18:32:08.379 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-10-21T18:32:08.385 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-client.admin.88196.log: --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-10-21T18:32:08.386 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/mon.c.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88196.log.gz 2023-10-21T18:32:08.386 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-10-21T18:32:08.386 INFO:teuthology.orchestra.run.smithi099.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-10-21T18:32:08.386 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-10-21T18:32:08.387 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/mds.f.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-10-21T18:32:08.387 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-10-21T18:32:08.387 INFO:teuthology.orchestra.run.smithi099.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-10-21T18:32:08.387 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88485.log 2023-10-21T18:32:08.387 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/mds.d.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88116.log 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr: 57.1% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88485.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88485.log.gz 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88116.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-21T18:32:08.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.88116.log.gz 2023-10-21T18:32:08.389 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-21T18:32:08.389 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88287.log 2023-10-21T18:32:08.389 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-21T18:32:08.389 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-21T18:32:08.389 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-21T18:32:08.390 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.88287.log.gz /var/log/ceph/ceph-client.admin.88371.log 2023-10-21T18:32:08.390 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-10-21T18:32:08.390 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-10-21T18:32:08.390 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88371.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-21T18:32:08.390 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.f.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88371.log.gz 2023-10-21T18:32:08.391 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88327.log 2023-10-21T18:32:08.391 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-21T18:32:08.391 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88327.log: /var/log/ceph/ceph-mgr.x.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.88327.log.gz 2023-10-21T18:32:08.405 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-21T18:32:08.409 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-21T18:32:08.410 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-10-21T18:32:08.416 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88156.log 2023-10-21T18:32:08.416 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-21T18:32:08.416 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88156.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88156.log.gz 2023-10-21T18:32:08.416 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88236.log 2023-10-21T18:32:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93295.log 2023-10-21T18:32:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92387.log 2023-10-21T18:32:08.418 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93295.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.94315.log 2023-10-21T18:32:08.418 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93295.log.gz 2023-10-21T18:32:08.419 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101121.log 2023-10-21T18:32:08.419 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92387.log.gz 2023-10-21T18:32:08.419 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94048.log 2023-10-21T18:32:08.420 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94315.log.gz 2023-10-21T18:32:08.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101121.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-21T18:32:08.420 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101121.log.gz 2023-10-21T18:32:08.422 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94048.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94048.log.gz 2023-10-21T18:32:08.422 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101826.log 2023-10-21T18:32:08.423 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102070.log 2023-10-21T18:32:08.424 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.d.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-21T18:32:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101826.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101826.log.gz 2023-10-21T18:32:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95203.log 2023-10-21T18:32:08.426 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-21T18:32:08.426 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88236.log.gz 2023-10-21T18:32:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102070.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102070.log.gz 2023-10-21T18:32:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92816.log 2023-10-21T18:32:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94825.log 2023-10-21T18:32:08.428 INFO:teuthology.orchestra.run.smithi012.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.95203.log.gz 2023-10-21T18:32:08.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93769.log 2023-10-21T18:32:08.429 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92816.log.gz 2023-10-21T18:32:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94825.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94825.log.gz 2023-10-21T18:32:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-10-21T18:32:08.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93769.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93769.log.gz 2023-10-21T18:32:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-10-21T18:32:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/valgrind/mds.c.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-10-21T18:32:08.434 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-10-21T18:32:08.435 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/valgrind/mds.a.log: 57.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-10-21T18:32:08.436 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-10-21T18:32:08.437 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/valgrind/mon.a.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-10-21T18:32:08.437 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101415.log 2023-10-21T18:32:08.438 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/valgrind/mds.e.log: 57.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-10-21T18:32:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92949.log 2023-10-21T18:32:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101415.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101415.log.gz 2023-10-21T18:32:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100600.log 2023-10-21T18:32:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92949.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92949.log.gz 2023-10-21T18:32:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93209.log 2023-10-21T18:32:08.443 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100600.log.gz 2023-10-21T18:32:08.443 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92577.log 2023-10-21T18:32:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-21T18:32:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102280.log 2023-10-21T18:32:08.445 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93209.log.gz 2023-10-21T18:32:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92577.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92577.log.gz 2023-10-21T18:32:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102112.log 2023-10-21T18:32:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102280.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102280.log.gz 2023-10-21T18:32:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94038.log 2023-10-21T18:32:08.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102341.log 2023-10-21T18:32:08.448 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102112.log.gz 2023-10-21T18:32:08.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94038.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.94038.log.gz 2023-10-21T18:32:08.450 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94783.log 2023-10-21T18:32:08.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102341.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.102341.log.gz 2023-10-21T18:32:08.451 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101584.log 2023-10-21T18:32:08.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94783.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.94783.log.gz /var/log/ceph/ceph-client.admin.101331.log 2023-10-21T18:32:08.453 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-21T18:32:08.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101584.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.101584.log.gz 2023-10-21T18:32:08.454 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101988.log 2023-10-21T18:32:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94319.log 2023-10-21T18:32:08.455 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101331.log.gz 2023-10-21T18:32:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101988.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.101988.log.gz --verbose 2023-10-21T18:32:08.457 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.101079.log 2023-10-21T18:32:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94319.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94319.log.gz 2023-10-21T18:32:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102238.log 2023-10-21T18:32:08.459 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101457.log 2023-10-21T18:32:08.459 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101079.log.gz 2023-10-21T18:32:08.460 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102238.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102238.log.gz 2023-10-21T18:32:08.461 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92622.log 2023-10-21T18:32:08.462 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101457.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101457.log.gz 2023-10-21T18:32:08.462 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95635.log 2023-10-21T18:32:08.463 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92622.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-21T18:32:08.464 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92622.log.gz 2023-10-21T18:32:08.464 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.95635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95635.log.gz 2023-10-21T18:32:08.465 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93379.log 2023-10-21T18:32:08.466 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94403.log 2023-10-21T18:32:08.467 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-21T18:32:08.468 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102154.log 2023-10-21T18:32:08.468 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93379.log.gz 2023-10-21T18:32:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93075.log 2023-10-21T18:32:08.469 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94403.log.gz 2023-10-21T18:32:08.470 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102154.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.93119.log -- replaced with /var/log/ceph/ceph-client.admin.102154.log.gz 2023-10-21T18:32:08.470 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-21T18:32:08.472 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94657.log 2023-10-21T18:32:08.472 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93075.log.gz 2023-10-21T18:32:08.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93119.log.gz 2023-10-21T18:32:08.473 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94615.log 2023-10-21T18:32:08.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94657.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94657.log.gz -5 2023-10-21T18:32:08.475 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87251.log 2023-10-21T18:32:08.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94615.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94615.log.gz 2023-10-21T18:32:08.477 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92991.log 2023-10-21T18:32:08.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.87251.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87251.log.gz 2023-10-21T18:32:08.478 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94555.log 2023-10-21T18:32:08.479 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93337.log 2023-10-21T18:32:08.479 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92991.log.gz 2023-10-21T18:32:08.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94555.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94555.log.gz 2023-10-21T18:32:08.480 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94509.log 2023-10-21T18:32:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93337.log.gz 2023-10-21T18:32:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101247.log 2023-10-21T18:32:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94509.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-21T18:32:08.483 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94509.log.gz 2023-10-21T18:32:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101247.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101247.log.gz 2023-10-21T18:32:08.484 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95161.log 2023-10-21T18:32:08.485 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93757.log 2023-10-21T18:32:08.487 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95161.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95161.log.gz 2023-10-21T18:32:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102196.log 2023-10-21T18:32:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93757.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93757.log.gz 2023-10-21T18:32:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92664.log 2023-10-21T18:32:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101626.log 2023-10-21T18:32:08.491 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102196.log.gz 2023-10-21T18:32:08.492 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94993.log 2023-10-21T18:32:08.493 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92664.log.gz 2023-10-21T18:32:08.493 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86967.log 2023-10-21T18:32:08.493 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101626.log.gz 2023-10-21T18:32:08.494 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100911.log 2023-10-21T18:32:08.494 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94993.log.gz 2023-10-21T18:32:08.495 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.86967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94867.log 2023-10-21T18:32:08.496 INFO:teuthology.orchestra.run.smithi012.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.86967.log.gz 2023-10-21T18:32:08.496 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92462.log 2023-10-21T18:32:08.497 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100911.log.gz 2023-10-21T18:32:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94867.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94867.log.gz 2023-10-21T18:32:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102028.log 2023-10-21T18:32:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92706.log 2023-10-21T18:32:08.500 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92462.log.gz 2023-10-21T18:32:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93589.log 2023-10-21T18:32:08.501 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102028.log.gz 2023-10-21T18:32:08.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92706.log.gz 2023-10-21T18:32:08.502 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95035.log 2023-10-21T18:32:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93589.log.gz 2023-10-21T18:32:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-21T18:32:08.505 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95035.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95035.log.gz 2023-10-21T18:32:08.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80897.log 2023-10-21T18:32:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95119.log 2023-10-21T18:32:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.80897.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80897.log.gz 2023-10-21T18:32:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93167.log 2023-10-21T18:32:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101542.log 2023-10-21T18:32:08.510 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95119.log.gz 2023-10-21T18:32:08.511 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93167.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93167.log.gz 2023-10-21T18:32:08.511 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94467.log 2023-10-21T18:32:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93763.log 2023-10-21T18:32:08.513 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101542.log.gz 2023-10-21T18:32:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94467.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.93766.log -- replaced with /var/log/ceph/ceph-client.admin.94467.log.gz 2023-10-21T18:32:08.515 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-21T18:32:08.516 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94126.log 2023-10-21T18:32:08.517 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93763.log.gz 2023-10-21T18:32:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93766.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93766.log.gz 2023-10-21T18:32:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100953.log 2023-10-21T18:32:08.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101037.log 2023-10-21T18:32:08.520 INFO:teuthology.orchestra.run.smithi012.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94126.log.gz 2023-10-21T18:32:08.521 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100953.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.100953.log.gz -5 2023-10-21T18:32:08.521 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.92865.log 2023-10-21T18:32:08.523 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101163.log 2023-10-21T18:32:08.523 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101037.log.gz 2023-10-21T18:32:08.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92865.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-10-21T18:32:08.525 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92865.log.gz 2023-10-21T18:32:08.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101163.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-21T18:32:08.526 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101163.log.gz 2023-10-21T18:32:08.527 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94101.log 2023-10-21T18:32:08.529 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101886.log 2023-10-21T18:32:08.531 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100995.log 2023-10-21T18:32:08.531 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94101.log.gz 2023-10-21T18:32:08.532 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101499.log 2023-10-21T18:32:08.533 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101886.log.gz 2023-10-21T18:32:08.534 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95077.log 2023-10-21T18:32:08.534 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100995.log.gz 2023-10-21T18:32:08.535 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100726.log 2023-10-21T18:32:08.536 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101499.log.gz 2023-10-21T18:32:08.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93771.log 2023-10-21T18:32:08.537 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95077.log.gz 2023-10-21T18:32:08.539 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93768.log 2023-10-21T18:32:08.539 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100726.log.gz 2023-10-21T18:32:08.540 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92907.log 2023-10-21T18:32:08.540 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93771.log.gz 2023-10-21T18:32:08.542 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101771.log 2023-10-21T18:32:08.542 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93768.log.gz 2023-10-21T18:32:08.543 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.92907.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.94909.log 2023-10-21T18:32:08.543 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92907.log.gz 2023-10-21T18:32:08.545 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101668.log 2023-10-21T18:32:08.545 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101771.log.gz 2023-10-21T18:32:08.546 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93765.log 89.2% 2023-10-21T18:32:08.547 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94909.log.gz 2023-10-21T18:32:08.548 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101668.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-21T18:32:08.548 INFO:teuthology.orchestra.run.smithi012.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101668.log.gz 2023-10-21T18:32:08.549 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93547.log 2023-10-21T18:32:08.550 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93765.log.gz 2023-10-21T18:32:08.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93756.log 2023-10-21T18:32:08.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93547.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93547.log.gz 2023-10-21T18:32:08.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94699.log 2023-10-21T18:32:08.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93756.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93756.log.gz 2023-10-21T18:32:08.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94699.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94699.log.gz 2023-10-21T18:32:08.556 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-21T18:32:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94951.log 2023-10-21T18:32:08.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.94951.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-10-21T18:32:08.562 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94951.log.gz 2023-10-21T18:32:08.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100768.log 2023-10-21T18:32:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-21T18:32:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100768.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100768.log.gz 2023-10-21T18:32:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100642.log 2023-10-21T18:32:08.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101710.log 2023-10-21T18:32:08.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100642.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-21T18:32:08.571 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100642.log.gz 2023-10-21T18:32:08.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: 89.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-21T18:32:08.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101205.log 2023-10-21T18:32:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101710.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101710.log.gz 2023-10-21T18:32:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101205.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101205.log.gz 2023-10-21T18:32:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100684.log 2023-10-21T18:32:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94388.log 2023-10-21T18:32:08.583 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100684.log.gz 2023-10-21T18:32:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94100.log 2023-10-21T18:32:08.589 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94388.log: /var/log/ceph/ceph-client.admin.94100.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94083.log 2023-10-21T18:32:08.590 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94388.log.gz 2023-10-21T18:32:08.591 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94100.log.gz 2023-10-21T18:32:08.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94083.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94083.log.gz 2023-10-21T18:32:08.597 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94741.log 2023-10-21T18:32:08.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87393.log 2023-10-21T18:32:08.601 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94741.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94741.log.gz 2023-10-21T18:32:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101289.log 2023-10-21T18:32:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.87393.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87393.log.gz 2023-10-21T18:32:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94070.log 2023-10-21T18:32:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101946.log 2023-10-21T18:32:08.607 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101289.log.gz 2023-10-21T18:32:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94070.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94070.log.gz 2023-10-21T18:32:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101946.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101946.log.gz 2023-10-21T18:32:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93421.log 2023-10-21T18:32:08.613 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93421.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93421.log.gz 2023-10-21T18:32:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93463.log 2023-10-21T18:32:08.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94078.log 2023-10-21T18:32:08.618 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93463.log.gz 2023-10-21T18:32:08.620 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-10-21T18:32:08.625 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95305.log: /var/log/ceph/ceph-client.admin.94078.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93505.log 2023-10-21T18:32:08.625 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94078.log.gz 2023-10-21T18:32:08.626 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-10-21T18:32:08.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101373.log 2023-10-21T18:32:08.630 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93505.log: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93505.log.gz 2023-10-21T18:32:08.630 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-21T18:32:08.632 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101373.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101373.log.gz 2023-10-21T18:32:08.633 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-21T18:32:08.635 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93033.log 2023-10-21T18:32:08.640 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.93033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93033.log.gz 2023-10-21T18:32:08.640 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93253.log 2023-10-21T18:32:08.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93253.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93253.log.gz 2023-10-21T18:32:08.668 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-21T18:32:09.203 INFO:teuthology.orchestra.run.smithi099.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-21T18:32:10.201 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-21T18:32:10.407 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-21T18:32:11.775 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-21T18:32:11.886 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-21T18:32:12.274 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-21T18:32:12.403 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-21T18:32:12.485 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-21T18:32:12.546 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-21T18:32:12.548 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-10-21T18:32:12.548 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m4.182s 2023-10-21T18:32:12.548 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m19.196s 2023-10-21T18:32:12.548 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.656s 2023-10-21T18:32:12.848 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-21T18:32:14.200 INFO:teuthology.orchestra.run.smithi012.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-21T18:32:14.402 INFO:teuthology.orchestra.run.smithi012.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-21T18:33:10.910 INFO:teuthology.orchestra.run.smithi012.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-21T18:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-21T18:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:real 1m2.545s 2023-10-21T18:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:user 1m20.418s 2023-10-21T18:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m6.066s 2023-10-21T18:33:10.916 INFO:tasks.ceph:Archiving logs... 2023-10-21T18:33:10.917 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi012/log 2023-10-21T18:33:10.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-21T18:33:22.641 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi099/log 2023-10-21T18:33:22.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-21T18:33:25.360 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-21T18:33:25.361 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-21T18:33:25.369 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f0804064d67a2a63dbabf1801ff452580a050cfc/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-21T18:33:25.388 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-21T18:33:25.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-21T18:33:25.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-21T18:33:25.568 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-21T18:33:25.577 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-21T18:33:25.603 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-21T18:33:25.613 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-21T18:33:25.630 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-10-21T18:33:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-21T18:33:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-10-21T18:33:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 81 +1821us[+1821us] +/- 92ms 2023-10-21T18:33:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 7 377 13 -1384us[-1384us] +/- 62ms 2023-10-21T18:33:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 9 377 208 +271us[ +271us] +/- 77ms 2023-10-21T18:33:25.636 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T18:33:25.664 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2023-10-21T18:33:25.675 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-21T18:33:25.675 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-21T18:33:25.675 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 15 +1883us[+1883us] +/- 70ms 2023-10-21T18:33:25.676 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 7 377 85 -1414us[-1414us] +/- 61ms 2023-10-21T18:33:25.676 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 21 +304us[ +304us] +/- 79ms 2023-10-21T18:33:25.676 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-21T18:33:25.677 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-21T18:33:25.688 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-21T18:33:25.688 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-21T18:33:25.707 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-21T18:33:25.994 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-21T18:33:26.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-21T18:33:26.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T18:33:26.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-21T18:33:26.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T18:33:26.251 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-21T18:33:26.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-21T18:33:26.290 INFO:teuthology.task.internal:Duration was 8785.607529 seconds 2023-10-21T18:33:26.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-21T18:33:26.323 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-21T18:33:26.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-21T18:33:26.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-21T18:33:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-21T18:33:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-21T18:33:26.928 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-21T18:33:26.929 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-10-21T18:33:26.929 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-21T18:33:26.995 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2023-10-21T18:33:26.996 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-21T18:33:27.022 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-21T18:33:27.022 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-21T18:33:27.028 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-21T18:33:27.125 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-21T18:33:27.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-21T18:33:27.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-21T18:33:27.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-21T18:33:27.388 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-21T18:33:27.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-21T18:33:27.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-21T18:33:27.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-21T18:33:27.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-21T18:33:27.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-21T18:33:27.589 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2023-10-21T18:33:27.655 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-10-21T18:33:27.713 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-21T18:33:27.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T18:33:27.768 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-21T18:33:27.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-21T18:33:27.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-21T18:33:27.794 INFO:teuthology.task.internal:Transferring archived files... 2023-10-21T18:33:27.795 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi012 2023-10-21T18:33:27.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-21T18:33:27.914 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390/remote/smithi099 2023-10-21T18:33:27.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-21T18:33:27.952 INFO:teuthology.task.internal:Removing archive directory... 2023-10-21T18:33:27.952 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-21T18:33:27.963 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-21T18:33:28.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-21T18:33:28.028 INFO:teuthology.task.internal:Not uploading archives. 2023-10-21T18:33:28.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-21T18:33:28.051 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-21T18:33:28.052 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-21T18:33:28.061 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-21T18:33:28.076 INFO:teuthology.orchestra.run.smithi099.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 18:33 /home/ubuntu/cephtest 2023-10-21T18:33:28.114 INFO:teuthology.orchestra.run.smithi012.stdout: 393592 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 18:33 /home/ubuntu/cephtest 2023-10-21T18:33:28.118 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-21T18:33:28.128 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-21T18:33:28.154 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-10-21T18:33:28.154 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T18:33:28.228 DEBUG:teuthology.nuke:shortname: smithi012 2023-10-21T18:33:28.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:33:28.253 DEBUG:teuthology.nuke:shortname: smithi099 2023-10-21T18:33:28.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:33:28.256 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 15:58:32.509645', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYN4kKqT7xVgODcVRCSZe5jsFsOCfrHaPYJH+rwCRkYG91+v0SBq7FZ9g6EmXEL4IkiQDrCcWb6rqSUlfLBcL0='} 2023-10-21T18:33:28.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:46:15-fs-main-distro-default-smithi/7434390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 15:58:32.511350', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVkwp3no3ElQupln7HpL62qvqewOLKkQLS2EhgGvpL4oHHkRLhvdEoXYU/8yLVd6YgEBtq2APMjTS0n0gnLgsg='} 2023-10-21T18:33:28.311 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-21T18:33:28.353 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:33:28.379 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-21T18:33:28.380 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:28.394 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-21T18:33:28.395 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:33:28.405 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-21T18:33:28.418 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-21T18:33:28.418 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:28.442 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-21T18:33:32.406 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:32.444 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:32.515 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-21T18:33:32.555 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-21T18:33:36.517 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:36.556 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:36.628 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-21T18:33:36.667 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-21T18:33:36.729 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-21T18:33:40.672 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:33:40.783 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-21T18:33:40.884 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-21T18:33:40.989 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} duration: 8785.607528924942 failure_reason: '"2023-10-21T17:31:46.557104+0000 mds.c (mds.0) 26 : cluster [WRN] client.4573 isn''t responding to mclientcaps(revoke), ino 0x100000035ab pending pAsLsXs issued pAsLsXsFsxc, sent 301.405456 seconds ago" in cluster log' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-10-21T18:33:40.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:33:41.075 INFO:teuthology.run:FAIL